python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1333823 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3422174'] with mtr_portfolio_ids : ['25583540'] and first list_photo_ids : [] new path : /proc/1333823/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 12 ; length of list_pids : 12 ; length of list_args : 12 time to download the photos : 1.8487067222595215 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Aug 1 15:30:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10957 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-01 15:30:34.747412: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-01 15:30:34.771298: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-08-01 15:30:34.773211: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f8bd0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-01 15:30:34.773268: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-01 15:30:34.777240: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-01 15:30:34.887974: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x40c726d0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-01 15:30:34.888028: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-01 15:30:34.889512: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-01 15:30:34.889920: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-01 15:30:34.892965: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-01 15:30:34.895909: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-01 15:30:34.896417: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-01 15:30:34.899046: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-01 15:30:34.900358: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-01 15:30:34.905617: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-01 15:30:34.907478: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-01 15:30:34.907570: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-01 15:30:34.908536: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-01 15:30:34.908556: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-01 15:30:34.908567: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-01 15:30:34.909979: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10011 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-01 15:30:35.293408: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-01 15:30:35.293519: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-01 15:30:35.293549: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-01 15:30:35.293575: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-01 15:30:35.293602: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-01 15:30:35.293628: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-01 15:30:35.293655: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-01 15:30:35.293680: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-01 15:30:35.295464: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-01 15:30:35.296988: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-01 15:30:35.297046: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-01 15:30:35.297074: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-01 15:30:35.297101: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-01 15:30:35.297127: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-01 15:30:35.297153: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-01 15:30:35.297180: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-01 15:30:35.297206: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-01 15:30:35.298865: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-01 15:30:35.298900: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-01 15:30:35.298913: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-01 15:30:35.298923: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-01 15:30:35.300640: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10011 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-01 15:30:43.683912: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-01 15:30:43.862436: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 44.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 Detection mask done ! Trying to reset tf kernel 1334447 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1888 tf kernel not reseted sub process len(results) : 12 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 12 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7177 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0005588531494140625 nb_pixel_total : 30516 time to create 1 rle with old method : 0.03434395790100098 length of segment : 116 time for calcul the mask position with numpy : 0.00021266937255859375 nb_pixel_total : 12054 time to create 1 rle with old method : 0.013716459274291992 length of segment : 141 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 3188 time to create 1 rle with old method : 0.0038106441497802734 length of segment : 71 time for calcul the mask position with numpy : 0.0008056163787841797 nb_pixel_total : 60853 time to create 1 rle with old method : 0.0687255859375 length of segment : 242 time for calcul the mask position with numpy : 0.0016894340515136719 nb_pixel_total : 116934 time to create 1 rle with old method : 0.13028335571289062 length of segment : 533 time for calcul the mask position with numpy : 0.00010609626770019531 nb_pixel_total : 3229 time to create 1 rle with old method : 0.00395655632019043 length of segment : 75 time for calcul the mask position with numpy : 0.00022172927856445312 nb_pixel_total : 13818 time to create 1 rle with old method : 0.016218900680541992 length of segment : 141 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 1335 time to create 1 rle with old method : 0.0016863346099853516 length of segment : 80 time for calcul the mask position with numpy : 0.0004353523254394531 nb_pixel_total : 39198 time to create 1 rle with old method : 0.043492794036865234 length of segment : 269 time for calcul the mask position with numpy : 0.010190725326538086 nb_pixel_total : 551612 time to create 1 rle with new method : 0.05690121650695801 length of segment : 692 time for calcul the mask position with numpy : 0.0015361309051513672 nb_pixel_total : 120787 time to create 1 rle with old method : 0.13053536415100098 length of segment : 544 time for calcul the mask position with numpy : 9.870529174804688e-05 nb_pixel_total : 3963 time to create 1 rle with old method : 0.004631757736206055 length of segment : 78 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 2967 time to create 1 rle with old method : 0.0033597946166992188 length of segment : 91 time for calcul the mask position with numpy : 0.0004749298095703125 nb_pixel_total : 26331 time to create 1 rle with old method : 0.029044151306152344 length of segment : 270 time for calcul the mask position with numpy : 0.0003025531768798828 nb_pixel_total : 19172 time to create 1 rle with old method : 0.021593093872070312 length of segment : 261 time for calcul the mask position with numpy : 0.00011515617370605469 nb_pixel_total : 4722 time to create 1 rle with old method : 0.005689144134521484 length of segment : 77 time for calcul the mask position with numpy : 0.00021982192993164062 nb_pixel_total : 12236 time to create 1 rle with old method : 0.013921737670898438 length of segment : 183 time for calcul the mask position with numpy : 9.751319885253906e-05 nb_pixel_total : 5018 time to create 1 rle with old method : 0.005736351013183594 length of segment : 96 time for calcul the mask position with numpy : 0.0003681182861328125 nb_pixel_total : 25404 time to create 1 rle with old method : 0.03371310234069824 length of segment : 217 time for calcul the mask position with numpy : 0.0002028942108154297 nb_pixel_total : 6011 time to create 1 rle with old method : 0.006987571716308594 length of segment : 65 time for calcul the mask position with numpy : 0.0003867149353027344 nb_pixel_total : 5204 time to create 1 rle with old method : 0.006180763244628906 length of segment : 182 time for calcul the mask position with numpy : 0.0018467903137207031 nb_pixel_total : 85088 time to create 1 rle with old method : 0.09320211410522461 length of segment : 269 time for calcul the mask position with numpy : 0.00038123130798339844 nb_pixel_total : 12629 time to create 1 rle with old method : 0.014842987060546875 length of segment : 164 time for calcul the mask position with numpy : 0.0002434253692626953 nb_pixel_total : 6409 time to create 1 rle with old method : 0.00754857063293457 length of segment : 101 time for calcul the mask position with numpy : 0.00020599365234375 nb_pixel_total : 3122 time to create 1 rle with old method : 0.003859281539916992 length of segment : 72 time for calcul the mask position with numpy : 0.002165079116821289 nb_pixel_total : 97757 time to create 1 rle with old method : 0.10967731475830078 length of segment : 535 time for calcul the mask position with numpy : 0.00013780593872070312 nb_pixel_total : 4026 time to create 1 rle with old method : 0.004878044128417969 length of segment : 91 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 2599 time to create 1 rle with old method : 0.003127574920654297 length of segment : 61 time for calcul the mask position with numpy : 0.0002951622009277344 nb_pixel_total : 8154 time to create 1 rle with old method : 0.009680032730102539 length of segment : 109 time for calcul the mask position with numpy : 0.0005872249603271484 nb_pixel_total : 21521 time to create 1 rle with old method : 0.024581432342529297 length of segment : 195 time for calcul the mask position with numpy : 0.0004112720489501953 nb_pixel_total : 16825 time to create 1 rle with old method : 0.01832866668701172 length of segment : 149 time for calcul the mask position with numpy : 0.0004520416259765625 nb_pixel_total : 12609 time to create 1 rle with old method : 0.014150142669677734 length of segment : 226 time for calcul the mask position with numpy : 0.00035691261291503906 nb_pixel_total : 19996 time to create 1 rle with old method : 0.022514820098876953 length of segment : 117 time for calcul the mask position with numpy : 0.0003669261932373047 nb_pixel_total : 14583 time to create 1 rle with old method : 0.01644420623779297 length of segment : 142 time for calcul the mask position with numpy : 0.00022864341735839844 nb_pixel_total : 5878 time to create 1 rle with old method : 0.0069065093994140625 length of segment : 90 time for calcul the mask position with numpy : 0.0004913806915283203 nb_pixel_total : 18694 time to create 1 rle with old method : 0.020503759384155273 length of segment : 148 time for calcul the mask position with numpy : 0.0004038810729980469 nb_pixel_total : 14184 time to create 1 rle with old method : 0.015505552291870117 length of segment : 179 time for calcul the mask position with numpy : 0.0002410411834716797 nb_pixel_total : 5233 time to create 1 rle with old method : 0.00611114501953125 length of segment : 83 time for calcul the mask position with numpy : 0.0003838539123535156 nb_pixel_total : 13444 time to create 1 rle with old method : 0.015610933303833008 length of segment : 147 time for calcul the mask position with numpy : 0.00229644775390625 nb_pixel_total : 105763 time to create 1 rle with old method : 0.11429715156555176 length of segment : 543 time spent for convertir_results : 2.654027223587036 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 40 chid ids of type : 3594 Number RLEs to save : 7845 save missing photos in datou_result : time spend for datou_step_exec : 26.735633850097656 time spend to save output : 1.216083288192749 total time spend for step 1 : 27.951717138290405 step2:crop_condition Fri Aug 1 15:30:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 12 ! batch 1 Loaded 40 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 20 About to insert : list_path_to_insert length 20 new photo from crops ! About to upload 20 photos upload in portfolio : 3736932 init cache_photo without model_param we have 20 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754055062_1333823 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 20 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.552813529968262 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754055070_1333823 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.4034850597381592 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 3736932 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754055077_1333823 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 17 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.4355878829956055 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1374767263, 1374767260, 1374767256, 1374767251, 1374767248, 1374767202, 1374767199, 1374767189, 1374767140, 1374767134, 1374767130, 1374767126] Looping around the photos to save general results len do output : 40 /1374784564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374784624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767263', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767260', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767256', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767251', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767248', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767202', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767199', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767189', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767140', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767134', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767130', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767126', None, None, None, None, None, '3422174') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 132 time used for this insertion : 0.04427075386047363 save_final save missing photos in datou_result : time spend for datou_step_exec : 23.63499140739441 time spend to save output : 0.0458981990814209 total time spend for step 2 : 23.68088960647583 step3:rle_unique_nms_with_priority Fri Aug 1 15:31:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 40 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.44642114639282227 time for calcul the mask position with numpy : 0.28564953804016113 nb_pixel_total : 1850055 time to create 1 rle with new method : 0.09373140335083008 time for calcul the mask position with numpy : 0.0064661502838134766 nb_pixel_total : 116934 time to create 1 rle with old method : 0.1282196044921875 time for calcul the mask position with numpy : 0.007660627365112305 nb_pixel_total : 60853 time to create 1 rle with old method : 0.08047151565551758 time for calcul the mask position with numpy : 0.006783962249755859 nb_pixel_total : 3188 time to create 1 rle with old method : 0.0036432743072509766 time for calcul the mask position with numpy : 0.006823539733886719 nb_pixel_total : 12054 time to create 1 rle with old method : 0.013556480407714844 time for calcul the mask position with numpy : 0.007004737854003906 nb_pixel_total : 30516 time to create 1 rle with old method : 0.034218788146972656 create new chi : 0.6845359802246094 time to delete rle : 0.1150519847869873 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 3286 TO DO : save crop sub photo not yet done ! save time : 0.5478312969207764 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.567030668258667 time for calcul the mask position with numpy : 0.3498656749725342 nb_pixel_total : 1473063 time to create 1 rle with new method : 0.09710049629211426 time for calcul the mask position with numpy : 0.010346412658691406 nb_pixel_total : 542957 time to create 1 rle with new method : 0.08702826499938965 time for calcul the mask position with numpy : 0.0065686702728271484 nb_pixel_total : 39198 time to create 1 rle with old method : 0.04339146614074707 time for calcul the mask position with numpy : 0.0066640377044677734 nb_pixel_total : 1335 time to create 1 rle with old method : 0.0015037059783935547 time for calcul the mask position with numpy : 0.006639242172241211 nb_pixel_total : 13818 time to create 1 rle with old method : 0.015479803085327148 time for calcul the mask position with numpy : 0.006053447723388672 nb_pixel_total : 3229 time to create 1 rle with old method : 0.0036187171936035156 create new chi : 0.6503381729125977 time to delete rle : 0.0004444122314453125 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 3514 TO DO : save crop sub photo not yet done ! save time : 0.6014301776885986 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03368377685546875 time for calcul the mask position with numpy : 0.01815176010131836 nb_pixel_total : 1952813 time to create 1 rle with new method : 0.19606471061706543 time for calcul the mask position with numpy : 0.007230043411254883 nb_pixel_total : 120787 time to create 1 rle with old method : 0.14290714263916016 create new chi : 0.36470675468444824 time to delete rle : 0.0003204345703125 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2168 TO DO : save crop sub photo not yet done ! save time : 0.425523042678833 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04981064796447754 time for calcul the mask position with numpy : 0.02943587303161621 nb_pixel_total : 2040339 time to create 1 rle with new method : 0.09134435653686523 time for calcul the mask position with numpy : 0.006273984909057617 nb_pixel_total : 26331 time to create 1 rle with old method : 0.028534889221191406 time for calcul the mask position with numpy : 0.005947589874267578 nb_pixel_total : 2967 time to create 1 rle with old method : 0.003281831741333008 time for calcul the mask position with numpy : 0.005670309066772461 nb_pixel_total : 3963 time to create 1 rle with old method : 0.004534006118774414 create new chi : 0.18530917167663574 time to delete rle : 0.0003497600555419922 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 1958 TO DO : save crop sub photo not yet done ! save time : 0.3951148986816406 nb_obj : 8 nb_hashtags : 1 time to prepare the origin masks : 0.6419193744659424 time for calcul the mask position with numpy : 0.1888129711151123 nb_pixel_total : 1912547 time to create 1 rle with new method : 0.09772062301635742 time for calcul the mask position with numpy : 0.006665945053100586 nb_pixel_total : 84104 time to create 1 rle with old method : 0.11966347694396973 time for calcul the mask position with numpy : 0.006191253662109375 nb_pixel_total : 5204 time to create 1 rle with old method : 0.006341695785522461 time for calcul the mask position with numpy : 0.005992889404296875 nb_pixel_total : 6011 time to create 1 rle with old method : 0.0070226192474365234 time for calcul the mask position with numpy : 0.006072044372558594 nb_pixel_total : 24586 time to create 1 rle with old method : 0.027486324310302734 time for calcul the mask position with numpy : 0.00592350959777832 nb_pixel_total : 5018 time to create 1 rle with old method : 0.0053975582122802734 time for calcul the mask position with numpy : 0.0060694217681884766 nb_pixel_total : 12236 time to create 1 rle with old method : 0.013166666030883789 time for calcul the mask position with numpy : 0.005888700485229492 nb_pixel_total : 4722 time to create 1 rle with old method : 0.004983186721801758 time for calcul the mask position with numpy : 0.006031513214111328 nb_pixel_total : 19172 time to create 1 rle with old method : 0.02052617073059082 create new chi : 0.5503973960876465 time to delete rle : 0.0004856586456298828 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++++Number RLEs to save : 3635 TO DO : save crop sub photo not yet done ! save time : 0.4513542652130127 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.036919355392456055 time for calcul the mask position with numpy : 0.018885135650634766 nb_pixel_total : 2060971 time to create 1 rle with new method : 0.028305530548095703 time for calcul the mask position with numpy : 0.007315158843994141 nb_pixel_total : 12629 time to create 1 rle with old method : 0.01919841766357422 create new chi : 0.08566951751708984 time to delete rle : 0.0003173351287841797 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1408 TO DO : save crop sub photo not yet done ! save time : 0.23259949684143066 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.8799335956573486 time for calcul the mask position with numpy : 0.09206128120422363 nb_pixel_total : 1959687 time to create 1 rle with new method : 0.3970072269439697 time for calcul the mask position with numpy : 0.0075190067291259766 nb_pixel_total : 2599 time to create 1 rle with old method : 0.003090381622314453 time for calcul the mask position with numpy : 0.007889509201049805 nb_pixel_total : 4026 time to create 1 rle with old method : 0.004752397537231445 time for calcul the mask position with numpy : 0.007523775100708008 nb_pixel_total : 97757 time to create 1 rle with old method : 0.11488842964172363 time for calcul the mask position with numpy : 0.007851123809814453 nb_pixel_total : 3122 time to create 1 rle with old method : 0.003866910934448242 time for calcul the mask position with numpy : 0.008034706115722656 nb_pixel_total : 6409 time to create 1 rle with old method : 0.0067675113677978516 create new chi : 0.6719870567321777 time to delete rle : 0.0007340908050537109 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2800 TO DO : save crop sub photo not yet done ! save time : 0.47495388984680176 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.10606098175048828 time for calcul the mask position with numpy : 0.03896927833557129 nb_pixel_total : 2043925 time to create 1 rle with new method : 0.3269076347351074 time for calcul the mask position with numpy : 0.0070934295654296875 nb_pixel_total : 21521 time to create 1 rle with old method : 0.024413108825683594 time for calcul the mask position with numpy : 0.007205963134765625 nb_pixel_total : 8154 time to create 1 rle with old method : 0.008681535720825195 create new chi : 0.4200589656829834 time to delete rle : 0.0004191398620605469 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1688 TO DO : save crop sub photo not yet done ! save time : 0.3767824172973633 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.07219815254211426 time for calcul the mask position with numpy : 0.09089350700378418 nb_pixel_total : 2024170 time to create 1 rle with new method : 0.2669539451599121 time for calcul the mask position with numpy : 0.008055686950683594 nb_pixel_total : 19996 time to create 1 rle with old method : 0.02385234832763672 time for calcul the mask position with numpy : 0.006990671157836914 nb_pixel_total : 12609 time to create 1 rle with old method : 0.014025449752807617 time for calcul the mask position with numpy : 0.00714874267578125 nb_pixel_total : 16825 time to create 1 rle with old method : 0.018660306930541992 create new chi : 0.4484670162200928 time to delete rle : 0.0005588531494140625 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 2064 TO DO : save crop sub photo not yet done ! save time : 0.48210906982421875 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.052214860916137695 time for calcul the mask position with numpy : 0.09844827651977539 nb_pixel_total : 2053139 time to create 1 rle with new method : 0.33600902557373047 time for calcul the mask position with numpy : 0.008073806762695312 nb_pixel_total : 5878 time to create 1 rle with old method : 0.008298158645629883 time for calcul the mask position with numpy : 0.006379127502441406 nb_pixel_total : 14583 time to create 1 rle with old method : 0.01587367057800293 create new chi : 0.48570799827575684 time to delete rle : 0.0004220008850097656 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1544 TO DO : save crop sub photo not yet done ! save time : 0.43716883659362793 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.05737924575805664 time for calcul the mask position with numpy : 0.08194112777709961 nb_pixel_total : 2040722 time to create 1 rle with new method : 0.32388949394226074 time for calcul the mask position with numpy : 0.007342338562011719 nb_pixel_total : 14184 time to create 1 rle with old method : 0.018085956573486328 time for calcul the mask position with numpy : 0.007928133010864258 nb_pixel_total : 18694 time to create 1 rle with old method : 0.030903339385986328 create new chi : 0.4810292720794678 time to delete rle : 0.0005373954772949219 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1734 TO DO : save crop sub photo not yet done ! save time : 0.6068196296691895 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.42127513885498047 time for calcul the mask position with numpy : 0.21526241302490234 nb_pixel_total : 1949160 time to create 1 rle with new method : 0.2703425884246826 time for calcul the mask position with numpy : 0.009015798568725586 nb_pixel_total : 105763 time to create 1 rle with old method : 0.11526370048522949 time for calcul the mask position with numpy : 0.006761312484741211 nb_pixel_total : 13444 time to create 1 rle with old method : 0.016476154327392578 time for calcul the mask position with numpy : 0.006592512130737305 nb_pixel_total : 5233 time to create 1 rle with old method : 0.008755683898925781 create new chi : 0.6598010063171387 time to delete rle : 0.0005857944488525391 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 2626 TO DO : save crop sub photo not yet done ! save time : 0.3733978271484375 map_output_result : {1374767263: (0.0, 'Should be the crop_list due to order', 0), 1374767260: (0.0, 'Should be the crop_list due to order', 0), 1374767256: (0.0, 'Should be the crop_list due to order', 0), 1374767251: (0.0, 'Should be the crop_list due to order', 0), 1374767248: (0.0, 'Should be the crop_list due to order', 0), 1374767202: (0.0, 'Should be the crop_list due to order', 0), 1374767199: (0.0, 'Should be the crop_list due to order', 0), 1374767189: (0.0, 'Should be the crop_list due to order', 0), 1374767140: (0.0, 'Should be the crop_list due to order', 0), 1374767134: (0.0, 'Should be the crop_list due to order', 0), 1374767130: (0.0, 'Should be the crop_list due to order', 0), 1374767126: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1374767263, 1374767260, 1374767256, 1374767251, 1374767248, 1374767202, 1374767199, 1374767189, 1374767140, 1374767134, 1374767130, 1374767126] Looping around the photos to save general results len do output : 12 /1374767263.Didn't retrieve data . /1374767260.Didn't retrieve data . /1374767256.Didn't retrieve data . /1374767251.Didn't retrieve data . /1374767248.Didn't retrieve data . /1374767202.Didn't retrieve data . /1374767199.Didn't retrieve data . /1374767189.Didn't retrieve data . /1374767140.Didn't retrieve data . /1374767134.Didn't retrieve data . /1374767130.Didn't retrieve data . /1374767126.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767263', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767260', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767256', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767251', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767248', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767202', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767199', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767189', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767140', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767134', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767130', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767126', None, None, None, None, None, '3422174') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.03953433036804199 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.1153404712677 time spend to save output : 0.03998231887817383 total time spend for step 3 : 15.155322790145874 step4:ventilate_hashtags_in_portfolio Fri Aug 1 15:31:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25583540 get user id for portfolio 25583540 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25583540 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pehd','environnement','flou','metal','papier','mal_croppe','carton','pet_clair','background','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25583540 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pehd','environnement','flou','metal','papier','mal_croppe','carton','pet_clair','background','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25583540 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pehd','environnement','flou','metal','papier','mal_croppe','carton','pet_clair','background','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25585151,25585152,25585153,25585154,25585155,25585156,25585157,25585158,25585159,25585160,25585161?tags=autre,pehd,environnement,flou,metal,papier,mal_croppe,carton,pet_clair,background,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1374767263, 1374767260, 1374767256, 1374767251, 1374767248, 1374767202, 1374767199, 1374767189, 1374767140, 1374767134, 1374767130, 1374767126] Looping around the photos to save general results len do output : 1 /25583540. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767263', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767260', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767256', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767251', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767248', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767202', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767199', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767189', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767140', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767134', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767130', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767126', None, None, None, None, None, '3422174') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.022952556610107422 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.3853280544281006 time spend to save output : 0.02339005470275879 total time spend for step 4 : 2.4087181091308594 step5:final Fri Aug 1 15:31:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1374767263: ('0.06119024080504116',), 1374767260: ('0.06119024080504116',), 1374767256: ('0.06119024080504116',), 1374767251: ('0.06119024080504116',), 1374767248: ('0.06119024080504116',), 1374767202: ('0.06119024080504116',), 1374767199: ('0.06119024080504116',), 1374767189: ('0.06119024080504116',), 1374767140: ('0.06119024080504116',), 1374767134: ('0.06119024080504116',), 1374767130: ('0.06119024080504116',), 1374767126: ('0.06119024080504116',)} new output for save of step final : {1374767263: ('0.06119024080504116',), 1374767260: ('0.06119024080504116',), 1374767256: ('0.06119024080504116',), 1374767251: ('0.06119024080504116',), 1374767248: ('0.06119024080504116',), 1374767202: ('0.06119024080504116',), 1374767199: ('0.06119024080504116',), 1374767189: ('0.06119024080504116',), 1374767140: ('0.06119024080504116',), 1374767134: ('0.06119024080504116',), 1374767130: ('0.06119024080504116',), 1374767126: ('0.06119024080504116',)} [1374767263, 1374767260, 1374767256, 1374767251, 1374767248, 1374767202, 1374767199, 1374767189, 1374767140, 1374767134, 1374767130, 1374767126] Looping around the photos to save general results len do output : 12 /1374767263.Didn't retrieve data . /1374767260.Didn't retrieve data . /1374767256.Didn't retrieve data . /1374767251.Didn't retrieve data . /1374767248.Didn't retrieve data . /1374767202.Didn't retrieve data . /1374767199.Didn't retrieve data . /1374767189.Didn't retrieve data . /1374767140.Didn't retrieve data . /1374767134.Didn't retrieve data . /1374767130.Didn't retrieve data . /1374767126.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767263', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767260', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767256', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767251', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767248', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767202', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767199', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767189', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767140', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767134', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767130', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767126', None, None, None, None, None, '3422174') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.01923680305480957 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.18536949157714844 time spend to save output : 0.019768714904785156 total time spend for step 5 : 0.2051382064819336 step6:blur_detection Fri Aug 1 15:31:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1754055030_1333823_1374767263_908efd990889bcd3e6e6e94e95ffd7b3.jpg resize: (1080, 1920) 1374767263 -2.271955923016564 treat image : temp/1754055030_1333823_1374767260_b178c5436e0861d0f18fb6c5eceb26a3.jpg resize: (1080, 1920) 1374767260 -1.1591694499258702 treat image : temp/1754055030_1333823_1374767256_c9f63136730307228aa7b88355e846de.jpg resize: (1080, 1920) 1374767256 -4.908741027491516 treat image : temp/1754055030_1333823_1374767251_cd1f8d78dd2d89ced1958944a9c9a2b6.jpg resize: (1080, 1920) 1374767251 0.3844821695283094 treat image : temp/1754055030_1333823_1374767248_caf2fed8edd2781a3811a133363c22d7.jpg resize: (1080, 1920) 1374767248 -3.821425839700746 treat image : temp/1754055030_1333823_1374767202_77a8d0b2b3571478757530ec2c8cab2b.jpg resize: (1080, 1920) 1374767202 -0.5825485731432074 treat image : temp/1754055030_1333823_1374767199_fcdb46349fcaa684b536a20c8840b4c8.jpg resize: (1080, 1920) 1374767199 -5.327171757289037 treat image : temp/1754055030_1333823_1374767189_bb765a20ca0928bddde14c1e91674bcd.jpg resize: (1080, 1920) 1374767189 -0.552340113018424 treat image : temp/1754055030_1333823_1374767140_c39d8fab14ea87e3ef36e66967e97f8d.jpg resize: (1080, 1920) 1374767140 -4.972151202314639 treat image : temp/1754055030_1333823_1374767134_0867a7c7b93ade90b6fdb33526631886.jpg resize: (1080, 1920) 1374767134 -0.8902612457619317 treat image : temp/1754055030_1333823_1374767130_9f8708198d8a82f51948b89ecd803812.jpg resize: (1080, 1920) 1374767130 -1.2198733885851443 treat image : temp/1754055030_1333823_1374767126_fa228e8bc69ee014e720897cdd8ceba8.jpg resize: (1080, 1920) 1374767126 -4.977153294640044 treat image : temp/1754055030_1333823_1374767263_908efd990889bcd3e6e6e94e95ffd7b3_rle_crop_3900470020_0.png resize: (71, 80) 1374784564 -2.917220397398157 treat image : temp/1754055030_1333823_1374767260_b178c5436e0861d0f18fb6c5eceb26a3_rle_crop_3900470025_0.png resize: (48, 52) 1374784566 -3.4108260855106414 treat image : temp/1754055030_1333823_1374767260_b178c5436e0861d0f18fb6c5eceb26a3_rle_crop_3900470026_0.png resize: (258, 178) 1374784568 1.8915822980346348 treat image : temp/1754055030_1333823_1374767260_b178c5436e0861d0f18fb6c5eceb26a3_rle_crop_3900470023_0.png resize: (75, 81) 1374784569 -3.777586949796489 treat image : temp/1754055030_1333823_1374767251_cd1f8d78dd2d89ced1958944a9c9a2b6_rle_crop_3900470029_0.png resize: (78, 74) 1374784571 -1.0591078214420688 treat image : temp/1754055030_1333823_1374767251_cd1f8d78dd2d89ced1958944a9c9a2b6_rle_crop_3900470030_0.png resize: (91, 43) 1374784572 -1.436151533314088 treat image : temp/1754055030_1333823_1374767248_caf2fed8edd2781a3811a133363c22d7_rle_crop_3900470038_0.png resize: (173, 71) 1374784574 -3.038960639233888 treat image : temp/1754055030_1333823_1374767248_caf2fed8edd2781a3811a133363c22d7_rle_crop_3900470039_0.png resize: (255, 447) 1374784575 -5.0212318053803475 treat image : temp/1754055030_1333823_1374767248_caf2fed8edd2781a3811a133363c22d7_rle_crop_3900470037_0.png resize: (56, 151) 1374784577 -2.1803721089169614 treat image : temp/1754055030_1333823_1374767248_caf2fed8edd2781a3811a133363c22d7_rle_crop_3900470032_0.png resize: (241, 129) 1374784578 -1.316284164570076 treat image : temp/1754055030_1333823_1374767248_caf2fed8edd2781a3811a133363c22d7_rle_crop_3900470033_0.png resize: (77, 101) 1374784581 -1.9886537133002526 treat image : temp/1754055030_1333823_1374767248_caf2fed8edd2781a3811a133363c22d7_rle_crop_3900470034_0.png resize: (182, 119) 1374784582 -1.9591957379797391 treat image : temp/1754055030_1333823_1374767248_caf2fed8edd2781a3811a133363c22d7_rle_crop_3900470036_0.png resize: (178, 230) 1374784584 -1.9625534021658786 treat image : temp/1754055030_1333823_1374767248_caf2fed8edd2781a3811a133363c22d7_rle_crop_3900470035_0.png resize: (96, 69) 1374784586 0.1836713479745299 treat image : temp/1754055030_1333823_1374767202_77a8d0b2b3571478757530ec2c8cab2b_rle_crop_3900470040_0.png resize: (164, 126) 1374784587 -1.3785041600877197 treat image : temp/1754055030_1333823_1374767199_fcdb46349fcaa684b536a20c8840b4c8_rle_crop_3900470045_0.png resize: (61, 60) 1374784589 -3.447457852238153 treat image : temp/1754055030_1333823_1374767199_fcdb46349fcaa684b536a20c8840b4c8_rle_crop_3900470044_0.png resize: (91, 98) 1374784590 -4.524629168890422 treat image : temp/1754055030_1333823_1374767199_fcdb46349fcaa684b536a20c8840b4c8_rle_crop_3900470042_0.png resize: (72, 82) 1374784592 -4.0288635920120255 treat image : temp/1754055030_1333823_1374767134_0867a7c7b93ade90b6fdb33526631886_rle_crop_3900470052_0.png resize: (90, 108) 1374784593 -1.0950797076887067 treat image : temp/1754055030_1333823_1374767130_9f8708198d8a82f51948b89ecd803812_rle_crop_3900470053_0.png resize: (146, 252) 1374784595 -1.6077536310360205 treat image : temp/1754055030_1333823_1374767199_fcdb46349fcaa684b536a20c8840b4c8_rle_crop_3900470041_0.png resize: (101, 76) 1374784602 2.775274994318954 treat image : temp/1754055030_1333823_1374767189_bb765a20ca0928bddde14c1e91674bcd_rle_crop_3900470046_0.png resize: (109, 104) 1374784603 -0.7444124444984747 treat image : temp/1754055030_1333823_1374767126_fa228e8bc69ee014e720897cdd8ceba8_rle_crop_3900470055_0.png resize: (76, 81) 1374784605 3.6986623450167 treat image : temp/1754055030_1333823_1374767263_908efd990889bcd3e6e6e94e95ffd7b3_rle_crop_3900470018_0.png resize: (114, 354) 1374784608 -1.0717827192868237 treat image : temp/1754055030_1333823_1374767263_908efd990889bcd3e6e6e94e95ffd7b3_rle_crop_3900470019_0.png resize: (140, 122) 1374784609 -2.659976758515839 treat image : temp/1754055030_1333823_1374767263_908efd990889bcd3e6e6e94e95ffd7b3_rle_crop_3900470021_0.png resize: (226, 324) 1374784610 -0.9777952569569498 treat image : temp/1754055030_1333823_1374767263_908efd990889bcd3e6e6e94e95ffd7b3_rle_crop_3900470022_0.png resize: (533, 333) 1374784611 0.3337634474752927 treat image : temp/1754055030_1333823_1374767260_b178c5436e0861d0f18fb6c5eceb26a3_rle_crop_3900470027_0.png resize: (626, 1031) 1374784612 -0.3358062926067294 treat image : temp/1754055030_1333823_1374767260_b178c5436e0861d0f18fb6c5eceb26a3_rle_crop_3900470024_0.png resize: (141, 132) 1374784613 -2.5221027583623896 treat image : temp/1754055030_1333823_1374767256_c9f63136730307228aa7b88355e846de_rle_crop_3900470028_0.png resize: (542, 366) 1374784614 0.037685210791696684 treat image : temp/1754055030_1333823_1374767251_cd1f8d78dd2d89ced1958944a9c9a2b6_rle_crop_3900470031_0.png resize: (228, 193) 1374784615 -1.0153973900670745 treat image : temp/1754055030_1333823_1374767199_fcdb46349fcaa684b536a20c8840b4c8_rle_crop_3900470043_0.png resize: (535, 299) 1374784616 -0.029441813361826878 treat image : temp/1754055030_1333823_1374767189_bb765a20ca0928bddde14c1e91674bcd_rle_crop_3900470047_0.png resize: (176, 213) 1374784617 -1.2460959428648415 treat image : temp/1754055030_1333823_1374767140_c39d8fab14ea87e3ef36e66967e97f8d_rle_crop_3900470050_0.png resize: (116, 295) 1374784618 -2.58890478918264 treat image : temp/1754055030_1333823_1374767140_c39d8fab14ea87e3ef36e66967e97f8d_rle_crop_3900470049_0.png resize: (177, 132) 1374784619 -4.416316163831804 treat image : temp/1754055030_1333823_1374767140_c39d8fab14ea87e3ef36e66967e97f8d_rle_crop_3900470048_0.png resize: (139, 158) 1374784620 -1.9536808248967257 treat image : temp/1754055030_1333823_1374767134_0867a7c7b93ade90b6fdb33526631886_rle_crop_3900470051_0.png resize: (134, 134) 1374784621 -1.045689481757104 treat image : temp/1754055030_1333823_1374767130_9f8708198d8a82f51948b89ecd803812_rle_crop_3900470054_0.png resize: (175, 122) 1374784622 -1.0857799490078925 treat image : temp/1754055030_1333823_1374767126_fa228e8bc69ee014e720897cdd8ceba8_rle_crop_3900470056_0.png resize: (136, 125) 1374784623 -3.640893280043398 treat image : temp/1754055030_1333823_1374767126_fa228e8bc69ee014e720897cdd8ceba8_rle_crop_3900470057_0.png resize: (535, 321) 1374784624 -0.28774759140904543 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 52 time used for this insertion : 0.028900623321533203 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 52 time used for this insertion : 0.031200170516967773 save missing photos in datou_result : time spend for datou_step_exec : 9.966092109680176 time spend to save output : 0.07173490524291992 total time spend for step 6 : 10.037827014923096 step7:brightness Fri Aug 1 15:31:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1754055030_1333823_1374767263_908efd990889bcd3e6e6e94e95ffd7b3.jpg treat image : temp/1754055030_1333823_1374767260_b178c5436e0861d0f18fb6c5eceb26a3.jpg treat image : temp/1754055030_1333823_1374767256_c9f63136730307228aa7b88355e846de.jpg treat image : temp/1754055030_1333823_1374767251_cd1f8d78dd2d89ced1958944a9c9a2b6.jpg treat image : temp/1754055030_1333823_1374767248_caf2fed8edd2781a3811a133363c22d7.jpg treat image : temp/1754055030_1333823_1374767202_77a8d0b2b3571478757530ec2c8cab2b.jpg treat image : temp/1754055030_1333823_1374767199_fcdb46349fcaa684b536a20c8840b4c8.jpg treat image : temp/1754055030_1333823_1374767189_bb765a20ca0928bddde14c1e91674bcd.jpg treat image : temp/1754055030_1333823_1374767140_c39d8fab14ea87e3ef36e66967e97f8d.jpg treat image : temp/1754055030_1333823_1374767134_0867a7c7b93ade90b6fdb33526631886.jpg treat image : temp/1754055030_1333823_1374767130_9f8708198d8a82f51948b89ecd803812.jpg treat image : temp/1754055030_1333823_1374767126_fa228e8bc69ee014e720897cdd8ceba8.jpg treat image : temp/1754055030_1333823_1374767263_908efd990889bcd3e6e6e94e95ffd7b3_rle_crop_3900470020_0.png treat image : temp/1754055030_1333823_1374767260_b178c5436e0861d0f18fb6c5eceb26a3_rle_crop_3900470025_0.png treat image : temp/1754055030_1333823_1374767260_b178c5436e0861d0f18fb6c5eceb26a3_rle_crop_3900470026_0.png treat image : temp/1754055030_1333823_1374767260_b178c5436e0861d0f18fb6c5eceb26a3_rle_crop_3900470023_0.png treat image : temp/1754055030_1333823_1374767251_cd1f8d78dd2d89ced1958944a9c9a2b6_rle_crop_3900470029_0.png treat image : temp/1754055030_1333823_1374767251_cd1f8d78dd2d89ced1958944a9c9a2b6_rle_crop_3900470030_0.png treat image : temp/1754055030_1333823_1374767248_caf2fed8edd2781a3811a133363c22d7_rle_crop_3900470038_0.png treat image : temp/1754055030_1333823_1374767248_caf2fed8edd2781a3811a133363c22d7_rle_crop_3900470039_0.png treat image : temp/1754055030_1333823_1374767248_caf2fed8edd2781a3811a133363c22d7_rle_crop_3900470037_0.png treat image : temp/1754055030_1333823_1374767248_caf2fed8edd2781a3811a133363c22d7_rle_crop_3900470032_0.png treat image : temp/1754055030_1333823_1374767248_caf2fed8edd2781a3811a133363c22d7_rle_crop_3900470033_0.png treat image : temp/1754055030_1333823_1374767248_caf2fed8edd2781a3811a133363c22d7_rle_crop_3900470034_0.png treat image : temp/1754055030_1333823_1374767248_caf2fed8edd2781a3811a133363c22d7_rle_crop_3900470036_0.png treat image : temp/1754055030_1333823_1374767248_caf2fed8edd2781a3811a133363c22d7_rle_crop_3900470035_0.png treat image : temp/1754055030_1333823_1374767202_77a8d0b2b3571478757530ec2c8cab2b_rle_crop_3900470040_0.png treat image : temp/1754055030_1333823_1374767199_fcdb46349fcaa684b536a20c8840b4c8_rle_crop_3900470045_0.png treat image : temp/1754055030_1333823_1374767199_fcdb46349fcaa684b536a20c8840b4c8_rle_crop_3900470044_0.png treat image : temp/1754055030_1333823_1374767199_fcdb46349fcaa684b536a20c8840b4c8_rle_crop_3900470042_0.png treat image : temp/1754055030_1333823_1374767134_0867a7c7b93ade90b6fdb33526631886_rle_crop_3900470052_0.png treat image : temp/1754055030_1333823_1374767130_9f8708198d8a82f51948b89ecd803812_rle_crop_3900470053_0.png treat image : temp/1754055030_1333823_1374767199_fcdb46349fcaa684b536a20c8840b4c8_rle_crop_3900470041_0.png treat image : temp/1754055030_1333823_1374767189_bb765a20ca0928bddde14c1e91674bcd_rle_crop_3900470046_0.png treat image : temp/1754055030_1333823_1374767126_fa228e8bc69ee014e720897cdd8ceba8_rle_crop_3900470055_0.png treat image : temp/1754055030_1333823_1374767263_908efd990889bcd3e6e6e94e95ffd7b3_rle_crop_3900470018_0.png treat image : temp/1754055030_1333823_1374767263_908efd990889bcd3e6e6e94e95ffd7b3_rle_crop_3900470019_0.png treat image : temp/1754055030_1333823_1374767263_908efd990889bcd3e6e6e94e95ffd7b3_rle_crop_3900470021_0.png treat image : temp/1754055030_1333823_1374767263_908efd990889bcd3e6e6e94e95ffd7b3_rle_crop_3900470022_0.png treat image : temp/1754055030_1333823_1374767260_b178c5436e0861d0f18fb6c5eceb26a3_rle_crop_3900470027_0.png treat image : temp/1754055030_1333823_1374767260_b178c5436e0861d0f18fb6c5eceb26a3_rle_crop_3900470024_0.png treat image : temp/1754055030_1333823_1374767256_c9f63136730307228aa7b88355e846de_rle_crop_3900470028_0.png treat image : temp/1754055030_1333823_1374767251_cd1f8d78dd2d89ced1958944a9c9a2b6_rle_crop_3900470031_0.png treat image : temp/1754055030_1333823_1374767199_fcdb46349fcaa684b536a20c8840b4c8_rle_crop_3900470043_0.png treat image : temp/1754055030_1333823_1374767189_bb765a20ca0928bddde14c1e91674bcd_rle_crop_3900470047_0.png treat image : temp/1754055030_1333823_1374767140_c39d8fab14ea87e3ef36e66967e97f8d_rle_crop_3900470050_0.png treat image : temp/1754055030_1333823_1374767140_c39d8fab14ea87e3ef36e66967e97f8d_rle_crop_3900470049_0.png treat image : temp/1754055030_1333823_1374767140_c39d8fab14ea87e3ef36e66967e97f8d_rle_crop_3900470048_0.png treat image : temp/1754055030_1333823_1374767134_0867a7c7b93ade90b6fdb33526631886_rle_crop_3900470051_0.png treat image : temp/1754055030_1333823_1374767130_9f8708198d8a82f51948b89ecd803812_rle_crop_3900470054_0.png treat image : temp/1754055030_1333823_1374767126_fa228e8bc69ee014e720897cdd8ceba8_rle_crop_3900470056_0.png treat image : temp/1754055030_1333823_1374767126_fa228e8bc69ee014e720897cdd8ceba8_rle_crop_3900470057_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 52 time used for this insertion : 0.03164172172546387 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 52 time used for this insertion : 0.03173398971557617 save missing photos in datou_result : time spend for datou_step_exec : 2.880037546157837 time spend to save output : 0.07666254043579102 total time spend for step 7 : 2.956700086593628 step8:velours_tree Fri Aug 1 15:31:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.13343071937561035 time spend to save output : 4.220008850097656e-05 total time spend for step 8 : 0.13347291946411133 step9:send_mail_cod Fri Aug 1 15:31:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25583540_01-08-2025_15_31_54.pdf 25585151 imagette255851511754055114 25585152 imagette255851521754055114 25585154 imagette255851541754055114 25585155 imagette255851551754055114 25585156 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette255851561754055114 25585157 imagette255851571754055115 25585158 change filename to text .change filename to text .change filename to text .imagette255851581754055115 25585159 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette255851591754055115 25585160 imagette255851601754055117 25585161 imagette255851611754055117 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25583540 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25585151,25585152,25585153,25585154,25585155,25585156,25585157,25585158,25585159,25585160,25585161?tags=autre,pehd,environnement,flou,metal,papier,mal_croppe,carton,pet_clair,background,pet_fonce args[1374767263] : ((1374767263, -2.271955923016564, 492609224), (1374767263, 0.2134158012217296, 2107752395), '0.06119024080504116') We are sending mail with results at report@fotonower.com args[1374767260] : ((1374767260, -1.1591694499258702, 492688767), (1374767260, 0.2083918102246085, 2107752395), '0.06119024080504116') We are sending mail with results at report@fotonower.com args[1374767256] : ((1374767256, -4.908741027491516, 492609224), (1374767256, 0.37528069623229615, 2107752395), '0.06119024080504116') We are sending mail with results at report@fotonower.com args[1374767251] : ((1374767251, 0.3844821695283094, 492688767), (1374767251, 0.47517075189662644, 2107752395), '0.06119024080504116') We are sending mail with results at report@fotonower.com args[1374767248] : ((1374767248, -3.821425839700746, 492609224), (1374767248, 0.526557090555916, 2107752395), '0.06119024080504116') We are sending mail with results at report@fotonower.com args[1374767202] : ((1374767202, -0.5825485731432074, 492688767), (1374767202, 0.3862706532973059, 2107752395), '0.06119024080504116') We are sending mail with results at report@fotonower.com args[1374767199] : ((1374767199, -5.327171757289037, 492609224), (1374767199, 0.2659706120144582, 2107752395), '0.06119024080504116') We are sending mail with results at report@fotonower.com args[1374767189] : ((1374767189, -0.552340113018424, 492688767), (1374767189, 0.10235174549490261, 2107752395), '0.06119024080504116') We are sending mail with results at report@fotonower.com args[1374767140] : ((1374767140, -4.972151202314639, 492609224), (1374767140, 0.4679108099204726, 2107752395), '0.06119024080504116') We are sending mail with results at report@fotonower.com args[1374767134] : ((1374767134, -0.8902612457619317, 492688767), (1374767134, 0.3927239043908547, 2107752395), '0.06119024080504116') We are sending mail with results at report@fotonower.com args[1374767130] : ((1374767130, -1.2198733885851443, 492688767), (1374767130, 0.7089070841519164, 2107752395), '0.06119024080504116') We are sending mail with results at report@fotonower.com args[1374767126] : ((1374767126, -4.977153294640044, 492609224), (1374767126, 0.42784930973846397, 2107752395), '0.06119024080504116') We are sending mail with results at report@fotonower.com refus_total : 0.06119024080504116 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25583540 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25583540_01-08-2025_15_31_54.pdf results_Auto_P25583540_01-08-2025_15_31_54.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25583540_01-08-2025_15_31_54.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25583540','results_Auto_P25583540_01-08-2025_15_31_54.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25583540_01-08-2025_15_31_54.pdf','pdf','','0.29','0.06119024080504116') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25583540

https://www.fotonower.com/image?json=false&list_photos_id=1374767263
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374767260
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374767256
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374767251
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374767248
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374767202
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374767199
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374767189
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374767140
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374767134
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374767130
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374767126
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 6.12%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/25585156?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/25585158?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25585159?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25583540_01-08-2025_15_31_54.pdf.

Lien vers velours :https://www.fotonower.com/velours/25585151,25585152,25585153,25585154,25585155,25585156,25585157,25585158,25585159,25585160,25585161?tags=autre,pehd,environnement,flou,metal,papier,mal_croppe,carton,pet_clair,background,pet_fonce.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 01 Aug 2025 13:31:59 GMT Content-Length: 0 Connection: close X-Message-Id: _-qRL4fkSHOrQhWl7R7SLQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1374767263, 1374767260, 1374767256, 1374767251, 1374767248, 1374767202, 1374767199, 1374767189, 1374767140, 1374767134, 1374767130, 1374767126] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767263', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767260', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767256', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767251', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767248', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767202', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767199', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767189', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767140', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767134', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767130', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767126', None, None, None, None, None, '3422174') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.03534507751464844 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.635992527008057 time spend to save output : 0.035594940185546875 total time spend for step 9 : 4.6715874671936035 step10:split_time_score Fri Aug 1 15:31:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 12),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 01082025 25583540 Nombre de photos uploadées : 12 / 23040 (0%) 01082025 25583540 Nombre de photos taguées (types de déchets): 0 / 12 (0%) 01082025 25583540 Nombre de photos taguées (volume) : 0 / 12 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ???????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005939006805419922 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.6316900253295898 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.129726261091821 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25581210_01-08-2025_11_21_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25581210 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25581210 AND mptpi.`type`=3594 To do Qualite : 0.08000464168595678 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25582614_01-08-2025_12_41_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25582614 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25582614 AND mptpi.`type`=3594 To do Qualite : 0.20749459187610225 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25581212_01-08-2025_11_12_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25581212 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25581212 AND mptpi.`type`=3594 To do Qualite : 0.24190254870756175 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25581213_01-08-2025_12_42_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25581213 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25581213 AND mptpi.`type`=3594 To do Qualite : 0.05313503689236112 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25581215_01-08-2025_10_42_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25581215 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25581215 AND mptpi.`type`=3594 To do Qualite : 0.0346822193287037 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25582617_01-08-2025_12_32_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25582617 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25582617 AND mptpi.`type`=3594 To do Qualite : 0.05554378419612791 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25582619_01-08-2025_12_22_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25582619 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25582619 AND mptpi.`type`=3594 To do Qualite : 0.11536986132544579 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25582621_01-08-2025_12_12_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25582621 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25582621 AND mptpi.`type`=3594 To do Qualite : 0.10505108438051147 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25583539_01-08-2025_13_21_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25583539 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25583539 AND mptpi.`type`=3594 To do Qualite : 0.06119024080504116 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25583540_01-08-2025_15_31_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25583540 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25583540 AND mptpi.`type`=3594 To do Qualite : 0.07867310900054467 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25584297_01-08-2025_14_13_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25584297 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25584297 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'01082025': {'nb_upload': 12, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1374767263, 1374767260, 1374767256, 1374767251, 1374767248, 1374767202, 1374767199, 1374767189, 1374767140, 1374767134, 1374767130, 1374767126] Looping around the photos to save general results len do output : 1 /25583540Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767263', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767260', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767256', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767251', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767248', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767202', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767199', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767189', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767140', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767134', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767130', None, None, None, None, None, '3422174') ('3318', None, None, None, None, None, None, None, '3422174') ('3318', '25583540', '1374767126', None, None, None, None, None, '3422174') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.0474088191986084 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.717672109603882 time spend to save output : 0.047652482986450195 total time spend for step 10 : 3.765324592590332 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 12 set_done_treatment 39.88user 23.04system 1:37.98elapsed 64%CPU (0avgtext+0avgdata 2816272maxresident)k 500944inputs+21416outputs (8major+1541546minor)pagefaults 0swaps