python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3203506 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3538575'] with mtr_portfolio_ids : ['25992555'] and first list_photo_ids : [] new path : /proc/3203506/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 16 ; length of list_pids : 16 ; length of list_args : 16 time to download the photos : 3.1523678302764893 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Aug 14 18:10:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6616 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-14 18:10:33.483428: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-14 18:10:33.508817: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-14 18:10:33.510883: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fd12c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-14 18:10:33.510913: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-14 18:10:33.514771: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-14 18:10:33.635123: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x23122900 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-14 18:10:33.635181: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-14 18:10:33.636232: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-14 18:10:33.636694: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-14 18:10:33.639707: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-14 18:10:33.642420: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-14 18:10:33.642810: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-14 18:10:33.645331: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-14 18:10:33.646620: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-14 18:10:33.651708: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-14 18:10:33.653226: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-14 18:10:33.653304: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-14 18:10:33.653985: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-14 18:10:33.654001: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-14 18:10:33.654011: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-14 18:10:33.655158: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5933 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-14 18:10:33.944800: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-14 18:10:33.944929: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-14 18:10:33.944952: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-14 18:10:33.944972: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-14 18:10:33.944990: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-14 18:10:33.945007: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-14 18:10:33.945024: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-14 18:10:33.945043: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-14 18:10:33.946270: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-14 18:10:33.947521: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-14 18:10:33.947567: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-14 18:10:33.947589: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-14 18:10:33.947608: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-14 18:10:33.947628: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-14 18:10:33.947647: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-14 18:10:33.947667: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-14 18:10:33.947686: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-14 18:10:33.948905: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-14 18:10:33.948947: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-14 18:10:33.948958: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-14 18:10:33.948968: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-14 18:10:33.950242: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5933 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-14 18:10:41.472642: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-14 18:10:41.675264: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 60.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 Detection mask done ! Trying to reset tf kernel 3204130 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 786 tf kernel not reseted sub process len(results) : 16 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 16 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5819 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00035953521728515625 nb_pixel_total : 13185 time to create 1 rle with old method : 0.015389204025268555 length of segment : 163 time for calcul the mask position with numpy : 0.0003609657287597656 nb_pixel_total : 16154 time to create 1 rle with old method : 0.018930673599243164 length of segment : 167 time for calcul the mask position with numpy : 0.00028514862060546875 nb_pixel_total : 11110 time to create 1 rle with old method : 0.01293492317199707 length of segment : 181 time for calcul the mask position with numpy : 9.131431579589844e-05 nb_pixel_total : 3109 time to create 1 rle with old method : 0.0037331581115722656 length of segment : 64 time for calcul the mask position with numpy : 0.00024318695068359375 nb_pixel_total : 10341 time to create 1 rle with old method : 0.012395858764648438 length of segment : 161 time for calcul the mask position with numpy : 0.0003731250762939453 nb_pixel_total : 17817 time to create 1 rle with old method : 0.02087092399597168 length of segment : 182 time for calcul the mask position with numpy : 0.00011181831359863281 nb_pixel_total : 4164 time to create 1 rle with old method : 0.004984617233276367 length of segment : 72 time for calcul the mask position with numpy : 0.00045037269592285156 nb_pixel_total : 27471 time to create 1 rle with old method : 0.031894683837890625 length of segment : 147 time for calcul the mask position with numpy : 0.00026345252990722656 nb_pixel_total : 12523 time to create 1 rle with old method : 0.014786243438720703 length of segment : 80 time for calcul the mask position with numpy : 0.0019958019256591797 nb_pixel_total : 101513 time to create 1 rle with old method : 0.11568641662597656 length of segment : 518 time for calcul the mask position with numpy : 0.00022649765014648438 nb_pixel_total : 11344 time to create 1 rle with old method : 0.013298988342285156 length of segment : 132 time for calcul the mask position with numpy : 0.000247955322265625 nb_pixel_total : 8710 time to create 1 rle with old method : 0.009954452514648438 length of segment : 167 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 4347 time to create 1 rle with old method : 0.005162715911865234 length of segment : 47 time for calcul the mask position with numpy : 0.00014019012451171875 nb_pixel_total : 8471 time to create 1 rle with old method : 0.009771585464477539 length of segment : 56 time for calcul the mask position with numpy : 0.0003724098205566406 nb_pixel_total : 10334 time to create 1 rle with old method : 0.011787891387939453 length of segment : 211 time for calcul the mask position with numpy : 0.00011682510375976562 nb_pixel_total : 6933 time to create 1 rle with old method : 0.007882118225097656 length of segment : 56 time for calcul the mask position with numpy : 9.989738464355469e-05 nb_pixel_total : 4995 time to create 1 rle with old method : 0.005747795104980469 length of segment : 51 time for calcul the mask position with numpy : 0.0002181529998779297 nb_pixel_total : 6800 time to create 1 rle with old method : 0.007558584213256836 length of segment : 167 time for calcul the mask position with numpy : 0.00015878677368164062 nb_pixel_total : 7050 time to create 1 rle with old method : 0.008173704147338867 length of segment : 86 time for calcul the mask position with numpy : 0.00010657310485839844 nb_pixel_total : 4465 time to create 1 rle with old method : 0.005124092102050781 length of segment : 69 time for calcul the mask position with numpy : 0.0001239776611328125 nb_pixel_total : 5656 time to create 1 rle with old method : 0.0063588619232177734 length of segment : 78 time for calcul the mask position with numpy : 0.0002002716064453125 nb_pixel_total : 7556 time to create 1 rle with old method : 0.008649110794067383 length of segment : 168 time for calcul the mask position with numpy : 0.0014595985412597656 nb_pixel_total : 102211 time to create 1 rle with old method : 0.10989618301391602 length of segment : 514 time for calcul the mask position with numpy : 0.000225067138671875 nb_pixel_total : 6873 time to create 1 rle with old method : 0.007875680923461914 length of segment : 134 time for calcul the mask position with numpy : 0.0002651214599609375 nb_pixel_total : 13209 time to create 1 rle with old method : 0.01433253288269043 length of segment : 185 time for calcul the mask position with numpy : 0.00015163421630859375 nb_pixel_total : 6954 time to create 1 rle with old method : 0.007994413375854492 length of segment : 108 time for calcul the mask position with numpy : 0.00021505355834960938 nb_pixel_total : 7808 time to create 1 rle with old method : 0.008930444717407227 length of segment : 116 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 1980 time to create 1 rle with old method : 0.002331256866455078 length of segment : 53 time for calcul the mask position with numpy : 0.0019392967224121094 nb_pixel_total : 114801 time to create 1 rle with old method : 0.1253964900970459 length of segment : 355 time for calcul the mask position with numpy : 0.0005452632904052734 nb_pixel_total : 33911 time to create 1 rle with old method : 0.03705906867980957 length of segment : 292 time for calcul the mask position with numpy : 0.00040030479431152344 nb_pixel_total : 20184 time to create 1 rle with old method : 0.0227963924407959 length of segment : 209 time for calcul the mask position with numpy : 0.0017230510711669922 nb_pixel_total : 104454 time to create 1 rle with old method : 0.1139671802520752 length of segment : 519 time for calcul the mask position with numpy : 0.00013494491577148438 nb_pixel_total : 3850 time to create 1 rle with old method : 0.004453182220458984 length of segment : 71 time for calcul the mask position with numpy : 0.00010752677917480469 nb_pixel_total : 4800 time to create 1 rle with old method : 0.005379199981689453 length of segment : 81 time for calcul the mask position with numpy : 0.0003421306610107422 nb_pixel_total : 19094 time to create 1 rle with old method : 0.02121281623840332 length of segment : 172 time for calcul the mask position with numpy : 0.00010538101196289062 nb_pixel_total : 2649 time to create 1 rle with old method : 0.003108978271484375 length of segment : 59 time for calcul the mask position with numpy : 0.0002608299255371094 nb_pixel_total : 14898 time to create 1 rle with old method : 0.016911029815673828 length of segment : 135 time for calcul the mask position with numpy : 7.867813110351562e-05 nb_pixel_total : 1473 time to create 1 rle with old method : 0.0017788410186767578 length of segment : 46 time for calcul the mask position with numpy : 0.00048065185546875 nb_pixel_total : 24867 time to create 1 rle with old method : 0.027291536331176758 length of segment : 442 time for calcul the mask position with numpy : 0.00038909912109375 nb_pixel_total : 8963 time to create 1 rle with old method : 0.010026931762695312 length of segment : 172 time for calcul the mask position with numpy : 9.1552734375e-05 nb_pixel_total : 3237 time to create 1 rle with old method : 0.0039751529693603516 length of segment : 36 time for calcul the mask position with numpy : 0.00029015541076660156 nb_pixel_total : 9874 time to create 1 rle with old method : 0.010936498641967773 length of segment : 158 time for calcul the mask position with numpy : 0.0004949569702148438 nb_pixel_total : 28054 time to create 1 rle with old method : 0.03091883659362793 length of segment : 268 time for calcul the mask position with numpy : 9.822845458984375e-05 nb_pixel_total : 4606 time to create 1 rle with old method : 0.0053632259368896484 length of segment : 51 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 1735 time to create 1 rle with old method : 0.0022079944610595703 length of segment : 35 time for calcul the mask position with numpy : 0.0002741813659667969 nb_pixel_total : 10104 time to create 1 rle with old method : 0.011496782302856445 length of segment : 178 time for calcul the mask position with numpy : 0.00011873245239257812 nb_pixel_total : 4812 time to create 1 rle with old method : 0.005552768707275391 length of segment : 84 time for calcul the mask position with numpy : 0.000614166259765625 nb_pixel_total : 33963 time to create 1 rle with old method : 0.04248046875 length of segment : 253 time for calcul the mask position with numpy : 0.000392913818359375 nb_pixel_total : 9865 time to create 1 rle with old method : 0.011105060577392578 length of segment : 118 time for calcul the mask position with numpy : 0.00020575523376464844 nb_pixel_total : 4953 time to create 1 rle with old method : 0.005609273910522461 length of segment : 73 time for calcul the mask position with numpy : 0.0002899169921875 nb_pixel_total : 4455 time to create 1 rle with old method : 0.00623321533203125 length of segment : 97 time for calcul the mask position with numpy : 0.000469207763671875 nb_pixel_total : 10156 time to create 1 rle with old method : 0.011410236358642578 length of segment : 180 time for calcul the mask position with numpy : 0.0032410621643066406 nb_pixel_total : 105807 time to create 1 rle with old method : 0.11475777626037598 length of segment : 525 time for calcul the mask position with numpy : 0.0001995563507080078 nb_pixel_total : 2350 time to create 1 rle with old method : 0.002847433090209961 length of segment : 69 time for calcul the mask position with numpy : 0.00011086463928222656 nb_pixel_total : 2427 time to create 1 rle with old method : 0.002991914749145508 length of segment : 49 time for calcul the mask position with numpy : 0.00013375282287597656 nb_pixel_total : 1452 time to create 1 rle with old method : 0.0017237663269042969 length of segment : 49 time for calcul the mask position with numpy : 0.00018930435180664062 nb_pixel_total : 2290 time to create 1 rle with old method : 0.002699136734008789 length of segment : 81 time for calcul the mask position with numpy : 0.0001773834228515625 nb_pixel_total : 2428 time to create 1 rle with old method : 0.0030031204223632812 length of segment : 50 time for calcul the mask position with numpy : 0.0002522468566894531 nb_pixel_total : 3975 time to create 1 rle with old method : 0.004591464996337891 length of segment : 90 time for calcul the mask position with numpy : 9.489059448242188e-05 nb_pixel_total : 3381 time to create 1 rle with old method : 0.004019498825073242 length of segment : 71 time for calcul the mask position with numpy : 0.00024271011352539062 nb_pixel_total : 14238 time to create 1 rle with old method : 0.01611781120300293 length of segment : 133 time for calcul the mask position with numpy : 0.000415802001953125 nb_pixel_total : 13589 time to create 1 rle with old method : 0.015259981155395508 length of segment : 146 time for calcul the mask position with numpy : 0.00037598609924316406 nb_pixel_total : 22804 time to create 1 rle with old method : 0.02545452117919922 length of segment : 186 time for calcul the mask position with numpy : 0.00028061866760253906 nb_pixel_total : 13817 time to create 1 rle with old method : 0.0157473087310791 length of segment : 115 time for calcul the mask position with numpy : 0.011328458786010742 nb_pixel_total : 492442 time to create 1 rle with new method : 0.020708322525024414 length of segment : 1156 time for calcul the mask position with numpy : 0.00032973289489746094 nb_pixel_total : 5791 time to create 1 rle with old method : 0.0069773197174072266 length of segment : 118 time for calcul the mask position with numpy : 0.0016200542449951172 nb_pixel_total : 55579 time to create 1 rle with old method : 0.062371253967285156 length of segment : 348 time for calcul the mask position with numpy : 0.0002906322479248047 nb_pixel_total : 5506 time to create 1 rle with old method : 0.006637096405029297 length of segment : 110 time for calcul the mask position with numpy : 0.0005252361297607422 nb_pixel_total : 17795 time to create 1 rle with old method : 0.02042222023010254 length of segment : 165 time for calcul the mask position with numpy : 0.0003559589385986328 nb_pixel_total : 18395 time to create 1 rle with old method : 0.021191120147705078 length of segment : 288 time for calcul the mask position with numpy : 0.00012755393981933594 nb_pixel_total : 5944 time to create 1 rle with old method : 0.007059574127197266 length of segment : 73 time for calcul the mask position with numpy : 0.0016977787017822266 nb_pixel_total : 104704 time to create 1 rle with old method : 0.11974024772644043 length of segment : 350 time for calcul the mask position with numpy : 0.0018551349639892578 nb_pixel_total : 89336 time to create 1 rle with old method : 0.10760998725891113 length of segment : 552 time for calcul the mask position with numpy : 0.00023603439331054688 nb_pixel_total : 6645 time to create 1 rle with old method : 0.007760763168334961 length of segment : 105 time for calcul the mask position with numpy : 0.0003478527069091797 nb_pixel_total : 7350 time to create 1 rle with old method : 0.008703470230102539 length of segment : 93 time for calcul the mask position with numpy : 0.00012087821960449219 nb_pixel_total : 1935 time to create 1 rle with old method : 0.002553224563598633 length of segment : 27 time spent for convertir_results : 3.570855140686035 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 76 chid ids of type : 3594 Number RLEs to save : 13166 save missing photos in datou_result : time spend for datou_step_exec : 24.944748401641846 time spend to save output : 0.7625887393951416 total time spend for step 1 : 25.707337141036987 step2:crop_condition Thu Aug 14 18:10:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 16 ! batch 1 Loaded 76 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 50 About to insert : list_path_to_insert length 50 new photo from crops ! About to upload 50 photos upload in portfolio : 3736932 init cache_photo without model_param we have 50 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755187860_3203506 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 50 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.32643747329712 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755187873_3203506 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.9708833694458008 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755187879_3203506 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.050141096115112 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755187884_3203506 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.300401210784912 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755187886_3203506 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5974597930908203 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1377046864, 1377046836, 1377046833, 1377046830, 1377046825, 1377046819, 1377046791, 1377046785, 1377046779, 1377046776, 1377046753, 1377046750, 1377046746, 1377046740, 1377046713, 1377046709] Looping around the photos to save general results len do output : 76 /1377057184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377057327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046864', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046836', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046833', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046830', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046825', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046819', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046791', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046785', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046779', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046776', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046753', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046750', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046746', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046740', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046713', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046709', None, None, None, None, None, '3538575') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 244 time used for this insertion : 0.038309574127197266 save_final save missing photos in datou_result : time spend for datou_step_exec : 30.307446479797363 time spend to save output : 0.040863990783691406 total time spend for step 2 : 30.348310470581055 step3:rle_unique_nms_with_priority Thu Aug 14 18:11:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 76 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.11108779907226562 time for calcul the mask position with numpy : 0.024735450744628906 nb_pixel_total : 2060415 time to create 1 rle with new method : 0.045189619064331055 time for calcul the mask position with numpy : 0.006345033645629883 nb_pixel_total : 13185 time to create 1 rle with old method : 0.016191720962524414 create new chi : 0.09750151634216309 time to delete rle : 0.020995378494262695 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1406 TO DO : save crop sub photo not yet done ! save time : 0.12991762161254883 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.06112313270568848 time for calcul the mask position with numpy : 0.02613043785095215 nb_pixel_total : 2043227 time to create 1 rle with new method : 0.04552483558654785 time for calcul the mask position with numpy : 0.006641387939453125 nb_pixel_total : 3109 time to create 1 rle with old method : 0.0035622119903564453 time for calcul the mask position with numpy : 0.006499052047729492 nb_pixel_total : 11110 time to create 1 rle with old method : 0.012571573257446289 time for calcul the mask position with numpy : 0.006223917007446289 nb_pixel_total : 16154 time to create 1 rle with old method : 0.018357038497924805 create new chi : 0.13091635704040527 time to delete rle : 0.0003261566162109375 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1904 TO DO : save crop sub photo not yet done ! save time : 0.15618205070495605 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06977415084838867 time for calcul the mask position with numpy : 0.02383279800415039 nb_pixel_total : 2013807 time to create 1 rle with new method : 0.04391360282897949 time for calcul the mask position with numpy : 0.0070247650146484375 nb_pixel_total : 27471 time to create 1 rle with old method : 0.03247690200805664 time for calcul the mask position with numpy : 0.0063021183013916016 nb_pixel_total : 4164 time to create 1 rle with old method : 0.0047152042388916016 time for calcul the mask position with numpy : 0.006213188171386719 nb_pixel_total : 17817 time to create 1 rle with old method : 0.019872665405273438 time for calcul the mask position with numpy : 0.006201744079589844 nb_pixel_total : 10341 time to create 1 rle with old method : 0.012977123260498047 create new chi : 0.16843724250793457 time to delete rle : 0.00036334991455078125 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2204 TO DO : save crop sub photo not yet done ! save time : 0.17206239700317383 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 0.10759997367858887 time for calcul the mask position with numpy : 0.023968935012817383 nb_pixel_total : 1909425 time to create 1 rle with new method : 0.048438072204589844 time for calcul the mask position with numpy : 0.006352663040161133 nb_pixel_total : 6933 time to create 1 rle with old method : 0.007817983627319336 time for calcul the mask position with numpy : 0.006127834320068359 nb_pixel_total : 10334 time to create 1 rle with old method : 0.011795282363891602 time for calcul the mask position with numpy : 0.0062253475189208984 nb_pixel_total : 8471 time to create 1 rle with old method : 0.009450674057006836 time for calcul the mask position with numpy : 0.0064618587493896484 nb_pixel_total : 4347 time to create 1 rle with old method : 0.005168437957763672 time for calcul the mask position with numpy : 0.006259918212890625 nb_pixel_total : 8710 time to create 1 rle with old method : 0.01042628288269043 time for calcul the mask position with numpy : 0.0062732696533203125 nb_pixel_total : 11344 time to create 1 rle with old method : 0.01275181770324707 time for calcul the mask position with numpy : 0.0074079036712646484 nb_pixel_total : 101513 time to create 1 rle with old method : 0.11222052574157715 time for calcul the mask position with numpy : 0.006485462188720703 nb_pixel_total : 12523 time to create 1 rle with old method : 0.014058351516723633 create new chi : 0.3136136531829834 time to delete rle : 0.0006124973297119141 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++++Number RLEs to save : 3614 TO DO : save crop sub photo not yet done ! save time : 0.26238512992858887 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04976987838745117 time for calcul the mask position with numpy : 0.01967334747314453 nb_pixel_total : 2054755 time to create 1 rle with new method : 0.028609752655029297 time for calcul the mask position with numpy : 0.00622248649597168 nb_pixel_total : 7050 time to create 1 rle with old method : 0.008041858673095703 time for calcul the mask position with numpy : 0.00608515739440918 nb_pixel_total : 6800 time to create 1 rle with old method : 0.007702827453613281 time for calcul the mask position with numpy : 0.006121397018432617 nb_pixel_total : 4995 time to create 1 rle with old method : 0.005672454833984375 create new chi : 0.08844661712646484 time to delete rle : 0.0003116130828857422 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 1688 TO DO : save crop sub photo not yet done ! save time : 0.14732146263122559 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.08170580863952637 time for calcul the mask position with numpy : 0.01917409896850586 nb_pixel_total : 1933630 time to create 1 rle with new method : 0.03830146789550781 time for calcul the mask position with numpy : 0.007464170455932617 nb_pixel_total : 13209 time to create 1 rle with old method : 0.014691352844238281 time for calcul the mask position with numpy : 0.006118297576904297 nb_pixel_total : 6873 time to create 1 rle with old method : 0.007806301116943359 time for calcul the mask position with numpy : 0.0066988468170166016 nb_pixel_total : 102211 time to create 1 rle with old method : 0.11550688743591309 time for calcul the mask position with numpy : 0.006636142730712891 nb_pixel_total : 7556 time to create 1 rle with old method : 0.00860285758972168 time for calcul the mask position with numpy : 0.006121635437011719 nb_pixel_total : 5656 time to create 1 rle with old method : 0.006331920623779297 time for calcul the mask position with numpy : 0.006108760833740234 nb_pixel_total : 4465 time to create 1 rle with old method : 0.005029916763305664 create new chi : 0.25779080390930176 time to delete rle : 0.0005359649658203125 batch 1 Loaded 13 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 3376 TO DO : save crop sub photo not yet done ! save time : 0.24344730377197266 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.07316184043884277 time for calcul the mask position with numpy : 0.021189212799072266 nb_pixel_total : 1911306 time to create 1 rle with new method : 0.03865170478820801 time for calcul the mask position with numpy : 0.006455421447753906 nb_pixel_total : 33911 time to create 1 rle with old method : 0.037630558013916016 time for calcul the mask position with numpy : 0.006869792938232422 nb_pixel_total : 111641 time to create 1 rle with old method : 0.12485146522521973 time for calcul the mask position with numpy : 0.00606846809387207 nb_pixel_total : 1980 time to create 1 rle with old method : 0.0022993087768554688 time for calcul the mask position with numpy : 0.00605010986328125 nb_pixel_total : 7808 time to create 1 rle with old method : 0.009568929672241211 time for calcul the mask position with numpy : 0.006548881530761719 nb_pixel_total : 6954 time to create 1 rle with old method : 0.007980585098266602 create new chi : 0.27756714820861816 time to delete rle : 0.0004944801330566406 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 2844 TO DO : save crop sub photo not yet done ! save time : 0.2213284969329834 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 0.12320661544799805 time for calcul the mask position with numpy : 0.0219876766204834 nb_pixel_total : 1871296 time to create 1 rle with new method : 0.04358673095703125 time for calcul the mask position with numpy : 0.006062746047973633 nb_pixel_total : 8963 time to create 1 rle with old method : 0.009643077850341797 time for calcul the mask position with numpy : 0.005960941314697266 nb_pixel_total : 21939 time to create 1 rle with old method : 0.025522470474243164 time for calcul the mask position with numpy : 0.0062868595123291016 nb_pixel_total : 1473 time to create 1 rle with old method : 0.0016608238220214844 time for calcul the mask position with numpy : 0.00583958625793457 nb_pixel_total : 14898 time to create 1 rle with old method : 0.016495466232299805 time for calcul the mask position with numpy : 0.0072154998779296875 nb_pixel_total : 2649 time to create 1 rle with old method : 0.004329681396484375 time for calcul the mask position with numpy : 0.00621342658996582 nb_pixel_total : 19094 time to create 1 rle with old method : 0.021686553955078125 time for calcul the mask position with numpy : 0.006084442138671875 nb_pixel_total : 4800 time to create 1 rle with old method : 0.005376577377319336 time for calcul the mask position with numpy : 0.005818367004394531 nb_pixel_total : 3850 time to create 1 rle with old method : 0.004258632659912109 time for calcul the mask position with numpy : 0.006525516510009766 nb_pixel_total : 104454 time to create 1 rle with old method : 0.1160120964050293 time for calcul the mask position with numpy : 0.0064089298248291016 nb_pixel_total : 20184 time to create 1 rle with old method : 0.022454500198364258 create new chi : 0.3605051040649414 time to delete rle : 0.0007727146148681641 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++Number RLEs to save : 4611 TO DO : save crop sub photo not yet done ! save time : 0.3381507396697998 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.06413125991821289 time for calcul the mask position with numpy : 0.018780946731567383 nb_pixel_total : 2026199 time to create 1 rle with new method : 0.030296802520751953 time for calcul the mask position with numpy : 0.00590968132019043 nb_pixel_total : 1735 time to create 1 rle with old method : 0.001986265182495117 time for calcul the mask position with numpy : 0.006434440612792969 nb_pixel_total : 4501 time to create 1 rle with old method : 0.005060911178588867 time for calcul the mask position with numpy : 0.00616765022277832 nb_pixel_total : 28054 time to create 1 rle with old method : 0.030774593353271484 time for calcul the mask position with numpy : 0.006284236907958984 nb_pixel_total : 9874 time to create 1 rle with old method : 0.01093602180480957 time for calcul the mask position with numpy : 0.0058441162109375 nb_pixel_total : 3237 time to create 1 rle with old method : 0.003679037094116211 create new chi : 0.13254022598266602 time to delete rle : 0.0004265308380126953 batch 1 Loaded 11 chid ids of type : 3594 ++++++++Number RLEs to save : 2156 TO DO : save crop sub photo not yet done ! save time : 0.15686655044555664 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.06933236122131348 time for calcul the mask position with numpy : 0.024685382843017578 nb_pixel_total : 2009903 time to create 1 rle with new method : 0.04166865348815918 time for calcul the mask position with numpy : 0.006029605865478516 nb_pixel_total : 4953 time to create 1 rle with old method : 0.005433320999145508 time for calcul the mask position with numpy : 0.0059163570404052734 nb_pixel_total : 9865 time to create 1 rle with old method : 0.010454416275024414 time for calcul the mask position with numpy : 0.005976438522338867 nb_pixel_total : 33963 time to create 1 rle with old method : 0.03668570518493652 time for calcul the mask position with numpy : 0.006357908248901367 nb_pixel_total : 4812 time to create 1 rle with old method : 0.005369663238525391 time for calcul the mask position with numpy : 0.0062367916107177734 nb_pixel_total : 10104 time to create 1 rle with old method : 0.010796785354614258 create new chi : 0.17034697532653809 time to delete rle : 0.0003752708435058594 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 2492 TO DO : save crop sub photo not yet done ! save time : 0.1742568016052246 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 0.11086034774780273 time for calcul the mask position with numpy : 0.02347540855407715 nb_pixel_total : 1938260 time to create 1 rle with new method : 0.044107675552368164 time for calcul the mask position with numpy : 0.006473064422607422 nb_pixel_total : 3975 time to create 1 rle with old method : 0.004372835159301758 time for calcul the mask position with numpy : 0.006162405014038086 nb_pixel_total : 2428 time to create 1 rle with old method : 0.0027184486389160156 time for calcul the mask position with numpy : 0.005938291549682617 nb_pixel_total : 2290 time to create 1 rle with old method : 0.0025925636291503906 time for calcul the mask position with numpy : 0.0061187744140625 nb_pixel_total : 1452 time to create 1 rle with old method : 0.002639293670654297 time for calcul the mask position with numpy : 0.006563901901245117 nb_pixel_total : 2427 time to create 1 rle with old method : 0.0029337406158447266 time for calcul the mask position with numpy : 0.00594782829284668 nb_pixel_total : 2350 time to create 1 rle with old method : 0.002614259719848633 time for calcul the mask position with numpy : 0.006757497787475586 nb_pixel_total : 105807 time to create 1 rle with old method : 0.1211857795715332 time for calcul the mask position with numpy : 0.006354808807373047 nb_pixel_total : 10156 time to create 1 rle with old method : 0.011627197265625 time for calcul the mask position with numpy : 0.007079124450683594 nb_pixel_total : 4455 time to create 1 rle with old method : 0.006592273712158203 create new chi : 0.28773999214172363 time to delete rle : 0.0005350112915039062 batch 1 Loaded 19 chid ids of type : 3594 +++++++++Number RLEs to save : 3460 TO DO : save crop sub photo not yet done ! save time : 0.22606325149536133 No data in photo_id : 1377046750 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.07036805152893066 time for calcul the mask position with numpy : 0.0200803279876709 nb_pixel_total : 2005771 time to create 1 rle with new method : 0.03119945526123047 time for calcul the mask position with numpy : 0.00652766227722168 nb_pixel_total : 13817 time to create 1 rle with old method : 0.01540064811706543 time for calcul the mask position with numpy : 0.0061190128326416016 nb_pixel_total : 22804 time to create 1 rle with old method : 0.025354623794555664 time for calcul the mask position with numpy : 0.005797147750854492 nb_pixel_total : 13589 time to create 1 rle with old method : 0.014847278594970703 time for calcul the mask position with numpy : 0.0057239532470703125 nb_pixel_total : 14238 time to create 1 rle with old method : 0.015233755111694336 time for calcul the mask position with numpy : 0.005676984786987305 nb_pixel_total : 3381 time to create 1 rle with old method : 0.0036406517028808594 create new chi : 0.1578812599182129 time to delete rle : 0.00039887428283691406 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2382 TO DO : save crop sub photo not yet done ! save time : 0.16472721099853516 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.040254831314086914 time for calcul the mask position with numpy : 0.016063928604125977 nb_pixel_total : 1581158 time to create 1 rle with new method : 0.03148293495178223 time for calcul the mask position with numpy : 0.009987354278564453 nb_pixel_total : 492442 time to create 1 rle with new method : 0.028853654861450195 create new chi : 0.08682775497436523 time to delete rle : 0.00030159950256347656 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 3392 TO DO : save crop sub photo not yet done ! save time : 0.21838998794555664 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.058800458908081055 time for calcul the mask position with numpy : 0.024070024490356445 nb_pixel_total : 1988929 time to create 1 rle with new method : 0.0415191650390625 time for calcul the mask position with numpy : 0.006230354309082031 nb_pixel_total : 17795 time to create 1 rle with old method : 0.021146297454833984 time for calcul the mask position with numpy : 0.006013393402099609 nb_pixel_total : 5506 time to create 1 rle with old method : 0.006234169006347656 time for calcul the mask position with numpy : 0.006227731704711914 nb_pixel_total : 55579 time to create 1 rle with old method : 0.06091022491455078 time for calcul the mask position with numpy : 0.0062656402587890625 nb_pixel_total : 5791 time to create 1 rle with old method : 0.006527423858642578 create new chi : 0.1915605068206787 time to delete rle : 0.0004935264587402344 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2562 TO DO : save crop sub photo not yet done ! save time : 0.17694854736328125 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 0.09586834907531738 time for calcul the mask position with numpy : 0.022513628005981445 nb_pixel_total : 1839586 time to create 1 rle with new method : 0.042969703674316406 time for calcul the mask position with numpy : 0.006044864654541016 nb_pixel_total : 1640 time to create 1 rle with old method : 0.0018839836120605469 time for calcul the mask position with numpy : 0.005879878997802734 nb_pixel_total : 7350 time to create 1 rle with old method : 0.00828242301940918 time for calcul the mask position with numpy : 0.006249427795410156 nb_pixel_total : 6645 time to create 1 rle with old method : 0.00733637809753418 time for calcul the mask position with numpy : 0.006335258483886719 nb_pixel_total : 89336 time to create 1 rle with old method : 0.09758639335632324 time for calcul the mask position with numpy : 0.006854057312011719 nb_pixel_total : 104704 time to create 1 rle with old method : 0.11455011367797852 time for calcul the mask position with numpy : 0.006100177764892578 nb_pixel_total : 5944 time to create 1 rle with old method : 0.006552219390869141 time for calcul the mask position with numpy : 0.005940914154052734 nb_pixel_total : 18395 time to create 1 rle with old method : 0.02037811279296875 create new chi : 0.3706679344177246 time to delete rle : 0.0006661415100097656 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 4040 TO DO : save crop sub photo not yet done ! save time : 0.26938438415527344 map_output_result : {1377046864: (0.0, 'Should be the crop_list due to order', 0), 1377046836: (0.0, 'Should be the crop_list due to order', 0), 1377046833: (0.0, 'Should be the crop_list due to order', 0), 1377046830: (0.0, 'Should be the crop_list due to order', 0), 1377046825: (0.0, 'Should be the crop_list due to order', 0), 1377046819: (0.0, 'Should be the crop_list due to order', 0), 1377046791: (0.0, 'Should be the crop_list due to order', 0), 1377046785: (0.0, 'Should be the crop_list due to order', 0), 1377046779: (0.0, 'Should be the crop_list due to order', 0), 1377046776: (0.0, 'Should be the crop_list due to order', 0), 1377046753: (0.0, 'Should be the crop_list due to order', 0), 1377046750: (0.0, 'Should be the crop_list due to order', 0.0), 1377046746: (0.0, 'Should be the crop_list due to order', 0), 1377046740: (0.0, 'Should be the crop_list due to order', 0), 1377046713: (0.0, 'Should be the crop_list due to order', 0), 1377046709: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1377046864, 1377046836, 1377046833, 1377046830, 1377046825, 1377046819, 1377046791, 1377046785, 1377046779, 1377046776, 1377046753, 1377046750, 1377046746, 1377046740, 1377046713, 1377046709] Looping around the photos to save general results len do output : 16 /1377046864.Didn't retrieve data . /1377046836.Didn't retrieve data . /1377046833.Didn't retrieve data . /1377046830.Didn't retrieve data . /1377046825.Didn't retrieve data . /1377046819.Didn't retrieve data . /1377046791.Didn't retrieve data . /1377046785.Didn't retrieve data . /1377046779.Didn't retrieve data . /1377046776.Didn't retrieve data . /1377046753.Didn't retrieve data . /1377046750.Didn't retrieve data . /1377046746.Didn't retrieve data . /1377046740.Didn't retrieve data . /1377046713.Didn't retrieve data . /1377046709.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046864', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046836', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046833', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046830', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046825', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046819', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046791', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046785', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046779', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046776', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046753', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046750', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046746', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046740', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046713', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046709', None, None, None, None, None, '3538575') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 48 time used for this insertion : 0.01361536979675293 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.928133964538574 time spend to save output : 0.01437687873840332 total time spend for step 3 : 7.9425108432769775 step4:ventilate_hashtags_in_portfolio Thu Aug 14 18:11:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25992555 get user id for portfolio 25992555 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25992555 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','metal','pehd','flou','mal_croppe','papier','pet_fonce','background','carton','environnement','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25992555 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','metal','pehd','flou','mal_croppe','papier','pet_fonce','background','carton','environnement','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25992555 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','metal','pehd','flou','mal_croppe','papier','pet_fonce','background','carton','environnement','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25992762,25992763,25992764,25992765,25992766,25992767,25992768,25992769,25992770,25992771,25992772?tags=autre,metal,pehd,flou,mal_croppe,papier,pet_fonce,background,carton,environnement,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1377046864, 1377046836, 1377046833, 1377046830, 1377046825, 1377046819, 1377046791, 1377046785, 1377046779, 1377046776, 1377046753, 1377046750, 1377046746, 1377046740, 1377046713, 1377046709] Looping around the photos to save general results len do output : 1 /25992555. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046864', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046836', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046833', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046830', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046825', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046819', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046791', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046785', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046779', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046776', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046753', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046750', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046746', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046740', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046713', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046709', None, None, None, None, None, '3538575') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 17 time used for this insertion : 0.015746116638183594 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6374883651733398 time spend to save output : 0.016040563583374023 total time spend for step 4 : 1.6535289287567139 step5:final Thu Aug 14 18:11:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1377046864: ('0.057759843991126554',), 1377046836: ('0.057759843991126554',), 1377046833: ('0.057759843991126554',), 1377046830: ('0.057759843991126554',), 1377046825: ('0.057759843991126554',), 1377046819: ('0.057759843991126554',), 1377046791: ('0.057759843991126554',), 1377046785: ('0.057759843991126554',), 1377046779: ('0.057759843991126554',), 1377046776: ('0.057759843991126554',), 1377046753: ('0.057759843991126554',), 1377046750: ('0.057759843991126554',), 1377046746: ('0.057759843991126554',), 1377046740: ('0.057759843991126554',), 1377046713: ('0.057759843991126554',), 1377046709: ('0.057759843991126554',)} new output for save of step final : {1377046864: ('0.057759843991126554',), 1377046836: ('0.057759843991126554',), 1377046833: ('0.057759843991126554',), 1377046830: ('0.057759843991126554',), 1377046825: ('0.057759843991126554',), 1377046819: ('0.057759843991126554',), 1377046791: ('0.057759843991126554',), 1377046785: ('0.057759843991126554',), 1377046779: ('0.057759843991126554',), 1377046776: ('0.057759843991126554',), 1377046753: ('0.057759843991126554',), 1377046750: ('0.057759843991126554',), 1377046746: ('0.057759843991126554',), 1377046740: ('0.057759843991126554',), 1377046713: ('0.057759843991126554',), 1377046709: ('0.057759843991126554',)} [1377046864, 1377046836, 1377046833, 1377046830, 1377046825, 1377046819, 1377046791, 1377046785, 1377046779, 1377046776, 1377046753, 1377046750, 1377046746, 1377046740, 1377046713, 1377046709] Looping around the photos to save general results len do output : 16 /1377046864.Didn't retrieve data . /1377046836.Didn't retrieve data . /1377046833.Didn't retrieve data . /1377046830.Didn't retrieve data . /1377046825.Didn't retrieve data . /1377046819.Didn't retrieve data . /1377046791.Didn't retrieve data . /1377046785.Didn't retrieve data . /1377046779.Didn't retrieve data . /1377046776.Didn't retrieve data . /1377046753.Didn't retrieve data . /1377046750.Didn't retrieve data . /1377046746.Didn't retrieve data . /1377046740.Didn't retrieve data . /1377046713.Didn't retrieve data . /1377046709.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046864', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046836', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046833', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046830', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046825', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046819', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046791', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046785', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046779', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046776', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046753', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046750', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046746', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046740', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046713', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046709', None, None, None, None, None, '3538575') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 48 time used for this insertion : 0.014326333999633789 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1206204891204834 time spend to save output : 0.015012979507446289 total time spend for step 5 : 0.1356334686279297 step6:blur_detection Thu Aug 14 18:11:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1755187827_3203506_1377046864_d0b87753982c563f28770b1418da7997.jpg resize: (1080, 1920) 1377046864 0.5584710950509425 treat image : temp/1755187827_3203506_1377046836_cb0ac9c9e6f5cad219791760720036d2.jpg resize: (1080, 1920) 1377046836 0.03421179923535869 treat image : temp/1755187827_3203506_1377046833_ffcdc4218b3a29f4dddee9ad42430d02.jpg resize: (1080, 1920) 1377046833 0.436828118478923 treat image : temp/1755187827_3203506_1377046830_86ab5c9b70c58d857ae70f9cd118555b.jpg resize: (1080, 1920) 1377046830 -3.2117389921989425 treat image : temp/1755187827_3203506_1377046825_a66bdad891f266ba995808dc5df336ad.jpg resize: (1080, 1920) 1377046825 1.0740398086802114 treat image : temp/1755187827_3203506_1377046819_ff1f7eae144d776499accf64c99082fb.jpg resize: (1080, 1920) 1377046819 -4.394003111671201 treat image : temp/1755187827_3203506_1377046791_316d79ed8bb32afae6dd8d9ca77dc33b.jpg resize: (1080, 1920) 1377046791 -1.8701342688721148 treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86.jpg resize: (1080, 1920) 1377046785 -4.480947947396078 treat image : temp/1755187827_3203506_1377046779_75fca8d01eea2b0ec00ef24bfa562bc8.jpg resize: (1080, 1920) 1377046779 0.05119853676013182 treat image : temp/1755187827_3203506_1377046776_d9ccda1ab68336d92b8e44ce52397149.jpg resize: (1080, 1920) 1377046776 -4.3827062374092085 treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61.jpg resize: (1080, 1920) 1377046753 -0.4390743207750082 treat image : temp/1755187827_3203506_1377046750_2d5c87918801f30aeee22700bb1dba94.jpg resize: (1080, 1920) 1377046750 -0.34828767677475114 treat image : temp/1755187827_3203506_1377046746_a5f61c6fcd2bbf8fad424caeec5c85b9.jpg resize: (1080, 1920) 1377046746 -5.168606661357349 treat image : temp/1755187827_3203506_1377046740_5cc7529872291c176ad313e39c9a36eb.jpg resize: (1080, 1920) 1377046740 2.135349700441753 treat image : temp/1755187827_3203506_1377046713_328b1d8dde016e82ce8c6ba3ea36d1bb.jpg resize: (1080, 1920) 1377046713 -0.08935620510615343 treat image : temp/1755187827_3203506_1377046709_022f6e0a9cfe01a996805122f17c2196.jpg resize: (1080, 1920) 1377046709 -3.937624708836534 treat image : temp/1755187827_3203506_1377046836_cb0ac9c9e6f5cad219791760720036d2_rle_crop_3915059033_0.png resize: (174, 113) 1377057184 -2.672891864207854 treat image : temp/1755187827_3203506_1377046836_cb0ac9c9e6f5cad219791760720036d2_rle_crop_3915059034_0.png resize: (64, 72) 1377057185 -0.8835530948871452 treat image : temp/1755187827_3203506_1377046833_ffcdc4218b3a29f4dddee9ad42430d02_rle_crop_3915059035_0.png resize: (147, 165) 1377057186 -1.4470615519599206 treat image : temp/1755187827_3203506_1377046833_ffcdc4218b3a29f4dddee9ad42430d02_rle_crop_3915059036_0.png resize: (182, 229) 1377057188 -0.5174040164218278 treat image : temp/1755187827_3203506_1377046830_86ab5c9b70c58d857ae70f9cd118555b_rle_crop_3915059039_0.png resize: (77, 212) 1377057189 -1.5140690536561516 treat image : temp/1755187827_3203506_1377046830_86ab5c9b70c58d857ae70f9cd118555b_rle_crop_3915059042_0.png resize: (167, 103) 1377057190 -1.3536619222452297 treat image : temp/1755187827_3203506_1377046830_86ab5c9b70c58d857ae70f9cd118555b_rle_crop_3915059043_0.png resize: (47, 126) 1377057191 -1.5660276708720164 treat image : temp/1755187827_3203506_1377046830_86ab5c9b70c58d857ae70f9cd118555b_rle_crop_3915059045_0.png resize: (160, 208) 1377057193 -2.438315502986429 treat image : temp/1755187827_3203506_1377046830_86ab5c9b70c58d857ae70f9cd118555b_rle_crop_3915059046_0.png resize: (50, 176) 1377057194 -2.0202588478984587 treat image : temp/1755187827_3203506_1377046825_a66bdad891f266ba995808dc5df336ad_rle_crop_3915059047_0.png resize: (50, 141) 1377057195 0.5716688137884441 treat image : temp/1755187827_3203506_1377046825_a66bdad891f266ba995808dc5df336ad_rle_crop_3915059048_0.png resize: (164, 98) 1377057197 -2.246302221975449 treat image : temp/1755187827_3203506_1377046819_ff1f7eae144d776499accf64c99082fb_rle_crop_3915059050_0.png resize: (69, 97) 1377057198 -0.2514264529299506 treat image : temp/1755187827_3203506_1377046819_ff1f7eae144d776499accf64c99082fb_rle_crop_3915059051_0.png resize: (78, 108) 1377057199 -2.817051423539679 treat image : temp/1755187827_3203506_1377046819_ff1f7eae144d776499accf64c99082fb_rle_crop_3915059052_0.png resize: (114, 141) 1377057201 -2.00625644935451 treat image : temp/1755187827_3203506_1377046819_ff1f7eae144d776499accf64c99082fb_rle_crop_3915059054_0.png resize: (109, 150) 1377057202 -1.9189279810702347 treat image : temp/1755187827_3203506_1377046791_316d79ed8bb32afae6dd8d9ca77dc33b_rle_crop_3915059056_0.png resize: (108, 95) 1377057203 -0.23158439549301407 treat image : temp/1755187827_3203506_1377046791_316d79ed8bb32afae6dd8d9ca77dc33b_rle_crop_3915059057_0.png resize: (116, 105) 1377057205 -1.3159259410580753 treat image : temp/1755187827_3203506_1377046791_316d79ed8bb32afae6dd8d9ca77dc33b_rle_crop_3915059058_0.png resize: (53, 54) 1377057206 -0.3713574670321609 treat image : temp/1755187827_3203506_1377046791_316d79ed8bb32afae6dd8d9ca77dc33b_rle_crop_3915059059_0.png resize: (346, 562) 1377057207 -0.5511189239878956 treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059061_0.png resize: (195, 174) 1377057208 -4.124148298888375 treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059063_0.png resize: (70, 82) 1377057210 -2.024307539554486 treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059064_0.png resize: (81, 67) 1377057211 1.4153586354867633 treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059065_0.png resize: (167, 169) 1377057212 -4.594379202962511 treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059066_0.png resize: (59, 78) 1377057214 -2.2982491983656734 treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059068_0.png resize: (46, 55) 1377057215 -1.3619543014580169 treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059070_0.png resize: (169, 105) 1377057216 -1.5353055603184849 treat image : temp/1755187827_3203506_1377046779_75fca8d01eea2b0ec00ef24bfa562bc8_rle_crop_3915059071_0.png resize: (32, 124) 1377057218 0.05751078532925716 treat image : temp/1755187827_3203506_1377046779_75fca8d01eea2b0ec00ef24bfa562bc8_rle_crop_3915059072_0.png resize: (111, 156) 1377057219 0.022058014621319743 treat image : temp/1755187827_3203506_1377046779_75fca8d01eea2b0ec00ef24bfa562bc8_rle_crop_3915059073_0.png resize: (267, 210) 1377057220 -0.3221600765257457 treat image : temp/1755187827_3203506_1377046776_d9ccda1ab68336d92b8e44ce52397149_rle_crop_3915059076_0.png resize: (177, 111) 1377057221 -0.9010467945723011 treat image : temp/1755187827_3203506_1377046776_d9ccda1ab68336d92b8e44ce52397149_rle_crop_3915059077_0.png resize: (70, 109) 1377057223 -4.062922760733708 treat image : temp/1755187827_3203506_1377046776_d9ccda1ab68336d92b8e44ce52397149_rle_crop_3915059078_0.png resize: (236, 278) 1377057224 -4.01026052381713 treat image : temp/1755187827_3203506_1377046776_d9ccda1ab68336d92b8e44ce52397149_rle_crop_3915059080_0.png resize: (73, 79) 1377057225 3.206670468989993 treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61_rle_crop_3915059081_0.png resize: (97, 83) 1377057227 -1.6574523452225496 treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61_rle_crop_3915059082_0.png resize: (142, 122) 1377057228 -1.938328793909604 treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61_rle_crop_3915059084_0.png resize: (69, 58) 1377057229 -3.0335739858769717 treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61_rle_crop_3915059085_0.png resize: (49, 71) 1377057230 -1.561716821023601 treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61_rle_crop_3915059086_0.png resize: (49, 36) 1377057232 0.6691862244946085 treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61_rle_crop_3915059088_0.png resize: (47, 67) 1377057233 0.45592069866042273 treat image : temp/1755187827_3203506_1377046746_a5f61c6fcd2bbf8fad424caeec5c85b9_rle_crop_3915059090_0.png resize: (71, 72) 1377057234 0.11506573805453331 treat image : temp/1755187827_3203506_1377046746_a5f61c6fcd2bbf8fad424caeec5c85b9_rle_crop_3915059091_0.png resize: (131, 150) 1377057236 -2.1577658777184308 treat image : temp/1755187827_3203506_1377046746_a5f61c6fcd2bbf8fad424caeec5c85b9_rle_crop_3915059093_0.png resize: (169, 185) 1377057237 -1.767487248381224 treat image : temp/1755187827_3203506_1377046746_a5f61c6fcd2bbf8fad424caeec5c85b9_rle_crop_3915059094_0.png resize: (114, 176) 1377057238 -4.726632505025053 treat image : temp/1755187827_3203506_1377046713_328b1d8dde016e82ce8c6ba3ea36d1bb_rle_crop_3915059096_0.png resize: (118, 98) 1377057239 -1.798320042972281 treat image : temp/1755187827_3203506_1377046713_328b1d8dde016e82ce8c6ba3ea36d1bb_rle_crop_3915059098_0.png resize: (109, 94) 1377057241 -0.4807286531377947 treat image : temp/1755187827_3203506_1377046709_022f6e0a9cfe01a996805122f17c2196_rle_crop_3915059100_0.png resize: (288, 89) 1377057242 -1.3574231291446874 treat image : temp/1755187827_3203506_1377046709_022f6e0a9cfe01a996805122f17c2196_rle_crop_3915059101_0.png resize: (71, 96) 1377057243 3.1156574002086126 treat image : temp/1755187827_3203506_1377046709_022f6e0a9cfe01a996805122f17c2196_rle_crop_3915059102_0.png resize: (349, 455) 1377057245 -2.6778567195244154 treat image : temp/1755187827_3203506_1377046709_022f6e0a9cfe01a996805122f17c2196_rle_crop_3915059104_0.png resize: (104, 92) 1377057246 0.04178375703270412 treat image : temp/1755187827_3203506_1377046709_022f6e0a9cfe01a996805122f17c2196_rle_crop_3915059106_0.png resize: (26, 113) 1377057247 -2.9118931888706867 treat image : temp/1755187827_3203506_1377046864_d0b87753982c563f28770b1418da7997_rle_crop_3915059031_0.png resize: (158, 122) 1377057285 -1.3805539664776358 treat image : temp/1755187827_3203506_1377046836_cb0ac9c9e6f5cad219791760720036d2_rle_crop_3915059032_0.png resize: (167, 155) 1377057287 -1.502273263927801 treat image : temp/1755187827_3203506_1377046791_316d79ed8bb32afae6dd8d9ca77dc33b_rle_crop_3915059060_0.png resize: (288, 159) 1377057289 -0.8876041101886297 treat image : temp/1755187827_3203506_1377046779_75fca8d01eea2b0ec00ef24bfa562bc8_rle_crop_3915059074_0.png resize: (51, 113) 1377057291 0.15060734655359365 treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61_rle_crop_3915059087_0.png resize: (81, 34) 1377057292 20.0 treat image : temp/1755187827_3203506_1377046833_ffcdc4218b3a29f4dddee9ad42430d02_rle_crop_3915059037_0.png resize: (72, 72) 1377057299 -0.012515048494717322 treat image : temp/1755187827_3203506_1377046833_ffcdc4218b3a29f4dddee9ad42430d02_rle_crop_3915059038_0.png resize: (125, 363) 1377057300 -2.636297981987752 treat image : temp/1755187827_3203506_1377046830_86ab5c9b70c58d857ae70f9cd118555b_rle_crop_3915059040_0.png resize: (515, 312) 1377057301 0.16384961180279675 treat image : temp/1755187827_3203506_1377046830_86ab5c9b70c58d857ae70f9cd118555b_rle_crop_3915059044_0.png resize: (55, 199) 1377057302 -2.8084264997657926 treat image : temp/1755187827_3203506_1377046825_a66bdad891f266ba995808dc5df336ad_rle_crop_3915059049_0.png resize: (75, 127) 1377057303 -1.8019965632177788 treat image : temp/1755187827_3203506_1377046819_ff1f7eae144d776499accf64c99082fb_rle_crop_3915059053_0.png resize: (513, 316) 1377057304 0.2572050488204383 treat image : temp/1755187827_3203506_1377046819_ff1f7eae144d776499accf64c99082fb_rle_crop_3915059055_0.png resize: (185, 123) 1377057305 -0.6638324365737587 treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059062_0.png resize: (518, 308) 1377057307 0.16257826499560546 treat image : temp/1755187827_3203506_1377046779_75fca8d01eea2b0ec00ef24bfa562bc8_rle_crop_3915059075_0.png resize: (35, 58) 1377057308 1.140313619982109 treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61_rle_crop_3915059083_0.png resize: (519, 327) 1377057309 0.3545615508352064 treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61_rle_crop_3915059089_0.png resize: (90, 60) 1377057310 -3.026826003326076 treat image : temp/1755187827_3203506_1377046740_5cc7529872291c176ad313e39c9a36eb_rle_crop_3915059095_0.png resize: (942, 837) 1377057311 0.7467791416650612 treat image : temp/1755187827_3203506_1377046713_328b1d8dde016e82ce8c6ba3ea36d1bb_rle_crop_3915059097_0.png resize: (347, 297) 1377057312 -0.07179676598824872 treat image : temp/1755187827_3203506_1377046713_328b1d8dde016e82ce8c6ba3ea36d1bb_rle_crop_3915059099_0.png resize: (164, 198) 1377057313 -1.7617238622283256 treat image : temp/1755187827_3203506_1377046709_022f6e0a9cfe01a996805122f17c2196_rle_crop_3915059103_0.png resize: (546, 278) 1377057314 -0.01981971680362265 treat image : temp/1755187827_3203506_1377046709_022f6e0a9cfe01a996805122f17c2196_rle_crop_3915059105_0.png resize: (93, 94) 1377057315 1.6510125232541553 treat image : temp/1755187827_3203506_1377046830_86ab5c9b70c58d857ae70f9cd118555b_rle_crop_3915059041_0.png resize: (110, 141) 1377057317 -1.9273062576084685 treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059067_0.png resize: (124, 163) 1377057318 -2.5426213916061426 treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059069_0.png resize: (291, 149) 1377057319 -2.3264647115250625 treat image : temp/1755187827_3203506_1377046746_a5f61c6fcd2bbf8fad424caeec5c85b9_rle_crop_3915059092_0.png resize: (133, 129) 1377057320 -2.8810137453574134 treat image : temp/1755187827_3203506_1377046776_d9ccda1ab68336d92b8e44ce52397149_rle_crop_3915059079_0.png resize: (118, 114) 1377057327 -2.3978791198670435 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 92 time used for this insertion : 0.014488458633422852 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 92 time used for this insertion : 0.014853477478027344 save missing photos in datou_result : time spend for datou_step_exec : 13.72853684425354 time spend to save output : 0.03436732292175293 total time spend for step 6 : 13.762904167175293 step7:brightness Thu Aug 14 18:11:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1755187827_3203506_1377046864_d0b87753982c563f28770b1418da7997.jpg treat image : temp/1755187827_3203506_1377046836_cb0ac9c9e6f5cad219791760720036d2.jpg treat image : temp/1755187827_3203506_1377046833_ffcdc4218b3a29f4dddee9ad42430d02.jpg treat image : temp/1755187827_3203506_1377046830_86ab5c9b70c58d857ae70f9cd118555b.jpg treat image : temp/1755187827_3203506_1377046825_a66bdad891f266ba995808dc5df336ad.jpg treat image : temp/1755187827_3203506_1377046819_ff1f7eae144d776499accf64c99082fb.jpg treat image : temp/1755187827_3203506_1377046791_316d79ed8bb32afae6dd8d9ca77dc33b.jpg treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86.jpg treat image : temp/1755187827_3203506_1377046779_75fca8d01eea2b0ec00ef24bfa562bc8.jpg treat image : temp/1755187827_3203506_1377046776_d9ccda1ab68336d92b8e44ce52397149.jpg treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61.jpg treat image : temp/1755187827_3203506_1377046750_2d5c87918801f30aeee22700bb1dba94.jpg treat image : temp/1755187827_3203506_1377046746_a5f61c6fcd2bbf8fad424caeec5c85b9.jpg treat image : temp/1755187827_3203506_1377046740_5cc7529872291c176ad313e39c9a36eb.jpg treat image : temp/1755187827_3203506_1377046713_328b1d8dde016e82ce8c6ba3ea36d1bb.jpg treat image : temp/1755187827_3203506_1377046709_022f6e0a9cfe01a996805122f17c2196.jpg treat image : temp/1755187827_3203506_1377046836_cb0ac9c9e6f5cad219791760720036d2_rle_crop_3915059033_0.png treat image : temp/1755187827_3203506_1377046836_cb0ac9c9e6f5cad219791760720036d2_rle_crop_3915059034_0.png treat image : temp/1755187827_3203506_1377046833_ffcdc4218b3a29f4dddee9ad42430d02_rle_crop_3915059035_0.png treat image : temp/1755187827_3203506_1377046833_ffcdc4218b3a29f4dddee9ad42430d02_rle_crop_3915059036_0.png treat image : temp/1755187827_3203506_1377046830_86ab5c9b70c58d857ae70f9cd118555b_rle_crop_3915059039_0.png treat image : temp/1755187827_3203506_1377046830_86ab5c9b70c58d857ae70f9cd118555b_rle_crop_3915059042_0.png treat image : temp/1755187827_3203506_1377046830_86ab5c9b70c58d857ae70f9cd118555b_rle_crop_3915059043_0.png treat image : temp/1755187827_3203506_1377046830_86ab5c9b70c58d857ae70f9cd118555b_rle_crop_3915059045_0.png treat image : temp/1755187827_3203506_1377046830_86ab5c9b70c58d857ae70f9cd118555b_rle_crop_3915059046_0.png treat image : temp/1755187827_3203506_1377046825_a66bdad891f266ba995808dc5df336ad_rle_crop_3915059047_0.png treat image : temp/1755187827_3203506_1377046825_a66bdad891f266ba995808dc5df336ad_rle_crop_3915059048_0.png treat image : temp/1755187827_3203506_1377046819_ff1f7eae144d776499accf64c99082fb_rle_crop_3915059050_0.png treat image : temp/1755187827_3203506_1377046819_ff1f7eae144d776499accf64c99082fb_rle_crop_3915059051_0.png treat image : temp/1755187827_3203506_1377046819_ff1f7eae144d776499accf64c99082fb_rle_crop_3915059052_0.png treat image : temp/1755187827_3203506_1377046819_ff1f7eae144d776499accf64c99082fb_rle_crop_3915059054_0.png treat image : temp/1755187827_3203506_1377046791_316d79ed8bb32afae6dd8d9ca77dc33b_rle_crop_3915059056_0.png treat image : temp/1755187827_3203506_1377046791_316d79ed8bb32afae6dd8d9ca77dc33b_rle_crop_3915059057_0.png treat image : temp/1755187827_3203506_1377046791_316d79ed8bb32afae6dd8d9ca77dc33b_rle_crop_3915059058_0.png treat image : temp/1755187827_3203506_1377046791_316d79ed8bb32afae6dd8d9ca77dc33b_rle_crop_3915059059_0.png treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059061_0.png treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059063_0.png treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059064_0.png treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059065_0.png treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059066_0.png treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059068_0.png treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059070_0.png treat image : temp/1755187827_3203506_1377046779_75fca8d01eea2b0ec00ef24bfa562bc8_rle_crop_3915059071_0.png treat image : temp/1755187827_3203506_1377046779_75fca8d01eea2b0ec00ef24bfa562bc8_rle_crop_3915059072_0.png treat image : temp/1755187827_3203506_1377046779_75fca8d01eea2b0ec00ef24bfa562bc8_rle_crop_3915059073_0.png treat image : temp/1755187827_3203506_1377046776_d9ccda1ab68336d92b8e44ce52397149_rle_crop_3915059076_0.png treat image : temp/1755187827_3203506_1377046776_d9ccda1ab68336d92b8e44ce52397149_rle_crop_3915059077_0.png treat image : temp/1755187827_3203506_1377046776_d9ccda1ab68336d92b8e44ce52397149_rle_crop_3915059078_0.png treat image : temp/1755187827_3203506_1377046776_d9ccda1ab68336d92b8e44ce52397149_rle_crop_3915059080_0.png treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61_rle_crop_3915059081_0.png treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61_rle_crop_3915059082_0.png treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61_rle_crop_3915059084_0.png treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61_rle_crop_3915059085_0.png treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61_rle_crop_3915059086_0.png treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61_rle_crop_3915059088_0.png treat image : temp/1755187827_3203506_1377046746_a5f61c6fcd2bbf8fad424caeec5c85b9_rle_crop_3915059090_0.png treat image : temp/1755187827_3203506_1377046746_a5f61c6fcd2bbf8fad424caeec5c85b9_rle_crop_3915059091_0.png treat image : temp/1755187827_3203506_1377046746_a5f61c6fcd2bbf8fad424caeec5c85b9_rle_crop_3915059093_0.png treat image : temp/1755187827_3203506_1377046746_a5f61c6fcd2bbf8fad424caeec5c85b9_rle_crop_3915059094_0.png treat image : temp/1755187827_3203506_1377046713_328b1d8dde016e82ce8c6ba3ea36d1bb_rle_crop_3915059096_0.png treat image : temp/1755187827_3203506_1377046713_328b1d8dde016e82ce8c6ba3ea36d1bb_rle_crop_3915059098_0.png treat image : temp/1755187827_3203506_1377046709_022f6e0a9cfe01a996805122f17c2196_rle_crop_3915059100_0.png treat image : temp/1755187827_3203506_1377046709_022f6e0a9cfe01a996805122f17c2196_rle_crop_3915059101_0.png treat image : temp/1755187827_3203506_1377046709_022f6e0a9cfe01a996805122f17c2196_rle_crop_3915059102_0.png treat image : temp/1755187827_3203506_1377046709_022f6e0a9cfe01a996805122f17c2196_rle_crop_3915059104_0.png treat image : temp/1755187827_3203506_1377046709_022f6e0a9cfe01a996805122f17c2196_rle_crop_3915059106_0.png treat image : temp/1755187827_3203506_1377046864_d0b87753982c563f28770b1418da7997_rle_crop_3915059031_0.png treat image : temp/1755187827_3203506_1377046836_cb0ac9c9e6f5cad219791760720036d2_rle_crop_3915059032_0.png treat image : temp/1755187827_3203506_1377046791_316d79ed8bb32afae6dd8d9ca77dc33b_rle_crop_3915059060_0.png treat image : temp/1755187827_3203506_1377046779_75fca8d01eea2b0ec00ef24bfa562bc8_rle_crop_3915059074_0.png treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61_rle_crop_3915059087_0.png treat image : temp/1755187827_3203506_1377046833_ffcdc4218b3a29f4dddee9ad42430d02_rle_crop_3915059037_0.png treat image : temp/1755187827_3203506_1377046833_ffcdc4218b3a29f4dddee9ad42430d02_rle_crop_3915059038_0.png treat image : temp/1755187827_3203506_1377046830_86ab5c9b70c58d857ae70f9cd118555b_rle_crop_3915059040_0.png treat image : temp/1755187827_3203506_1377046830_86ab5c9b70c58d857ae70f9cd118555b_rle_crop_3915059044_0.png treat image : temp/1755187827_3203506_1377046825_a66bdad891f266ba995808dc5df336ad_rle_crop_3915059049_0.png treat image : temp/1755187827_3203506_1377046819_ff1f7eae144d776499accf64c99082fb_rle_crop_3915059053_0.png treat image : temp/1755187827_3203506_1377046819_ff1f7eae144d776499accf64c99082fb_rle_crop_3915059055_0.png treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059062_0.png treat image : temp/1755187827_3203506_1377046779_75fca8d01eea2b0ec00ef24bfa562bc8_rle_crop_3915059075_0.png treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61_rle_crop_3915059083_0.png treat image : temp/1755187827_3203506_1377046753_4bfd72da85948b022de01a998dc34f61_rle_crop_3915059089_0.png treat image : temp/1755187827_3203506_1377046740_5cc7529872291c176ad313e39c9a36eb_rle_crop_3915059095_0.png treat image : temp/1755187827_3203506_1377046713_328b1d8dde016e82ce8c6ba3ea36d1bb_rle_crop_3915059097_0.png treat image : temp/1755187827_3203506_1377046713_328b1d8dde016e82ce8c6ba3ea36d1bb_rle_crop_3915059099_0.png treat image : temp/1755187827_3203506_1377046709_022f6e0a9cfe01a996805122f17c2196_rle_crop_3915059103_0.png treat image : temp/1755187827_3203506_1377046709_022f6e0a9cfe01a996805122f17c2196_rle_crop_3915059105_0.png treat image : temp/1755187827_3203506_1377046830_86ab5c9b70c58d857ae70f9cd118555b_rle_crop_3915059041_0.png treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059067_0.png treat image : temp/1755187827_3203506_1377046785_88b7c4259b07b230028c7bddd2800d86_rle_crop_3915059069_0.png treat image : temp/1755187827_3203506_1377046746_a5f61c6fcd2bbf8fad424caeec5c85b9_rle_crop_3915059092_0.png treat image : temp/1755187827_3203506_1377046776_d9ccda1ab68336d92b8e44ce52397149_rle_crop_3915059079_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 92 time used for this insertion : 0.01858377456665039 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 92 time used for this insertion : 0.017715930938720703 save missing photos in datou_result : time spend for datou_step_exec : 4.090109825134277 time spend to save output : 0.04092597961425781 total time spend for step 7 : 4.131035804748535 step8:velours_tree Thu Aug 14 18:11:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09452629089355469 time spend to save output : 3.695487976074219e-05 total time spend for step 8 : 0.09456324577331543 step9:send_mail_cod Thu Aug 14 18:11:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25992555_14-08-2025_18_11_54.pdf 25992762 change filename to text .change filename to text .change filename to text .change filename to text .imagette259927621755187914 25992763 imagette259927631755187914 25992764 imagette259927641755187914 25992765 imagette259927651755187914 25992766 imagette259927661755187914 25992767 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette259927671755187914 25992768 change filename to text .imagette259927681755187915 25992769 imagette259927691755187915 25992770 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette259927701755187915 25992772 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette259927721755187916 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25992555 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25992762,25992763,25992764,25992765,25992766,25992767,25992768,25992769,25992770,25992771,25992772?tags=autre,metal,pehd,flou,mal_croppe,papier,pet_fonce,background,carton,environnement,pet_clair args[1377046864] : ((1377046864, 0.5584710950509425, 492688767), (1377046864, 0.5539687288962285, 2107752395), '0.057759843991126554') We are sending mail with results at report@fotonower.com args[1377046836] : ((1377046836, 0.03421179923535869, 492688767), (1377046836, 0.13197425495217185, 2107752395), '0.057759843991126554') We are sending mail with results at report@fotonower.com args[1377046833] : ((1377046833, 0.436828118478923, 492688767), (1377046833, 0.4741331975644612, 2107752395), '0.057759843991126554') We are sending mail with results at report@fotonower.com args[1377046830] : ((1377046830, -3.2117389921989425, 492609224), (1377046830, 0.3975795040993632, 2107752395), '0.057759843991126554') We are sending mail with results at report@fotonower.com args[1377046825] : ((1377046825, 1.0740398086802114, 492688767), (1377046825, 0.8032210224123223, 2107752395), '0.057759843991126554') We are sending mail with results at report@fotonower.com args[1377046819] : ((1377046819, -4.394003111671201, 492609224), (1377046819, 0.4724148939518944, 2107752395), '0.057759843991126554') We are sending mail with results at report@fotonower.com args[1377046791] : ((1377046791, -1.8701342688721148, 492688767), (1377046791, 0.44740948685305804, 2107752395), '0.057759843991126554') We are sending mail with results at report@fotonower.com args[1377046785] : ((1377046785, -4.480947947396078, 492609224), (1377046785, 0.33137238592806406, 2107752395), '0.057759843991126554') We are sending mail with results at report@fotonower.com args[1377046779] : ((1377046779, 0.05119853676013182, 492688767), (1377046779, 0.31747527650300394, 2107752395), '0.057759843991126554') We are sending mail with results at report@fotonower.com args[1377046776] : ((1377046776, -4.3827062374092085, 492609224), (1377046776, 0.35589530619725795, 2107752395), '0.057759843991126554') We are sending mail with results at report@fotonower.com args[1377046753] : ((1377046753, -0.4390743207750082, 492688767), (1377046753, 0.700197722897593, 2107752395), '0.057759843991126554') We are sending mail with results at report@fotonower.com args[1377046750] : ((1377046750, -0.34828767677475114, 492688767), (1377046750, 0.39595998017779943, 2107752395), '0.057759843991126554') We are sending mail with results at report@fotonower.com args[1377046746] : ((1377046746, -5.168606661357349, 492609224), (1377046746, 0.37552298877167434, 2107752395), '0.057759843991126554') We are sending mail with results at report@fotonower.com args[1377046740] : ((1377046740, 2.135349700441753, 492688767), (1377046740, 0.614917757587967, 2107752395), '0.057759843991126554') We are sending mail with results at report@fotonower.com args[1377046713] : ((1377046713, -0.08935620510615343, 492688767), (1377046713, 1.3783622232550297, 2107752395), '0.057759843991126554') We are sending mail with results at report@fotonower.com args[1377046709] : ((1377046709, -3.937624708836534, 492609224), (1377046709, 0.5592756778954299, 2107752395), '0.057759843991126554') We are sending mail with results at report@fotonower.com refus_total : 0.057759843991126554 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25992555 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25992555_14-08-2025_18_11_54.pdf results_Auto_P25992555_14-08-2025_18_11_54.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25992555_14-08-2025_18_11_54.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25992555','results_Auto_P25992555_14-08-2025_18_11_54.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25992555_14-08-2025_18_11_54.pdf','pdf','','0.31','0.057759843991126554') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25992555

https://www.fotonower.com/image?json=false&list_photos_id=1377046864
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377046836
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377046833
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377046830
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377046825
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0740398086802114)
https://www.fotonower.com/image?json=false&list_photos_id=1377046819
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377046791
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377046785
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377046779
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377046776
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377046753
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377046750
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377046746
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377046740
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.135349700441753)
https://www.fotonower.com/image?json=false&list_photos_id=1377046713
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377046709
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 5.78%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/25992762?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/25992767?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/25992768?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/25992770?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25992772?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25992555_14-08-2025_18_11_54.pdf.

Lien vers velours :https://www.fotonower.com/velours/25992762,25992763,25992764,25992765,25992766,25992767,25992768,25992769,25992770,25992771,25992772?tags=autre,metal,pehd,flou,mal_croppe,papier,pet_fonce,background,carton,environnement,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 14 Aug 2025 16:11:59 GMT Content-Length: 0 Connection: close X-Message-Id: FPO4goQNQHm3su_vJkHerw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1377046864, 1377046836, 1377046833, 1377046830, 1377046825, 1377046819, 1377046791, 1377046785, 1377046779, 1377046776, 1377046753, 1377046750, 1377046746, 1377046740, 1377046713, 1377046709] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046864', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046836', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046833', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046830', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046825', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046819', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046791', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046785', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046779', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046776', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046753', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046750', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046746', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046740', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046713', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046709', None, None, None, None, None, '3538575') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.012903451919555664 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.61269736289978 time spend to save output : 0.013130426406860352 total time spend for step 9 : 4.625827789306641 step10:split_time_score Thu Aug 14 18:11:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 16),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 14082025 25992555 Nombre de photos uploadées : 16 / 23040 (0%) 14082025 25992555 Nombre de photos taguées (types de déchets): 0 / 16 (0%) 14082025 25992555 Nombre de photos taguées (volume) : 0 / 16 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ???????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007443428039550781 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20627164840698242 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.1280742026748971 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25974582_14-08-2025_10_11_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25974582 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25974582 AND mptpi.`type`=3594 To do Qualite : 0.015116423932613166 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25974586_14-08-2025_10_01_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25974586 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25974586 AND mptpi.`type`=3594 To do Qualite : 0.1361061197916667 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25980071_14-08-2025_14_41_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25980071 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25980071 AND mptpi.`type`=3594 To do Qualite : 0.12013578869047618 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25980101_14-08-2025_13_01_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25980101 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25980101 AND mptpi.`type`=3594 To do Qualite : 0.1582214988425926 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25980105_14-08-2025_12_51_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25980105 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25980105 AND mptpi.`type`=3594 To do Qualite : 0.16527360973324515 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25980109_14-08-2025_12_41_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25980109 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25980109 AND mptpi.`type`=3594 To do Qualite : 0.03430676118827159 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25983542_14-08-2025_14_21_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25983542 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25983542 AND mptpi.`type`=3594 To do Qualite : 0.08205182613168727 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25983560_14-08-2025_14_11_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25983560 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25983560 AND mptpi.`type`=3594 To do Qualite : 0.11458207947530864 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25990602_14-08-2025_17_42_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25990602 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25990602 AND mptpi.`type`=3594 To do Qualite : 0.15098488940329224 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25990607_14-08-2025_17_32_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25990607 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25990607 AND mptpi.`type`=3594 To do Qualite : 0.1071771973204265 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25990609_14-08-2025_17_21_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25990609 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25990609 AND mptpi.`type`=3594 To do Qualite : 0.11963767954653373 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25990613_14-08-2025_17_12_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25990613 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25990613 AND mptpi.`type`=3594 To do Qualite : 0.057759843991126554 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25992555_14-08-2025_18_11_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25992555 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25992555 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'14082025': {'nb_upload': 16, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1377046864, 1377046836, 1377046833, 1377046830, 1377046825, 1377046819, 1377046791, 1377046785, 1377046779, 1377046776, 1377046753, 1377046750, 1377046746, 1377046740, 1377046713, 1377046709] Looping around the photos to save general results len do output : 1 /25992555Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046864', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046836', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046833', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046830', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046825', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046819', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046791', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046785', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046779', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046776', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046753', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046750', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046746', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046740', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046713', None, None, None, None, None, '3538575') ('3318', None, None, None, None, None, None, None, '3538575') ('3318', '25992555', '1377046709', None, None, None, None, None, '3538575') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 17 time used for this insertion : 0.014879226684570312 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.1420953273773193 time spend to save output : 0.01523733139038086 total time spend for step 10 : 1.1573326587677002 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 16 set_done_treatment 53.15user 15.05system 1:35.48elapsed 71%CPU (0avgtext+0avgdata 3113640maxresident)k 500304inputs+25376outputs (4major+1311648minor)pagefaults 0swaps