python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3607106 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3689059'] with mtr_portfolio_ids : ['26713963'] and first list_photo_ids : [] new path : /proc/3607106/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 40 ; length of list_pids : 40 ; length of list_args : 40 time to download the photos : 6.996330261230469 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Sep 10 19:20:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10594 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-10 19:20:39.394804: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-10 19:20:39.424502: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-10 19:20:39.426747: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7efed8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-10 19:20:39.426796: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-10 19:20:39.430606: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-10 19:20:39.599367: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x272e4bc0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-10 19:20:39.599426: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-10 19:20:39.600860: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-10 19:20:39.601247: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-10 19:20:39.604203: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-10 19:20:39.606814: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-10 19:20:39.607326: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-10 19:20:39.610626: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-10 19:20:39.612433: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-10 19:20:39.617122: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-10 19:20:39.618581: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-10 19:20:39.618646: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-10 19:20:39.619376: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-10 19:20:39.619390: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-10 19:20:39.619412: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-10 19:20:39.621139: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9813 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-10 19:20:39.892108: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-10 19:20:39.892185: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-10 19:20:39.892207: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-10 19:20:39.892222: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-10 19:20:39.892237: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-10 19:20:39.892252: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-10 19:20:39.892266: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-10 19:20:39.892282: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-10 19:20:39.893585: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-10 19:20:39.894723: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-10 19:20:39.894754: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-10 19:20:39.894769: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-10 19:20:39.894783: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-10 19:20:39.894797: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-10 19:20:39.894811: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-10 19:20:39.894825: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-10 19:20:39.894840: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-10 19:20:39.896131: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-10 19:20:39.896160: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-10 19:20:39.896169: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-10 19:20:39.896177: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-10 19:20:39.897512: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9813 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-10 19:20:48.615329: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-10 19:20:48.808309: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 40 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 Detection mask done ! Trying to reset tf kernel 3607851 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5302 tf kernel not reseted sub process len(results) : 40 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 40 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10594 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.004421710968017578 nb_pixel_total : 108585 time to create 1 rle with old method : 0.14168882369995117 length of segment : 520 time for calcul the mask position with numpy : 0.0005049705505371094 nb_pixel_total : 20911 time to create 1 rle with old method : 0.025143861770629883 length of segment : 134 time for calcul the mask position with numpy : 0.0001621246337890625 nb_pixel_total : 9688 time to create 1 rle with old method : 0.011761903762817383 length of segment : 88 time for calcul the mask position with numpy : 0.00014162063598632812 nb_pixel_total : 7861 time to create 1 rle with old method : 0.009235858917236328 length of segment : 116 time for calcul the mask position with numpy : 0.00033020973205566406 nb_pixel_total : 17909 time to create 1 rle with old method : 0.020536422729492188 length of segment : 255 time for calcul the mask position with numpy : 8.368492126464844e-05 nb_pixel_total : 3681 time to create 1 rle with old method : 0.004637002944946289 length of segment : 44 time for calcul the mask position with numpy : 0.0003743171691894531 nb_pixel_total : 19796 time to create 1 rle with old method : 0.023235797882080078 length of segment : 220 time for calcul the mask position with numpy : 0.00010204315185546875 nb_pixel_total : 5166 time to create 1 rle with old method : 0.0061798095703125 length of segment : 101 time for calcul the mask position with numpy : 0.00960683822631836 nb_pixel_total : 579107 time to create 1 rle with new method : 0.03126716613769531 length of segment : 1119 time for calcul the mask position with numpy : 0.00014901161193847656 nb_pixel_total : 5287 time to create 1 rle with old method : 0.009731292724609375 length of segment : 130 time for calcul the mask position with numpy : 0.0015118122100830078 nb_pixel_total : 105909 time to create 1 rle with old method : 0.11939740180969238 length of segment : 548 time for calcul the mask position with numpy : 0.00015473365783691406 nb_pixel_total : 6849 time to create 1 rle with old method : 0.008322954177856445 length of segment : 107 time for calcul the mask position with numpy : 0.00014281272888183594 nb_pixel_total : 8985 time to create 1 rle with old method : 0.01372528076171875 length of segment : 85 time for calcul the mask position with numpy : 0.005394935607910156 nb_pixel_total : 415487 time to create 1 rle with new method : 0.01205301284790039 length of segment : 554 time for calcul the mask position with numpy : 0.00022149085998535156 nb_pixel_total : 14268 time to create 1 rle with old method : 0.018270015716552734 length of segment : 162 time for calcul the mask position with numpy : 0.00018906593322753906 nb_pixel_total : 10621 time to create 1 rle with old method : 0.012646675109863281 length of segment : 132 time for calcul the mask position with numpy : 0.00029206275939941406 nb_pixel_total : 16088 time to create 1 rle with old method : 0.01856398582458496 length of segment : 144 time for calcul the mask position with numpy : 0.0012369155883789062 nb_pixel_total : 106426 time to create 1 rle with old method : 0.11825013160705566 length of segment : 513 time for calcul the mask position with numpy : 0.0002105236053466797 nb_pixel_total : 7604 time to create 1 rle with old method : 0.008712530136108398 length of segment : 174 time for calcul the mask position with numpy : 0.00023031234741210938 nb_pixel_total : 16079 time to create 1 rle with old method : 0.018476009368896484 length of segment : 145 time for calcul the mask position with numpy : 0.00042319297790527344 nb_pixel_total : 31002 time to create 1 rle with old method : 0.0380251407623291 length of segment : 209 time for calcul the mask position with numpy : 0.0001556873321533203 nb_pixel_total : 8402 time to create 1 rle with old method : 0.010229349136352539 length of segment : 119 time for calcul the mask position with numpy : 0.00036334991455078125 nb_pixel_total : 5884 time to create 1 rle with old method : 0.013215303421020508 length of segment : 59 time for calcul the mask position with numpy : 0.0018427371978759766 nb_pixel_total : 24616 time to create 1 rle with old method : 0.04871773719787598 length of segment : 190 time for calcul the mask position with numpy : 0.0002741813659667969 nb_pixel_total : 7994 time to create 1 rle with old method : 0.008951902389526367 length of segment : 111 time for calcul the mask position with numpy : 0.0003352165222167969 nb_pixel_total : 8450 time to create 1 rle with old method : 0.009706497192382812 length of segment : 121 time for calcul the mask position with numpy : 0.0001621246337890625 nb_pixel_total : 3004 time to create 1 rle with old method : 0.0036749839782714844 length of segment : 47 time for calcul the mask position with numpy : 0.00012135505676269531 nb_pixel_total : 1764 time to create 1 rle with old method : 0.0021648406982421875 length of segment : 49 time for calcul the mask position with numpy : 0.0002753734588623047 nb_pixel_total : 7882 time to create 1 rle with old method : 0.009153604507446289 length of segment : 90 time for calcul the mask position with numpy : 0.0003330707550048828 nb_pixel_total : 8824 time to create 1 rle with old method : 0.010010957717895508 length of segment : 143 time for calcul the mask position with numpy : 0.0004990100860595703 nb_pixel_total : 10545 time to create 1 rle with old method : 0.011570930480957031 length of segment : 182 time for calcul the mask position with numpy : 0.0003218650817871094 nb_pixel_total : 5120 time to create 1 rle with old method : 0.005860567092895508 length of segment : 152 time for calcul the mask position with numpy : 0.0003120899200439453 nb_pixel_total : 8423 time to create 1 rle with old method : 0.009470224380493164 length of segment : 121 time for calcul the mask position with numpy : 0.0002105236053466797 nb_pixel_total : 8160 time to create 1 rle with old method : 0.00916290283203125 length of segment : 136 time for calcul the mask position with numpy : 0.00015878677368164062 nb_pixel_total : 3998 time to create 1 rle with old method : 0.004741191864013672 length of segment : 68 time for calcul the mask position with numpy : 0.00030159950256347656 nb_pixel_total : 6208 time to create 1 rle with old method : 0.007012844085693359 length of segment : 127 time for calcul the mask position with numpy : 0.0003223419189453125 nb_pixel_total : 10865 time to create 1 rle with old method : 0.01259160041809082 length of segment : 117 time for calcul the mask position with numpy : 0.014072895050048828 nb_pixel_total : 728786 time to create 1 rle with new method : 0.021079063415527344 length of segment : 962 time for calcul the mask position with numpy : 0.0006430149078369141 nb_pixel_total : 40636 time to create 1 rle with old method : 0.044560909271240234 length of segment : 196 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 1814 time to create 1 rle with old method : 0.0021533966064453125 length of segment : 48 time for calcul the mask position with numpy : 0.0001392364501953125 nb_pixel_total : 4944 time to create 1 rle with old method : 0.0057888031005859375 length of segment : 163 time for calcul the mask position with numpy : 0.00014281272888183594 nb_pixel_total : 7866 time to create 1 rle with old method : 0.008835077285766602 length of segment : 120 time for calcul the mask position with numpy : 0.00015497207641601562 nb_pixel_total : 8335 time to create 1 rle with old method : 0.009489059448242188 length of segment : 119 time for calcul the mask position with numpy : 0.00015664100646972656 nb_pixel_total : 8146 time to create 1 rle with old method : 0.009305000305175781 length of segment : 115 time for calcul the mask position with numpy : 0.0002543926239013672 nb_pixel_total : 16595 time to create 1 rle with old method : 0.018370866775512695 length of segment : 170 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 2695 time to create 1 rle with old method : 0.0031728744506835938 length of segment : 61 time for calcul the mask position with numpy : 0.00012350082397460938 nb_pixel_total : 5704 time to create 1 rle with old method : 0.006369829177856445 length of segment : 107 time for calcul the mask position with numpy : 0.0001735687255859375 nb_pixel_total : 8844 time to create 1 rle with old method : 0.009984493255615234 length of segment : 131 time for calcul the mask position with numpy : 0.0002238750457763672 nb_pixel_total : 16568 time to create 1 rle with old method : 0.018503427505493164 length of segment : 107 time for calcul the mask position with numpy : 0.00015425682067871094 nb_pixel_total : 8226 time to create 1 rle with old method : 0.00900888442993164 length of segment : 120 time for calcul the mask position with numpy : 0.00041174888610839844 nb_pixel_total : 14542 time to create 1 rle with old method : 0.016648530960083008 length of segment : 135 time for calcul the mask position with numpy : 0.0002956390380859375 nb_pixel_total : 7300 time to create 1 rle with old method : 0.008387565612792969 length of segment : 93 time for calcul the mask position with numpy : 0.0001544952392578125 nb_pixel_total : 8237 time to create 1 rle with old method : 0.0096893310546875 length of segment : 120 time for calcul the mask position with numpy : 0.0001583099365234375 nb_pixel_total : 7311 time to create 1 rle with old method : 0.00910806655883789 length of segment : 91 time for calcul the mask position with numpy : 0.00031566619873046875 nb_pixel_total : 17870 time to create 1 rle with old method : 0.021520376205444336 length of segment : 175 time for calcul the mask position with numpy : 0.00016498565673828125 nb_pixel_total : 8898 time to create 1 rle with old method : 0.01007223129272461 length of segment : 126 time for calcul the mask position with numpy : 0.0005710124969482422 nb_pixel_total : 18537 time to create 1 rle with old method : 0.02026534080505371 length of segment : 247 time for calcul the mask position with numpy : 0.000225067138671875 nb_pixel_total : 8579 time to create 1 rle with old method : 0.00947260856628418 length of segment : 169 time for calcul the mask position with numpy : 0.00010633468627929688 nb_pixel_total : 4866 time to create 1 rle with old method : 0.0055408477783203125 length of segment : 92 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 3173 time to create 1 rle with old method : 0.0037326812744140625 length of segment : 74 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 3805 time to create 1 rle with old method : 0.0044939517974853516 length of segment : 49 time for calcul the mask position with numpy : 0.00018095970153808594 nb_pixel_total : 8820 time to create 1 rle with old method : 0.009659528732299805 length of segment : 181 time for calcul the mask position with numpy : 0.00014281272888183594 nb_pixel_total : 8170 time to create 1 rle with old method : 0.009404659271240234 length of segment : 120 time for calcul the mask position with numpy : 0.0003814697265625 nb_pixel_total : 26717 time to create 1 rle with old method : 0.029450416564941406 length of segment : 242 time for calcul the mask position with numpy : 0.0001761913299560547 nb_pixel_total : 8121 time to create 1 rle with old method : 0.009219646453857422 length of segment : 120 time for calcul the mask position with numpy : 0.0001404285430908203 nb_pixel_total : 6465 time to create 1 rle with old method : 0.007584810256958008 length of segment : 136 time for calcul the mask position with numpy : 0.00012564659118652344 nb_pixel_total : 5965 time to create 1 rle with old method : 0.0069921016693115234 length of segment : 124 time for calcul the mask position with numpy : 0.0012409687042236328 nb_pixel_total : 85572 time to create 1 rle with old method : 0.09958481788635254 length of segment : 247 time for calcul the mask position with numpy : 0.017961978912353516 nb_pixel_total : 719874 time to create 1 rle with new method : 0.023514986038208008 length of segment : 899 time for calcul the mask position with numpy : 0.00051116943359375 nb_pixel_total : 30827 time to create 1 rle with old method : 0.033924102783203125 length of segment : 129 time for calcul the mask position with numpy : 0.0003876686096191406 nb_pixel_total : 8404 time to create 1 rle with old method : 0.009346246719360352 length of segment : 130 time for calcul the mask position with numpy : 0.0003261566162109375 nb_pixel_total : 9715 time to create 1 rle with old method : 0.010740280151367188 length of segment : 139 time for calcul the mask position with numpy : 0.000316619873046875 nb_pixel_total : 9073 time to create 1 rle with old method : 0.010255098342895508 length of segment : 130 time for calcul the mask position with numpy : 0.0005404949188232422 nb_pixel_total : 28457 time to create 1 rle with old method : 0.030963659286499023 length of segment : 172 time for calcul the mask position with numpy : 0.0003821849822998047 nb_pixel_total : 8764 time to create 1 rle with old method : 0.009812355041503906 length of segment : 128 time for calcul the mask position with numpy : 0.00043511390686035156 nb_pixel_total : 8660 time to create 1 rle with old method : 0.009623527526855469 length of segment : 173 time for calcul the mask position with numpy : 0.0007040500640869141 nb_pixel_total : 24870 time to create 1 rle with old method : 0.030871152877807617 length of segment : 226 time for calcul the mask position with numpy : 0.012275934219360352 nb_pixel_total : 478499 time to create 1 rle with new method : 0.027078866958618164 length of segment : 1520 time for calcul the mask position with numpy : 0.0004134178161621094 nb_pixel_total : 17641 time to create 1 rle with old method : 0.02191305160522461 length of segment : 180 time for calcul the mask position with numpy : 0.0003707408905029297 nb_pixel_total : 9075 time to create 1 rle with old method : 0.013424396514892578 length of segment : 127 time for calcul the mask position with numpy : 0.0006456375122070312 nb_pixel_total : 10811 time to create 1 rle with old method : 0.016295433044433594 length of segment : 116 time for calcul the mask position with numpy : 0.0003762245178222656 nb_pixel_total : 8131 time to create 1 rle with old method : 0.010736942291259766 length of segment : 151 time for calcul the mask position with numpy : 0.00030493736267089844 nb_pixel_total : 6953 time to create 1 rle with old method : 0.008460521697998047 length of segment : 105 time for calcul the mask position with numpy : 0.00039315223693847656 nb_pixel_total : 8317 time to create 1 rle with old method : 0.009957551956176758 length of segment : 176 time for calcul the mask position with numpy : 0.00036215782165527344 nb_pixel_total : 6356 time to create 1 rle with old method : 0.007890701293945312 length of segment : 116 time spent for convertir_results : 3.994941473007202 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 85 chid ids of type : 3594 Number RLEs to save : 16909 save missing photos in datou_result : time spend for datou_step_exec : 39.54939389228821 time spend to save output : 1.058384656906128 total time spend for step 1 : 40.607778549194336 step2:crop_condition Wed Sep 10 19:21:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 40 ! batch 1 Loaded 85 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 34 About to insert : list_path_to_insert length 34 new photo from crops ! About to upload 34 photos upload in portfolio : 3736932 init cache_photo without model_param we have 34 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757524880_3607106 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 34 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.035506248474121 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757524894_3607106 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.001311779022217 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757524900_3607106 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5408132076263428 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 33 About to insert : list_path_to_insert length 33 new photo from crops ! About to upload 33 photos upload in portfolio : 3736932 init cache_photo without model_param we have 33 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757524912_3607106 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 33 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.423168182373047 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757524922_3607106 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.836676836013794 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1382886044, 1382886042, 1382886039, 1382886035, 1382886031, 1382886020, 1382885965, 1382885964, 1382885954, 1382885952, 1382885896, 1382885894, 1382885891, 1382885888, 1382885879, 1382885854, 1382885735, 1382885733, 1382885731, 1382885729, 1382885727, 1382885707, 1382885706, 1382885705, 1382885704, 1382885702, 1382885687, 1382885685, 1382885683, 1382885681, 1382885674, 1382885651, 1382885623, 1382885621, 1382885618, 1382885615, 1382885613, 1382885599, 1382885597, 1382885595] Looping around the photos to save general results len do output : 85 /1383101899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383101998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383102000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383102001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886044', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886042', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886039', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886035', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886031', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886020', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885965', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885964', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885954', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885952', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885896', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885894', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885891', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885888', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885879', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885854', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885735', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885733', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885731', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885729', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885727', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885707', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885706', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885705', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885704', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885702', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885687', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885685', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885683', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885681', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885674', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885651', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885623', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885621', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885618', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885615', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885613', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885599', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885597', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885595', None, None, None, None, None, '3689059') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 295 time used for this insertion : 0.03801465034484863 save_final save missing photos in datou_result : time spend for datou_step_exec : 45.385981798172 time spend to save output : 0.04124283790588379 total time spend for step 2 : 45.42722463607788 step3:rle_unique_nms_with_priority Wed Sep 10 19:22:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 85 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ No data in photo_id : 1382886044 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.11391615867614746 time for calcul the mask position with numpy : 0.033225297927856445 nb_pixel_total : 1965015 time to create 1 rle with new method : 0.07180094718933105 time for calcul the mask position with numpy : 0.00730133056640625 nb_pixel_total : 108585 time to create 1 rle with old method : 0.151993989944458 create new chi : 0.2647871971130371 time to delete rle : 0.022473573684692383 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2120 TO DO : save crop sub photo not yet done ! save time : 0.18238306045532227 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04220771789550781 time for calcul the mask position with numpy : 0.027789592742919922 nb_pixel_total : 2043001 time to create 1 rle with new method : 0.32916975021362305 time for calcul the mask position with numpy : 0.006490945816040039 nb_pixel_total : 9688 time to create 1 rle with old method : 0.011521100997924805 time for calcul the mask position with numpy : 0.006445407867431641 nb_pixel_total : 20911 time to create 1 rle with old method : 0.024155139923095703 create new chi : 0.412949800491333 time to delete rle : 0.0003178119659423828 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1524 TO DO : save crop sub photo not yet done ! save time : 0.14984822273254395 nb_obj : 4 nb_hashtags : 4 time to prepare the origin masks : 0.21714329719543457 time for calcul the mask position with numpy : 0.08058571815490723 nb_pixel_total : 2024353 time to create 1 rle with new method : 0.19811010360717773 time for calcul the mask position with numpy : 0.006574869155883789 nb_pixel_total : 19796 time to create 1 rle with old method : 0.022495508193969727 time for calcul the mask position with numpy : 0.0062656402587890625 nb_pixel_total : 3681 time to create 1 rle with old method : 0.00426936149597168 time for calcul the mask position with numpy : 0.006320476531982422 nb_pixel_total : 17909 time to create 1 rle with old method : 0.020148754119873047 time for calcul the mask position with numpy : 0.006786823272705078 nb_pixel_total : 7861 time to create 1 rle with old method : 0.008916378021240234 create new chi : 0.3712046146392822 time to delete rle : 0.00039887428283691406 batch 1 Loaded 9 chid ids of type : 3594 ++++++++Number RLEs to save : 2350 TO DO : save crop sub photo not yet done ! save time : 0.18956995010375977 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04333162307739258 time for calcul the mask position with numpy : 0.016568422317504883 nb_pixel_total : 1489327 time to create 1 rle with new method : 0.1988224983215332 time for calcul the mask position with numpy : 0.01522374153137207 nb_pixel_total : 579107 time to create 1 rle with new method : 0.07003045082092285 time for calcul the mask position with numpy : 0.006903648376464844 nb_pixel_total : 5166 time to create 1 rle with old method : 0.0057888031005859375 create new chi : 0.32115912437438965 time to delete rle : 0.0009274482727050781 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 3520 TO DO : save crop sub photo not yet done ! save time : 0.2521951198577881 No data in photo_id : 1382886020 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04684638977050781 time for calcul the mask position with numpy : 0.022110462188720703 nb_pixel_total : 1962404 time to create 1 rle with new method : 0.16380596160888672 time for calcul the mask position with numpy : 0.006882190704345703 nb_pixel_total : 105909 time to create 1 rle with old method : 0.11981487274169922 time for calcul the mask position with numpy : 0.006812334060668945 nb_pixel_total : 5287 time to create 1 rle with old method : 0.006089687347412109 create new chi : 0.3331887722015381 time to delete rle : 0.0003676414489746094 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2436 TO DO : save crop sub photo not yet done ! save time : 0.17862939834594727 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.08495807647705078 time for calcul the mask position with numpy : 0.11175847053527832 nb_pixel_total : 1628011 time to create 1 rle with new method : 0.09433984756469727 time for calcul the mask position with numpy : 0.0063724517822265625 nb_pixel_total : 14268 time to create 1 rle with old method : 0.016324758529663086 time for calcul the mask position with numpy : 0.008722543716430664 nb_pixel_total : 415487 time to create 1 rle with new method : 0.08986830711364746 time for calcul the mask position with numpy : 0.006287813186645508 nb_pixel_total : 8985 time to create 1 rle with old method : 0.010125398635864258 time for calcul the mask position with numpy : 0.0067157745361328125 nb_pixel_total : 6849 time to create 1 rle with old method : 0.008089780807495117 create new chi : 0.36846113204956055 time to delete rle : 0.0004963874816894531 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2896 TO DO : save crop sub photo not yet done ! save time : 0.21983051300048828 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.08011627197265625 time for calcul the mask position with numpy : 0.02418375015258789 nb_pixel_total : 1916782 time to create 1 rle with new method : 0.08310699462890625 time for calcul the mask position with numpy : 0.006432533264160156 nb_pixel_total : 16079 time to create 1 rle with old method : 0.01820540428161621 time for calcul the mask position with numpy : 0.006252288818359375 nb_pixel_total : 7604 time to create 1 rle with old method : 0.008703231811523438 time for calcul the mask position with numpy : 0.006697893142700195 nb_pixel_total : 106426 time to create 1 rle with old method : 0.12038731575012207 time for calcul the mask position with numpy : 0.006453514099121094 nb_pixel_total : 16088 time to create 1 rle with old method : 0.018793582916259766 time for calcul the mask position with numpy : 0.0063207149505615234 nb_pixel_total : 10621 time to create 1 rle with old method : 0.011995553970336914 create new chi : 0.32747936248779297 time to delete rle : 0.0005555152893066406 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 3296 TO DO : save crop sub photo not yet done ! save time : 0.24390482902526855 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03448796272277832 time for calcul the mask position with numpy : 0.02007460594177246 nb_pixel_total : 2042598 time to create 1 rle with new method : 0.05232739448547363 time for calcul the mask position with numpy : 0.006181240081787109 nb_pixel_total : 31002 time to create 1 rle with old method : 0.03509044647216797 create new chi : 0.11397528648376465 time to delete rle : 0.00023889541625976562 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1498 TO DO : save crop sub photo not yet done ! save time : 0.12932419776916504 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.0529019832611084 time for calcul the mask position with numpy : 0.020727157592773438 nb_pixel_total : 2034915 time to create 1 rle with new method : 0.08518576622009277 time for calcul the mask position with numpy : 0.007563114166259766 nb_pixel_total : 24399 time to create 1 rle with old method : 0.028096437454223633 time for calcul the mask position with numpy : 0.0063397884368896484 nb_pixel_total : 5884 time to create 1 rle with old method : 0.006779909133911133 time for calcul the mask position with numpy : 0.0061304569244384766 nb_pixel_total : 8402 time to create 1 rle with old method : 0.01055002212524414 create new chi : 0.17955708503723145 time to delete rle : 0.00032711029052734375 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 1790 TO DO : save crop sub photo not yet done ! save time : 0.14658284187316895 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03702735900878906 time for calcul the mask position with numpy : 0.023296594619750977 nb_pixel_total : 2065606 time to create 1 rle with new method : 0.0755608081817627 time for calcul the mask position with numpy : 0.006079912185668945 nb_pixel_total : 7994 time to create 1 rle with old method : 0.00900888442993164 create new chi : 0.11424398422241211 time to delete rle : 0.0003077983856201172 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1302 TO DO : save crop sub photo not yet done ! save time : 0.10933876037597656 No data in photo_id : 1382885891 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.0514826774597168 time for calcul the mask position with numpy : 0.021334171295166016 nb_pixel_total : 2060382 time to create 1 rle with new method : 0.09227848052978516 time for calcul the mask position with numpy : 0.007498502731323242 nb_pixel_total : 1764 time to create 1 rle with old method : 0.0020771026611328125 time for calcul the mask position with numpy : 0.006946086883544922 nb_pixel_total : 3004 time to create 1 rle with old method : 0.0035238265991210938 time for calcul the mask position with numpy : 0.006974697113037109 nb_pixel_total : 8450 time to create 1 rle with old method : 0.009694576263427734 create new chi : 0.16059470176696777 time to delete rle : 0.0003032684326171875 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1514 TO DO : save crop sub photo not yet done ! save time : 0.1436290740966797 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.061231374740600586 time for calcul the mask position with numpy : 0.08174872398376465 nb_pixel_total : 2046349 time to create 1 rle with new method : 0.08647894859313965 time for calcul the mask position with numpy : 0.0063321590423583984 nb_pixel_total : 10545 time to create 1 rle with old method : 0.012013912200927734 time for calcul the mask position with numpy : 0.006245613098144531 nb_pixel_total : 8824 time to create 1 rle with old method : 0.010248184204101562 time for calcul the mask position with numpy : 0.0062177181243896484 nb_pixel_total : 7882 time to create 1 rle with old method : 0.009052038192749023 create new chi : 0.22171282768249512 time to delete rle : 0.00032520294189453125 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1910 TO DO : save crop sub photo not yet done ! save time : 0.1528177261352539 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03191351890563965 time for calcul the mask position with numpy : 0.018703222274780273 nb_pixel_total : 2068480 time to create 1 rle with new method : 0.02854013442993164 time for calcul the mask position with numpy : 0.006127834320068359 nb_pixel_total : 5120 time to create 1 rle with old method : 0.005918264389038086 create new chi : 0.05955052375793457 time to delete rle : 0.0002155303955078125 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1384 TO DO : save crop sub photo not yet done ! save time : 0.12262940406799316 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.051763296127319336 time for calcul the mask position with numpy : 0.019639253616333008 nb_pixel_total : 2053019 time to create 1 rle with new method : 0.07219958305358887 time for calcul the mask position with numpy : 0.006456613540649414 nb_pixel_total : 3998 time to create 1 rle with old method : 0.004450559616088867 time for calcul the mask position with numpy : 0.006148338317871094 nb_pixel_total : 8160 time to create 1 rle with old method : 0.008655071258544922 time for calcul the mask position with numpy : 0.0062024593353271484 nb_pixel_total : 8423 time to create 1 rle with old method : 0.00944662094116211 create new chi : 0.1414341926574707 time to delete rle : 0.0003266334533691406 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1730 TO DO : save crop sub photo not yet done ! save time : 0.14708280563354492 No data in photo_id : 1382885733 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.058263540267944336 time for calcul the mask position with numpy : 0.015544652938842773 nb_pixel_total : 1327745 time to create 1 rle with new method : 0.1047353744506836 time for calcul the mask position with numpy : 0.016347885131835938 nb_pixel_total : 728786 time to create 1 rle with new method : 0.02786731719970703 time for calcul the mask position with numpy : 0.006112337112426758 nb_pixel_total : 10861 time to create 1 rle with old method : 0.011972904205322266 time for calcul the mask position with numpy : 0.005959987640380859 nb_pixel_total : 6208 time to create 1 rle with old method : 0.006909370422363281 create new chi : 0.19599318504333496 time to delete rle : 0.0005092620849609375 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3478 TO DO : save crop sub photo not yet done ! save time : 0.25211381912231445 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04498553276062012 time for calcul the mask position with numpy : 0.0208284854888916 nb_pixel_total : 2031150 time to create 1 rle with new method : 0.03268718719482422 time for calcul the mask position with numpy : 0.006549835205078125 nb_pixel_total : 1814 time to create 1 rle with old method : 0.0021734237670898438 time for calcul the mask position with numpy : 0.006849527359008789 nb_pixel_total : 40636 time to create 1 rle with old method : 0.04635000228881836 create new chi : 0.11582541465759277 time to delete rle : 0.0002875328063964844 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1568 TO DO : save crop sub photo not yet done ! save time : 0.13996624946594238 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04070234298706055 time for calcul the mask position with numpy : 0.020038366317749023 nb_pixel_total : 2060790 time to create 1 rle with new method : 0.059580087661743164 time for calcul the mask position with numpy : 0.006464719772338867 nb_pixel_total : 7866 time to create 1 rle with old method : 0.009151935577392578 time for calcul the mask position with numpy : 0.006384849548339844 nb_pixel_total : 4944 time to create 1 rle with old method : 0.005715370178222656 create new chi : 0.1140432357788086 time to delete rle : 0.0004322528839111328 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1646 TO DO : save crop sub photo not yet done ! save time : 0.1317753791809082 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.04679703712463379 time for calcul the mask position with numpy : 0.08818578720092773 nb_pixel_total : 2040524 time to create 1 rle with new method : 0.19674253463745117 time for calcul the mask position with numpy : 0.006651878356933594 nb_pixel_total : 16595 time to create 1 rle with old method : 0.020711898803710938 time for calcul the mask position with numpy : 0.0066661834716796875 nb_pixel_total : 8146 time to create 1 rle with old method : 0.009648561477661133 time for calcul the mask position with numpy : 0.007074832916259766 nb_pixel_total : 8335 time to create 1 rle with old method : 0.009581804275512695 create new chi : 0.3563718795776367 time to delete rle : 0.00044798851013183594 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1888 TO DO : save crop sub photo not yet done ! save time : 0.15659689903259277 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.044988393783569336 time for calcul the mask position with numpy : 0.021274805068969727 nb_pixel_total : 2065201 time to create 1 rle with new method : 0.09701991081237793 time for calcul the mask position with numpy : 0.006531715393066406 nb_pixel_total : 5704 time to create 1 rle with old method : 0.0065517425537109375 time for calcul the mask position with numpy : 0.0063037872314453125 nb_pixel_total : 2695 time to create 1 rle with old method : 0.0031104087829589844 create new chi : 0.14899158477783203 time to delete rle : 0.0002665519714355469 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1416 TO DO : save crop sub photo not yet done ! save time : 0.1257021427154541 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05041646957397461 time for calcul the mask position with numpy : 0.10963225364685059 nb_pixel_total : 2039962 time to create 1 rle with new method : 0.15211725234985352 time for calcul the mask position with numpy : 0.007451534271240234 nb_pixel_total : 8226 time to create 1 rle with old method : 0.009141683578491211 time for calcul the mask position with numpy : 0.006207942962646484 nb_pixel_total : 16568 time to create 1 rle with old method : 0.018649816513061523 time for calcul the mask position with numpy : 0.006333112716674805 nb_pixel_total : 8844 time to create 1 rle with old method : 0.009625434875488281 create new chi : 0.3275115489959717 time to delete rle : 0.0003275871276855469 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 1796 TO DO : save crop sub photo not yet done ! save time : 0.15781140327453613 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.040122032165527344 time for calcul the mask position with numpy : 0.020374774932861328 nb_pixel_total : 2051758 time to create 1 rle with new method : 0.08599567413330078 time for calcul the mask position with numpy : 0.006188154220581055 nb_pixel_total : 7300 time to create 1 rle with old method : 0.012540817260742188 time for calcul the mask position with numpy : 0.006127595901489258 nb_pixel_total : 14542 time to create 1 rle with old method : 0.015806198120117188 create new chi : 0.15386390686035156 time to delete rle : 0.00029850006103515625 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1536 TO DO : save crop sub photo not yet done ! save time : 0.13621234893798828 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.09341931343078613 time for calcul the mask position with numpy : 0.06717228889465332 nb_pixel_total : 2040182 time to create 1 rle with new method : 0.10785508155822754 time for calcul the mask position with numpy : 0.006392717361450195 nb_pixel_total : 17870 time to create 1 rle with old method : 0.019578218460083008 time for calcul the mask position with numpy : 0.00584101676940918 nb_pixel_total : 7311 time to create 1 rle with old method : 0.008066177368164062 time for calcul the mask position with numpy : 0.00590062141418457 nb_pixel_total : 8237 time to create 1 rle with old method : 0.00896763801574707 create new chi : 0.23911547660827637 time to delete rle : 0.0003199577331542969 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1852 TO DO : save crop sub photo not yet done ! save time : 0.15857410430908203 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.05031847953796387 time for calcul the mask position with numpy : 0.0197293758392334 nb_pixel_total : 2064702 time to create 1 rle with new method : 0.1479201316833496 time for calcul the mask position with numpy : 0.006072998046875 nb_pixel_total : 8898 time to create 1 rle with old method : 0.009952306747436523 create new chi : 0.18402099609375 time to delete rle : 0.0003247261047363281 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1332 TO DO : save crop sub photo not yet done ! save time : 0.1187734603881836 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.05100703239440918 time for calcul the mask position with numpy : 0.020296096801757812 nb_pixel_total : 2055063 time to create 1 rle with new method : 0.03277897834777832 time for calcul the mask position with numpy : 0.008414268493652344 nb_pixel_total : 18537 time to create 1 rle with old method : 0.02282261848449707 create new chi : 0.08464264869689941 time to delete rle : 0.00030040740966796875 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1574 TO DO : save crop sub photo not yet done ! save time : 0.15105366706848145 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.05616021156311035 time for calcul the mask position with numpy : 0.020574092864990234 nb_pixel_total : 2056982 time to create 1 rle with new method : 0.18346261978149414 time for calcul the mask position with numpy : 0.010518789291381836 nb_pixel_total : 3173 time to create 1 rle with old method : 0.0036220550537109375 time for calcul the mask position with numpy : 0.010339975357055664 nb_pixel_total : 4866 time to create 1 rle with old method : 0.005560636520385742 time for calcul the mask position with numpy : 0.010473251342773438 nb_pixel_total : 8579 time to create 1 rle with old method : 0.009649515151977539 create new chi : 0.26145243644714355 time to delete rle : 0.0003712177276611328 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1750 TO DO : save crop sub photo not yet done ! save time : 0.1439814567565918 No data in photo_id : 1382885681 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.06852173805236816 time for calcul the mask position with numpy : 0.02062392234802246 nb_pixel_total : 2069795 time to create 1 rle with new method : 0.07580900192260742 time for calcul the mask position with numpy : 0.0061228275299072266 nb_pixel_total : 3805 time to create 1 rle with old method : 0.0043370723724365234 create new chi : 0.10713720321655273 time to delete rle : 0.00024175643920898438 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1178 TO DO : save crop sub photo not yet done ! save time : 0.12446022033691406 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.053201913833618164 time for calcul the mask position with numpy : 0.020290136337280273 nb_pixel_total : 2029893 time to create 1 rle with new method : 0.11424088478088379 time for calcul the mask position with numpy : 0.006231069564819336 nb_pixel_total : 26717 time to create 1 rle with old method : 0.029647111892700195 time for calcul the mask position with numpy : 0.005995988845825195 nb_pixel_total : 8170 time to create 1 rle with old method : 0.00915837287902832 time for calcul the mask position with numpy : 0.006423473358154297 nb_pixel_total : 8820 time to create 1 rle with old method : 0.01009511947631836 create new chi : 0.21012043952941895 time to delete rle : 0.0003895759582519531 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2166 TO DO : save crop sub photo not yet done ! save time : 0.1771986484527588 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.15114259719848633 time for calcul the mask position with numpy : 0.04024171829223633 nb_pixel_total : 1222679 time to create 1 rle with new method : 0.08232712745666504 time for calcul the mask position with numpy : 0.010809659957885742 nb_pixel_total : 30827 time to create 1 rle with old method : 0.03386640548706055 time for calcul the mask position with numpy : 0.017559051513671875 nb_pixel_total : 713971 time to create 1 rle with new method : 0.0910794734954834 time for calcul the mask position with numpy : 0.007398128509521484 nb_pixel_total : 85572 time to create 1 rle with old method : 0.09701180458068848 time for calcul the mask position with numpy : 0.0061643123626708984 nb_pixel_total : 5965 time to create 1 rle with old method : 0.006579399108886719 time for calcul the mask position with numpy : 0.0063173770904541016 nb_pixel_total : 6465 time to create 1 rle with old method : 0.0072329044342041016 time for calcul the mask position with numpy : 0.007200956344604492 nb_pixel_total : 8121 time to create 1 rle with old method : 0.009216547012329102 create new chi : 0.43161797523498535 time to delete rle : 0.0008122920989990234 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 4290 TO DO : save crop sub photo not yet done ! save time : 0.3178238868713379 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.06536483764648438 time for calcul the mask position with numpy : 0.020212411880493164 nb_pixel_total : 2055481 time to create 1 rle with new method : 0.08052492141723633 time for calcul the mask position with numpy : 0.00651097297668457 nb_pixel_total : 9715 time to create 1 rle with old method : 0.010913372039794922 time for calcul the mask position with numpy : 0.0061876773834228516 nb_pixel_total : 8404 time to create 1 rle with old method : 0.010051727294921875 create new chi : 0.14087915420532227 time to delete rle : 0.00028705596923828125 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1618 TO DO : save crop sub photo not yet done ! save time : 0.14198040962219238 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.043349504470825195 time for calcul the mask position with numpy : 0.018957853317260742 nb_pixel_total : 2036070 time to create 1 rle with new method : 0.13004326820373535 time for calcul the mask position with numpy : 0.008466482162475586 nb_pixel_total : 28457 time to create 1 rle with old method : 0.03097248077392578 time for calcul the mask position with numpy : 0.0060918331146240234 nb_pixel_total : 9073 time to create 1 rle with old method : 0.009869813919067383 create new chi : 0.21366238594055176 time to delete rle : 0.0003001689910888672 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1684 TO DO : save crop sub photo not yet done ! save time : 0.14665937423706055 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.043135643005371094 time for calcul the mask position with numpy : 0.019286155700683594 nb_pixel_total : 2056176 time to create 1 rle with new method : 0.08553457260131836 time for calcul the mask position with numpy : 0.0059185028076171875 nb_pixel_total : 8660 time to create 1 rle with old method : 0.00970458984375 time for calcul the mask position with numpy : 0.005838155746459961 nb_pixel_total : 8764 time to create 1 rle with old method : 0.009521961212158203 create new chi : 0.13614869117736816 time to delete rle : 0.0002970695495605469 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1682 TO DO : save crop sub photo not yet done ! save time : 0.14861321449279785 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.10799384117126465 time for calcul the mask position with numpy : 0.01714611053466797 nb_pixel_total : 1543515 time to create 1 rle with new method : 0.08235335350036621 time for calcul the mask position with numpy : 0.006365537643432617 nb_pixel_total : 9075 time to create 1 rle with old method : 0.009917736053466797 time for calcul the mask position with numpy : 0.006457090377807617 nb_pixel_total : 17641 time to create 1 rle with old method : 0.019083261489868164 time for calcul the mask position with numpy : 0.010825872421264648 nb_pixel_total : 478499 time to create 1 rle with new method : 0.0862891674041748 time for calcul the mask position with numpy : 0.007631778717041016 nb_pixel_total : 24870 time to create 1 rle with old method : 0.027681350708007812 create new chi : 0.2831227779388428 time to delete rle : 0.0008921623229980469 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 5186 TO DO : save crop sub photo not yet done ! save time : 0.3349936008453369 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03217768669128418 time for calcul the mask position with numpy : 0.018645763397216797 nb_pixel_total : 2062789 time to create 1 rle with new method : 0.02740764617919922 time for calcul the mask position with numpy : 0.0060291290283203125 nb_pixel_total : 10811 time to create 1 rle with old method : 0.012000322341918945 create new chi : 0.07003235816955566 time to delete rle : 0.0002224445343017578 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1312 TO DO : save crop sub photo not yet done ! save time : 0.11663460731506348 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03295588493347168 time for calcul the mask position with numpy : 0.020494937896728516 nb_pixel_total : 2065469 time to create 1 rle with new method : 0.1146852970123291 time for calcul the mask position with numpy : 0.006082773208618164 nb_pixel_total : 8131 time to create 1 rle with old method : 0.009035110473632812 create new chi : 0.15054559707641602 time to delete rle : 0.0002522468566894531 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1382 TO DO : save crop sub photo not yet done ! save time : 0.1197361946105957 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04972553253173828 time for calcul the mask position with numpy : 0.02397632598876953 nb_pixel_total : 2051974 time to create 1 rle with new method : 0.08364534378051758 time for calcul the mask position with numpy : 0.006129741668701172 nb_pixel_total : 6356 time to create 1 rle with old method : 0.007176399230957031 time for calcul the mask position with numpy : 0.006120443344116211 nb_pixel_total : 8317 time to create 1 rle with old method : 0.009250164031982422 time for calcul the mask position with numpy : 0.006632328033447266 nb_pixel_total : 6953 time to create 1 rle with old method : 0.00787496566772461 create new chi : 0.15958189964294434 time to delete rle : 0.00033473968505859375 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1874 TO DO : save crop sub photo not yet done ! save time : 0.15728020668029785 map_output_result : {1382886044: (0.0, 'Should be the crop_list due to order', 0.0), 1382886042: (0.0, 'Should be the crop_list due to order', 0), 1382886039: (0.0, 'Should be the crop_list due to order', 0), 1382886035: (0.0, 'Should be the crop_list due to order', 0), 1382886031: (0.0, 'Should be the crop_list due to order', 0), 1382886020: (0.0, 'Should be the crop_list due to order', 0.0), 1382885965: (0.0, 'Should be the crop_list due to order', 0), 1382885964: (0.0, 'Should be the crop_list due to order', 0), 1382885954: (0.0, 'Should be the crop_list due to order', 0), 1382885952: (0.0, 'Should be the crop_list due to order', 0), 1382885896: (0.0, 'Should be the crop_list due to order', 0), 1382885894: (0.0, 'Should be the crop_list due to order', 0), 1382885891: (0.0, 'Should be the crop_list due to order', 0.0), 1382885888: (0.0, 'Should be the crop_list due to order', 0), 1382885879: (0.0, 'Should be the crop_list due to order', 0), 1382885854: (0.0, 'Should be the crop_list due to order', 0), 1382885735: (0.0, 'Should be the crop_list due to order', 0), 1382885733: (0.0, 'Should be the crop_list due to order', 0.0), 1382885731: (0.0, 'Should be the crop_list due to order', 0), 1382885729: (0.0, 'Should be the crop_list due to order', 0), 1382885727: (0.0, 'Should be the crop_list due to order', 0), 1382885707: (0.0, 'Should be the crop_list due to order', 0), 1382885706: (0.0, 'Should be the crop_list due to order', 0), 1382885705: (0.0, 'Should be the crop_list due to order', 0), 1382885704: (0.0, 'Should be the crop_list due to order', 0), 1382885702: (0.0, 'Should be the crop_list due to order', 0), 1382885687: (0.0, 'Should be the crop_list due to order', 0), 1382885685: (0.0, 'Should be the crop_list due to order', 0), 1382885683: (0.0, 'Should be the crop_list due to order', 0), 1382885681: (0.0, 'Should be the crop_list due to order', 0.0), 1382885674: (0.0, 'Should be the crop_list due to order', 0), 1382885651: (0.0, 'Should be the crop_list due to order', 0), 1382885623: (0.0, 'Should be the crop_list due to order', 0), 1382885621: (0.0, 'Should be the crop_list due to order', 0), 1382885618: (0.0, 'Should be the crop_list due to order', 0), 1382885615: (0.0, 'Should be the crop_list due to order', 0), 1382885613: (0.0, 'Should be the crop_list due to order', 0), 1382885599: (0.0, 'Should be the crop_list due to order', 0), 1382885597: (0.0, 'Should be the crop_list due to order', 0), 1382885595: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1382886044, 1382886042, 1382886039, 1382886035, 1382886031, 1382886020, 1382885965, 1382885964, 1382885954, 1382885952, 1382885896, 1382885894, 1382885891, 1382885888, 1382885879, 1382885854, 1382885735, 1382885733, 1382885731, 1382885729, 1382885727, 1382885707, 1382885706, 1382885705, 1382885704, 1382885702, 1382885687, 1382885685, 1382885683, 1382885681, 1382885674, 1382885651, 1382885623, 1382885621, 1382885618, 1382885615, 1382885613, 1382885599, 1382885597, 1382885595] Looping around the photos to save general results len do output : 40 /1382886044.Didn't retrieve data . /1382886042.Didn't retrieve data . /1382886039.Didn't retrieve data . /1382886035.Didn't retrieve data . /1382886031.Didn't retrieve data . /1382886020.Didn't retrieve data . /1382885965.Didn't retrieve data . /1382885964.Didn't retrieve data . /1382885954.Didn't retrieve data . /1382885952.Didn't retrieve data . /1382885896.Didn't retrieve data . /1382885894.Didn't retrieve data . /1382885891.Didn't retrieve data . /1382885888.Didn't retrieve data . /1382885879.Didn't retrieve data . /1382885854.Didn't retrieve data . /1382885735.Didn't retrieve data . /1382885733.Didn't retrieve data . /1382885731.Didn't retrieve data . /1382885729.Didn't retrieve data . /1382885727.Didn't retrieve data . /1382885707.Didn't retrieve data . /1382885706.Didn't retrieve data . /1382885705.Didn't retrieve data . /1382885704.Didn't retrieve data . /1382885702.Didn't retrieve data . /1382885687.Didn't retrieve data . /1382885685.Didn't retrieve data . /1382885683.Didn't retrieve data . /1382885681.Didn't retrieve data . /1382885674.Didn't retrieve data . /1382885651.Didn't retrieve data . /1382885623.Didn't retrieve data . /1382885621.Didn't retrieve data . /1382885618.Didn't retrieve data . /1382885615.Didn't retrieve data . /1382885613.Didn't retrieve data . /1382885599.Didn't retrieve data . /1382885597.Didn't retrieve data . /1382885595.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886044', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886042', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886039', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886035', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886031', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886020', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885965', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885964', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885954', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885952', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885896', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885894', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885891', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885888', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885879', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885854', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885735', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885733', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885731', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885729', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885727', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885707', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885706', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885705', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885704', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885702', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885687', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885685', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885683', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885681', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885674', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885651', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885623', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885621', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885618', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885615', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885613', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885599', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885597', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885595', None, None, None, None, None, '3689059') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 120 time used for this insertion : 0.021642208099365234 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.556949853897095 time spend to save output : 0.023454666137695312 total time spend for step 3 : 16.58040452003479 step4:ventilate_hashtags_in_portfolio Wed Sep 10 19:22:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26713963 get user id for portfolio 26713963 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26713963 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','pehd','background','carton','mal_croppe','environnement','pet_fonce','papier','metal','flou','autre')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26713963 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','pehd','background','carton','mal_croppe','environnement','pet_fonce','papier','metal','flou','autre')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26713963 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','pehd','background','carton','mal_croppe','environnement','pet_fonce','papier','metal','flou','autre')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26726936,26726937,26726938,26726939,26726940,26726941,26726942,26726943,26726944,26726945,26726946?tags=pet_clair,pehd,background,carton,mal_croppe,environnement,pet_fonce,papier,metal,flou,autre Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1382886044, 1382886042, 1382886039, 1382886035, 1382886031, 1382886020, 1382885965, 1382885964, 1382885954, 1382885952, 1382885896, 1382885894, 1382885891, 1382885888, 1382885879, 1382885854, 1382885735, 1382885733, 1382885731, 1382885729, 1382885727, 1382885707, 1382885706, 1382885705, 1382885704, 1382885702, 1382885687, 1382885685, 1382885683, 1382885681, 1382885674, 1382885651, 1382885623, 1382885621, 1382885618, 1382885615, 1382885613, 1382885599, 1382885597, 1382885595] Looping around the photos to save general results len do output : 1 /26713963. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886044', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886042', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886039', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886035', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886031', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886020', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885965', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885964', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885954', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885952', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885896', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885894', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885891', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885888', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885879', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885854', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885735', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885733', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885731', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885729', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885727', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885707', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885706', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885705', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885704', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885702', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885687', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885685', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885683', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885681', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885674', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885651', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885623', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885621', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885618', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885615', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885613', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885599', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885597', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885595', None, None, None, None, None, '3689059') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 41 time used for this insertion : 0.017301321029663086 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.8056824207305908 time spend to save output : 0.017968177795410156 total time spend for step 4 : 1.823650598526001 step5:final Wed Sep 10 19:22:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1382886044: ('0.050007933063271615',), 1382886042: ('0.050007933063271615',), 1382886039: ('0.050007933063271615',), 1382886035: ('0.050007933063271615',), 1382886031: ('0.050007933063271615',), 1382886020: ('0.050007933063271615',), 1382885965: ('0.050007933063271615',), 1382885964: ('0.050007933063271615',), 1382885954: ('0.050007933063271615',), 1382885952: ('0.050007933063271615',), 1382885896: ('0.050007933063271615',), 1382885894: ('0.050007933063271615',), 1382885891: ('0.050007933063271615',), 1382885888: ('0.050007933063271615',), 1382885879: ('0.050007933063271615',), 1382885854: ('0.050007933063271615',), 1382885735: ('0.050007933063271615',), 1382885733: ('0.050007933063271615',), 1382885731: ('0.050007933063271615',), 1382885729: ('0.050007933063271615',), 1382885727: ('0.050007933063271615',), 1382885707: ('0.050007933063271615',), 1382885706: ('0.050007933063271615',), 1382885705: ('0.050007933063271615',), 1382885704: ('0.050007933063271615',), 1382885702: ('0.050007933063271615',), 1382885687: ('0.050007933063271615',), 1382885685: ('0.050007933063271615',), 1382885683: ('0.050007933063271615',), 1382885681: ('0.050007933063271615',), 1382885674: ('0.050007933063271615',), 1382885651: ('0.050007933063271615',), 1382885623: ('0.050007933063271615',), 1382885621: ('0.050007933063271615',), 1382885618: ('0.050007933063271615',), 1382885615: ('0.050007933063271615',), 1382885613: ('0.050007933063271615',), 1382885599: ('0.050007933063271615',), 1382885597: ('0.050007933063271615',), 1382885595: ('0.050007933063271615',)} new output for save of step final : {1382886044: ('0.050007933063271615',), 1382886042: ('0.050007933063271615',), 1382886039: ('0.050007933063271615',), 1382886035: ('0.050007933063271615',), 1382886031: ('0.050007933063271615',), 1382886020: ('0.050007933063271615',), 1382885965: ('0.050007933063271615',), 1382885964: ('0.050007933063271615',), 1382885954: ('0.050007933063271615',), 1382885952: ('0.050007933063271615',), 1382885896: ('0.050007933063271615',), 1382885894: ('0.050007933063271615',), 1382885891: ('0.050007933063271615',), 1382885888: ('0.050007933063271615',), 1382885879: ('0.050007933063271615',), 1382885854: ('0.050007933063271615',), 1382885735: ('0.050007933063271615',), 1382885733: ('0.050007933063271615',), 1382885731: ('0.050007933063271615',), 1382885729: ('0.050007933063271615',), 1382885727: ('0.050007933063271615',), 1382885707: ('0.050007933063271615',), 1382885706: ('0.050007933063271615',), 1382885705: ('0.050007933063271615',), 1382885704: ('0.050007933063271615',), 1382885702: ('0.050007933063271615',), 1382885687: ('0.050007933063271615',), 1382885685: ('0.050007933063271615',), 1382885683: ('0.050007933063271615',), 1382885681: ('0.050007933063271615',), 1382885674: ('0.050007933063271615',), 1382885651: ('0.050007933063271615',), 1382885623: ('0.050007933063271615',), 1382885621: ('0.050007933063271615',), 1382885618: ('0.050007933063271615',), 1382885615: ('0.050007933063271615',), 1382885613: ('0.050007933063271615',), 1382885599: ('0.050007933063271615',), 1382885597: ('0.050007933063271615',), 1382885595: ('0.050007933063271615',)} [1382886044, 1382886042, 1382886039, 1382886035, 1382886031, 1382886020, 1382885965, 1382885964, 1382885954, 1382885952, 1382885896, 1382885894, 1382885891, 1382885888, 1382885879, 1382885854, 1382885735, 1382885733, 1382885731, 1382885729, 1382885727, 1382885707, 1382885706, 1382885705, 1382885704, 1382885702, 1382885687, 1382885685, 1382885683, 1382885681, 1382885674, 1382885651, 1382885623, 1382885621, 1382885618, 1382885615, 1382885613, 1382885599, 1382885597, 1382885595] Looping around the photos to save general results len do output : 40 /1382886044.Didn't retrieve data . /1382886042.Didn't retrieve data . /1382886039.Didn't retrieve data . /1382886035.Didn't retrieve data . /1382886031.Didn't retrieve data . /1382886020.Didn't retrieve data . /1382885965.Didn't retrieve data . /1382885964.Didn't retrieve data . /1382885954.Didn't retrieve data . /1382885952.Didn't retrieve data . /1382885896.Didn't retrieve data . /1382885894.Didn't retrieve data . /1382885891.Didn't retrieve data . /1382885888.Didn't retrieve data . /1382885879.Didn't retrieve data . /1382885854.Didn't retrieve data . /1382885735.Didn't retrieve data . /1382885733.Didn't retrieve data . /1382885731.Didn't retrieve data . /1382885729.Didn't retrieve data . /1382885727.Didn't retrieve data . /1382885707.Didn't retrieve data . /1382885706.Didn't retrieve data . /1382885705.Didn't retrieve data . /1382885704.Didn't retrieve data . /1382885702.Didn't retrieve data . /1382885687.Didn't retrieve data . /1382885685.Didn't retrieve data . /1382885683.Didn't retrieve data . /1382885681.Didn't retrieve data . /1382885674.Didn't retrieve data . /1382885651.Didn't retrieve data . /1382885623.Didn't retrieve data . /1382885621.Didn't retrieve data . /1382885618.Didn't retrieve data . /1382885615.Didn't retrieve data . /1382885613.Didn't retrieve data . /1382885599.Didn't retrieve data . /1382885597.Didn't retrieve data . /1382885595.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886044', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886042', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886039', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886035', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886031', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886020', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885965', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885964', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885954', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885952', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885896', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885894', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885891', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885888', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885879', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885854', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885735', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885733', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885731', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885729', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885727', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885707', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885706', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885705', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885704', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885702', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885687', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885685', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885683', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885681', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885674', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885651', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885623', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885621', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885618', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885615', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885613', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885599', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885597', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885595', None, None, None, None, None, '3689059') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 120 time used for this insertion : 0.018639802932739258 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11415863037109375 time spend to save output : 0.020525217056274414 total time spend for step 5 : 0.13468384742736816 step6:blur_detection Wed Sep 10 19:22:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1757524829_3607106_1382886044_4e2cf56c3ab18b1d60694b826357a93f.jpg resize: (1080, 1920) 1382886044 -2.6094436491508572 treat image : temp/1757524829_3607106_1382886042_5c493517227736ed6655f5cb4f8bfa28.jpg resize: (1080, 1920) 1382886042 -2.323413921036249 treat image : temp/1757524829_3607106_1382886039_da2eb7bb9a855fba383a8145edb635cc.jpg resize: (1080, 1920) 1382886039 -2.4790012565357396 treat image : temp/1757524829_3607106_1382886035_03c1b201e935ccfe415181f5d450fc70.jpg resize: (1080, 1920) 1382886035 -1.6125432536802708 treat image : temp/1757524829_3607106_1382886031_b970a19b3d535a547d0764c1e651d1a3.jpg resize: (1080, 1920) 1382886031 -1.842954749206439 treat image : temp/1757524829_3607106_1382886020_e8b3d3348172a79b09156f433e107eee.jpg resize: (1080, 1920) 1382886020 -2.8080492732467084 treat image : temp/1757524829_3607106_1382885965_ff8f88e8e11e3c3cb6fc55aeb346601b.jpg resize: (1080, 1920) 1382885965 -2.4177063924984097 treat image : temp/1757524829_3607106_1382885964_fe78f64656dd5bba3a3ab5928f0fd5ec.jpg resize: (1080, 1920) 1382885964 -4.717970099643176 treat image : temp/1757524829_3607106_1382885954_b53c0ab30d8fd9fa55317dde77d6e15d.jpg resize: (1080, 1920) 1382885954 -0.8502510445253179 treat image : temp/1757524829_3607106_1382885952_63a6159ef6f20d6cb88ad67724062352.jpg resize: (1080, 1920) 1382885952 0.40288933979085173 treat image : temp/1757524829_3607106_1382885896_6d2202393c20828ed2a7f563eaeb2cf7.jpg resize: (1080, 1920) 1382885896 -4.655080563570292 treat image : temp/1757524829_3607106_1382885894_49c1550c90ec043f15db38c88046d7a9.jpg resize: (1080, 1920) 1382885894 -2.335211895305695 treat image : temp/1757524829_3607106_1382885891_5dd12e5d82da94ac03e6de9962c63a56.jpg resize: (1080, 1920) 1382885891 -2.292817580282036 treat image : temp/1757524829_3607106_1382885888_0ccc1435cc76d46fe147b903e155e983.jpg resize: (1080, 1920) 1382885888 -4.599304818450221 treat image : temp/1757524829_3607106_1382885879_0e3f33b2488a5a7d43b921d331fba6cc.jpg resize: (1080, 1920) 1382885879 -2.697660813820512 treat image : temp/1757524829_3607106_1382885854_b23913d2bb77768acb394ae55f01abc6.jpg resize: (1080, 1920) 1382885854 -1.852016378146236 treat image : temp/1757524829_3607106_1382885735_d5faf985c5c44a4469fa155c5f43a13b.jpg resize: (1080, 1920) 1382885735 -2.8414608842733355 treat image : temp/1757524829_3607106_1382885733_8554fc4e74c4ecb441c4feacca652a5b.jpg resize: (1080, 1920) 1382885733 -2.830994489206857 treat image : temp/1757524829_3607106_1382885731_33e22ccb0e23d2f2ad875dd10ae91f50.jpg resize: (1080, 1920) 1382885731 -1.3327216602282357 treat image : temp/1757524829_3607106_1382885729_36a24bdcac23874c10b9691368f04c6e.jpg resize: (1080, 1920) 1382885729 -1.5445850580064853 treat image : temp/1757524829_3607106_1382885727_1c9c56a81eeb4c9325b94da08f081c39.jpg resize: (1080, 1920) 1382885727 -2.0547206568583087 treat image : temp/1757524829_3607106_1382885707_e5317192157c552c559732c7d088af0a.jpg resize: (1080, 1920) 1382885707 -2.684424222732671 treat image : temp/1757524829_3607106_1382885706_dc762f3757275c18ccaccd43b33f5b17.jpg resize: (1080, 1920) 1382885706 -3.645773792421154 treat image : temp/1757524829_3607106_1382885705_270ad4636ce7113f947fbfe649cdfe25.jpg resize: (1080, 1920) 1382885705 -1.7279546022292178 treat image : temp/1757524829_3607106_1382885704_91bbc83116078fa2496a0b3deed45ff0.jpg resize: (1080, 1920) 1382885704 -3.008749362535972 treat image : temp/1757524829_3607106_1382885702_d91e288c12b8a3d22a0860e971c586f3.jpg resize: (1080, 1920) 1382885702 -4.091856850004319 treat image : temp/1757524829_3607106_1382885687_a808bf56398e7b5d67f998bb55e48db5.jpg resize: (1080, 1920) 1382885687 1.6094653219682111 treat image : temp/1757524829_3607106_1382885685_28f53693ec2d9464f6c33959f776e5db.jpg resize: (1080, 1920) 1382885685 -2.815243701911356 treat image : temp/1757524829_3607106_1382885683_1bc64eb7c9925878c3858d61f83adfa9.jpg resize: (1080, 1920) 1382885683 -2.7461736825149194 treat image : temp/1757524829_3607106_1382885681_2920728af2c40dcb1d39d55a0d3bcb3c.jpg resize: (1080, 1920) 1382885681 -2.107615257691845 treat image : temp/1757524829_3607106_1382885674_4456d161dc67ea6f141a79a145a7f900.jpg resize: (1080, 1920) 1382885674 -2.2669141688981873 treat image : temp/1757524829_3607106_1382885651_0b803ba84f2ca8e342e0de3c8850cfc5.jpg resize: (1080, 1920) 1382885651 -1.5582312466854757 treat image : temp/1757524829_3607106_1382885623_f0abf24b806439a2d5bdb3f2a428e505.jpg resize: (1080, 1920) 1382885623 -0.10912009358946817 treat image : temp/1757524829_3607106_1382885621_c230fd013109bc261f820f7256ce7801.jpg resize: (1080, 1920) 1382885621 -1.9755695181732216 treat image : temp/1757524829_3607106_1382885618_b78b4de7c3e16502354547abcdd443f7.jpg resize: (1080, 1920) 1382885618 -2.9549733924044936 treat image : temp/1757524829_3607106_1382885615_e0ded61d1824dad54b971f74cfe3f5db.jpg resize: (1080, 1920) 1382885615 -1.6057744465494546 treat image : temp/1757524829_3607106_1382885613_55f6742f59389dee8799f857c8dcc7ee.jpg resize: (1080, 1920) 1382885613 -2.9762865002991568 treat image : temp/1757524829_3607106_1382885599_4591ccfffbc721292545441f7940ad0d.jpg resize: (1080, 1920) 1382885599 -1.0196372178572606 treat image : temp/1757524829_3607106_1382885597_b21cf4f8d898ac225162bad02c699856.jpg resize: (1080, 1920) 1382885597 -1.1756307531806578 treat image : temp/1757524829_3607106_1382885595_0eb6baf603eb4b4109fdf63163c254c9.jpg resize: (1080, 1920) 1382885595 -2.49070643099956 treat image : temp/1757524829_3607106_1382886039_da2eb7bb9a855fba383a8145edb635cc_rle_crop_3954379965_0.png resize: (88, 162) 1383101899 -1.6348402359760852 treat image : temp/1757524829_3607106_1382886035_03c1b201e935ccfe415181f5d450fc70_rle_crop_3954379966_0.png resize: (116, 80) 1383101900 2.7153486613467717 treat image : temp/1757524829_3607106_1382886031_b970a19b3d535a547d0764c1e651d1a3_rle_crop_3954379970_0.png resize: (101, 54) 1383101901 20.0 treat image : temp/1757524829_3607106_1382885965_ff8f88e8e11e3c3cb6fc55aeb346601b_rle_crop_3954379972_0.png resize: (130, 58) 1383101902 -1.9253971771345544 treat image : temp/1757524829_3607106_1382885964_fe78f64656dd5bba3a3ab5928f0fd5ec_rle_crop_3954379974_0.png resize: (105, 84) 1383101903 -0.04737214047498199 treat image : temp/1757524829_3607106_1382885964_fe78f64656dd5bba3a3ab5928f0fd5ec_rle_crop_3954379975_0.png resize: (85, 138) 1383101904 -0.8313526052575626 treat image : temp/1757524829_3607106_1382885954_b53c0ab30d8fd9fa55317dde77d6e15d_rle_crop_3954379978_0.png resize: (129, 131) 1383101905 -0.0368790705348674 treat image : temp/1757524829_3607106_1382885954_b53c0ab30d8fd9fa55317dde77d6e15d_rle_crop_3954379981_0.png resize: (173, 103) 1383101906 -2.185830133296948 treat image : temp/1757524829_3607106_1382885896_6d2202393c20828ed2a7f563eaeb2cf7_rle_crop_3954379984_0.png resize: (119, 85) 1383101907 1.536392696727024 treat image : temp/1757524829_3607106_1382885894_49c1550c90ec043f15db38c88046d7a9_rle_crop_3954379987_0.png resize: (98, 99) 1383101909 -1.7305909160596635 treat image : temp/1757524829_3607106_1382885888_0ccc1435cc76d46fe147b903e155e983_rle_crop_3954379988_0.png resize: (121, 86) 1383101910 1.093530237013992 treat image : temp/1757524829_3607106_1382885879_0e3f33b2488a5a7d43b921d331fba6cc_rle_crop_3954379992_0.png resize: (142, 74) 1383101911 1.1736135014431617 treat image : temp/1757524829_3607106_1382885879_0e3f33b2488a5a7d43b921d331fba6cc_rle_crop_3954379993_0.png resize: (182, 115) 1383101912 -1.769275118412809 treat image : temp/1757524829_3607106_1382885854_b23913d2bb77768acb394ae55f01abc6_rle_crop_3954379994_0.png resize: (152, 71) 1383101913 -2.1557101108129517 treat image : temp/1757524829_3607106_1382885735_d5faf985c5c44a4469fa155c5f43a13b_rle_crop_3954379995_0.png resize: (121, 86) 1383101914 0.15802511583458867 treat image : temp/1757524829_3607106_1382885735_d5faf985c5c44a4469fa155c5f43a13b_rle_crop_3954379996_0.png resize: (136, 80) 1383101915 -0.863010069045497 treat image : temp/1757524829_3607106_1382885727_1c9c56a81eeb4c9325b94da08f081c39_rle_crop_3954380003_0.png resize: (163, 77) 1383101916 -2.4728777791309597 treat image : temp/1757524829_3607106_1382885707_e5317192157c552c559732c7d088af0a_rle_crop_3954380005_0.png resize: (119, 86) 1383101917 0.591383394264756 treat image : temp/1757524829_3607106_1382885706_dc762f3757275c18ccaccd43b33f5b17_rle_crop_3954380009_0.png resize: (107, 82) 1383101918 -1.3071489372194598 treat image : temp/1757524829_3607106_1382885702_d91e288c12b8a3d22a0860e971c586f3_rle_crop_3954380015_0.png resize: (120, 84) 1383101919 1.028547474000199 treat image : temp/1757524829_3607106_1382885687_a808bf56398e7b5d67f998bb55e48db5_rle_crop_3954380018_0.png resize: (126, 103) 1383101920 -1.4804602440358834 treat image : temp/1757524829_3607106_1382885683_1bc64eb7c9925878c3858d61f83adfa9_rle_crop_3954380020_0.png resize: (169, 126) 1383101921 -2.7275059640722183 treat image : temp/1757524829_3607106_1382885683_1bc64eb7c9925878c3858d61f83adfa9_rle_crop_3954380021_0.png resize: (87, 80) 1383101922 -1.0951579534850069 treat image : temp/1757524829_3607106_1382885683_1bc64eb7c9925878c3858d61f83adfa9_rle_crop_3954380022_0.png resize: (74, 79) 1383101923 -1.9286512531410562 treat image : temp/1757524829_3607106_1382885651_0b803ba84f2ca8e342e0de3c8850cfc5_rle_crop_3954380024_0.png resize: (181, 92) 1383101925 -2.4715917173678372 treat image : temp/1757524829_3607106_1382885651_0b803ba84f2ca8e342e0de3c8850cfc5_rle_crop_3954380025_0.png resize: (120, 84) 1383101926 0.503828391095882 treat image : temp/1757524829_3607106_1382885623_f0abf24b806439a2d5bdb3f2a428e505_rle_crop_3954380027_0.png resize: (120, 96) 1383101927 -1.2432158798300346 treat image : temp/1757524829_3607106_1382885621_c230fd013109bc261f820f7256ce7801_rle_crop_3954380033_0.png resize: (130, 94) 1383101928 -1.4879368669639563 treat image : temp/1757524829_3607106_1382885615_e0ded61d1824dad54b971f74cfe3f5db_rle_crop_3954380037_0.png resize: (128, 101) 1383101929 -1.4997822739907716 treat image : temp/1757524829_3607106_1382885615_e0ded61d1824dad54b971f74cfe3f5db_rle_crop_3954380038_0.png resize: (173, 102) 1383101930 -1.8933311747419157 treat image : temp/1757524829_3607106_1382885613_55f6742f59389dee8799f857c8dcc7ee_rle_crop_3954380042_0.png resize: (127, 106) 1383101931 -1.6522899328560137 treat image : temp/1757524829_3607106_1382885597_b21cf4f8d898ac225162bad02c699856_rle_crop_3954380044_0.png resize: (151, 100) 1383101932 -1.1898661762051748 treat image : temp/1757524829_3607106_1382885595_0eb6baf603eb4b4109fdf63163c254c9_rle_crop_3954380046_0.png resize: (176, 77) 1383101933 -2.6048899241773174 treat image : temp/1757524829_3607106_1382885595_0eb6baf603eb4b4109fdf63163c254c9_rle_crop_3954380047_0.png resize: (116, 132) 1383101934 -1.6827144732777854 treat image : temp/1757524829_3607106_1382886031_b970a19b3d535a547d0764c1e651d1a3_rle_crop_3954379971_0.png resize: (900, 932) 1383101938 -0.2558370869290955 treat image : temp/1757524829_3607106_1382885964_fe78f64656dd5bba3a3ab5928f0fd5ec_rle_crop_3954379977_0.png resize: (162, 104) 1383101939 0.8176314277371447 treat image : temp/1757524829_3607106_1382885888_0ccc1435cc76d46fe147b903e155e983_rle_crop_3954379989_0.png resize: (47, 81) 1383101940 -1.2792024304018303 treat image : temp/1757524829_3607106_1382885735_d5faf985c5c44a4469fa155c5f43a13b_rle_crop_3954379997_0.png resize: (68, 116) 1383101941 -2.413277321459344 treat image : temp/1757524829_3607106_1382885727_1c9c56a81eeb4c9325b94da08f081c39_rle_crop_3954380004_0.png resize: (120, 76) 1383101942 2.4892903237262978 treat image : temp/1757524829_3607106_1382885707_e5317192157c552c559732c7d088af0a_rle_crop_3954380006_0.png resize: (115, 105) 1383101943 -1.595387740111382 treat image : temp/1757524829_3607106_1382885705_270ad4636ce7113f947fbfe649cdfe25_rle_crop_3954380010_0.png resize: (108, 127) 1383101944 -2.414453036390411 treat image : temp/1757524829_3607106_1382885705_270ad4636ce7113f947fbfe649cdfe25_rle_crop_3954380012_0.png resize: (120, 84) 1383101945 1.1752465417941678 treat image : temp/1757524829_3607106_1382885704_91bbc83116078fa2496a0b3deed45ff0_rle_crop_3954380014_0.png resize: (92, 123) 1383101946 -1.6658104730687862 treat image : temp/1757524829_3607106_1382885702_d91e288c12b8a3d22a0860e971c586f3_rle_crop_3954380016_0.png resize: (91, 119) 1383101947 -1.64616402727157 treat image : temp/1757524829_3607106_1382885702_d91e288c12b8a3d22a0860e971c586f3_rle_crop_3954380017_0.png resize: (166, 147) 1383101948 -1.0164530005942818 treat image : temp/1757524829_3607106_1382885618_b78b4de7c3e16502354547abcdd443f7_rle_crop_3954380035_0.png resize: (130, 101) 1383101949 -1.4092004150881938 treat image : temp/1757524829_3607106_1382885613_55f6742f59389dee8799f857c8dcc7ee_rle_crop_3954380040_0.png resize: (969, 866) 1383101950 -0.9667691102095913 treat image : temp/1757524829_3607106_1382885599_4591ccfffbc721292545441f7940ad0d_rle_crop_3954380043_0.png resize: (116, 144) 1383101951 -1.8727040466738543 treat image : temp/1757524829_3607106_1382885595_0eb6baf603eb4b4109fdf63163c254c9_rle_crop_3954380045_0.png resize: (102, 105) 1383101952 -1.5663911126940027 treat image : temp/1757524829_3607106_1382886035_03c1b201e935ccfe415181f5d450fc70_rle_crop_3954379968_0.png resize: (43, 117) 1383101954 -1.0144709802849563 treat image : temp/1757524829_3607106_1382886042_5c493517227736ed6655f5cb4f8bfa28_rle_crop_3954379963_0.png resize: (518, 364) 1383101965 0.1740942175338853 treat image : temp/1757524829_3607106_1382886039_da2eb7bb9a855fba383a8145edb635cc_rle_crop_3954379964_0.png resize: (132, 214) 1383101966 -0.9034395126836463 treat image : temp/1757524829_3607106_1382886035_03c1b201e935ccfe415181f5d450fc70_rle_crop_3954379967_0.png resize: (193, 207) 1383101967 -3.1589628029806716 treat image : temp/1757524829_3607106_1382885965_ff8f88e8e11e3c3cb6fc55aeb346601b_rle_crop_3954379973_0.png resize: (546, 318) 1383101968 -0.006960902494864211 treat image : temp/1757524829_3607106_1382885964_fe78f64656dd5bba3a3ab5928f0fd5ec_rle_crop_3954379976_0.png resize: (551, 1054) 1383101969 -6.274622289039268 treat image : temp/1757524829_3607106_1382885954_b53c0ab30d8fd9fa55317dde77d6e15d_rle_crop_3954379979_0.png resize: (144, 166) 1383101970 -3.282569264082601 treat image : temp/1757524829_3607106_1382885954_b53c0ab30d8fd9fa55317dde77d6e15d_rle_crop_3954379980_0.png resize: (513, 312) 1383101971 0.529233694276498 treat image : temp/1757524829_3607106_1382885954_b53c0ab30d8fd9fa55317dde77d6e15d_rle_crop_3954379982_0.png resize: (144, 179) 1383101972 -4.051246790456986 treat image : temp/1757524829_3607106_1382885952_63a6159ef6f20d6cb88ad67724062352_rle_crop_3954379983_0.png resize: (186, 242) 1383101973 -1.5411835632029292 treat image : temp/1757524829_3607106_1382885896_6d2202393c20828ed2a7f563eaeb2cf7_rle_crop_3954379985_0.png resize: (59, 127) 1383101974 -4.564724928898028 treat image : temp/1757524829_3607106_1382885896_6d2202393c20828ed2a7f563eaeb2cf7_rle_crop_3954379986_0.png resize: (182, 189) 1383101975 -4.382392684882545 treat image : temp/1757524829_3607106_1382885879_0e3f33b2488a5a7d43b921d331fba6cc_rle_crop_3954379991_0.png resize: (90, 105) 1383101977 -2.1758292805667114 treat image : temp/1757524829_3607106_1382885731_33e22ccb0e23d2f2ad875dd10ae91f50_rle_crop_3954379998_0.png resize: (126, 68) 1383101978 -2.270470270138996 treat image : temp/1757524829_3607106_1382885731_33e22ccb0e23d2f2ad875dd10ae91f50_rle_crop_3954379999_0.png resize: (117, 126) 1383101979 -2.8526715351566367 treat image : temp/1757524829_3607106_1382885731_33e22ccb0e23d2f2ad875dd10ae91f50_rle_crop_3954380000_0.png resize: (962, 971) 1383101980 0.48807788597267954 treat image : temp/1757524829_3607106_1382885729_36a24bdcac23874c10b9691368f04c6e_rle_crop_3954380001_0.png resize: (167, 310) 1383101981 -3.620237228944651 treat image : temp/1757524829_3607106_1382885729_36a24bdcac23874c10b9691368f04c6e_rle_crop_3954380002_0.png resize: (45, 53) 1383101982 -0.5533319705893236 treat image : temp/1757524829_3607106_1382885707_e5317192157c552c559732c7d088af0a_rle_crop_3954380007_0.png resize: (153, 148) 1383101983 -3.1844868620742206 treat image : temp/1757524829_3607106_1382885706_dc762f3757275c18ccaccd43b33f5b17_rle_crop_3954380008_0.png resize: (59, 68) 1383101984 -1.2890938636045852 treat image : temp/1757524829_3607106_1382885705_270ad4636ce7113f947fbfe649cdfe25_rle_crop_3954380011_0.png resize: (104, 191) 1383101985 -3.6014154279168764 treat image : temp/1757524829_3607106_1382885704_91bbc83116078fa2496a0b3deed45ff0_rle_crop_3954380013_0.png resize: (130, 140) 1383101986 -2.942944637957433 treat image : temp/1757524829_3607106_1382885685_28f53693ec2d9464f6c33959f776e5db_rle_crop_3954380019_0.png resize: (220, 123) 1383101987 -4.055738529967715 treat image : temp/1757524829_3607106_1382885674_4456d161dc67ea6f141a79a145a7f900_rle_crop_3954380023_0.png resize: (45, 102) 1383101988 -2.674288755341001 treat image : temp/1757524829_3607106_1382885651_0b803ba84f2ca8e342e0de3c8850cfc5_rle_crop_3954380026_0.png resize: (233, 153) 1383101989 -0.7794198513494723 treat image : temp/1757524829_3607106_1382885623_f0abf24b806439a2d5bdb3f2a428e505_rle_crop_3954380028_0.png resize: (122, 67) 1383101990 -0.7518148621716326 treat image : temp/1757524829_3607106_1382885623_f0abf24b806439a2d5bdb3f2a428e505_rle_crop_3954380029_0.png resize: (124, 70) 1383101991 -3.6958884806587 treat image : temp/1757524829_3607106_1382885623_f0abf24b806439a2d5bdb3f2a428e505_rle_crop_3954380030_0.png resize: (247, 530) 1383101992 -2.903205506229455 treat image : temp/1757524829_3607106_1382885623_f0abf24b806439a2d5bdb3f2a428e505_rle_crop_3954380031_0.png resize: (891, 1048) 1383101993 0.3518008659474151 treat image : temp/1757524829_3607106_1382885623_f0abf24b806439a2d5bdb3f2a428e505_rle_crop_3954380032_0.png resize: (128, 274) 1383101994 -1.8065998061062225 treat image : temp/1757524829_3607106_1382885621_c230fd013109bc261f820f7256ce7801_rle_crop_3954380034_0.png resize: (139, 95) 1383101995 -2.0510033010322544 treat image : temp/1757524829_3607106_1382885618_b78b4de7c3e16502354547abcdd443f7_rle_crop_3954380036_0.png resize: (172, 223) 1383101996 -2.1560016266461646 treat image : temp/1757524829_3607106_1382885613_55f6742f59389dee8799f857c8dcc7ee_rle_crop_3954380039_0.png resize: (210, 168) 1383101997 -2.9664568683167296 treat image : temp/1757524829_3607106_1382885613_55f6742f59389dee8799f857c8dcc7ee_rle_crop_3954380041_0.png resize: (180, 150) 1383101998 -2.6128981989291784 treat image : temp/1757524829_3607106_1382886035_03c1b201e935ccfe415181f5d450fc70_rle_crop_3954379969_0.png resize: (220, 145) 1383102000 -1.2636474774409523 treat image : temp/1757524829_3607106_1382885888_0ccc1435cc76d46fe147b903e155e983_rle_crop_3954379990_0.png resize: (49, 47) 1383102001 -3.3796331315929584 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 125 time used for this insertion : 0.019465923309326172 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 125 time used for this insertion : 0.037290096282958984 save missing photos in datou_result : time spend for datou_step_exec : 34.79319357872009 time spend to save output : 0.06155586242675781 total time spend for step 6 : 34.85474944114685 step7:brightness Wed Sep 10 19:22:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1757524829_3607106_1382886044_4e2cf56c3ab18b1d60694b826357a93f.jpg treat image : temp/1757524829_3607106_1382886042_5c493517227736ed6655f5cb4f8bfa28.jpg treat image : temp/1757524829_3607106_1382886039_da2eb7bb9a855fba383a8145edb635cc.jpg treat image : temp/1757524829_3607106_1382886035_03c1b201e935ccfe415181f5d450fc70.jpg treat image : temp/1757524829_3607106_1382886031_b970a19b3d535a547d0764c1e651d1a3.jpg treat image : temp/1757524829_3607106_1382886020_e8b3d3348172a79b09156f433e107eee.jpg treat image : temp/1757524829_3607106_1382885965_ff8f88e8e11e3c3cb6fc55aeb346601b.jpg treat image : temp/1757524829_3607106_1382885964_fe78f64656dd5bba3a3ab5928f0fd5ec.jpg treat image : temp/1757524829_3607106_1382885954_b53c0ab30d8fd9fa55317dde77d6e15d.jpg treat image : temp/1757524829_3607106_1382885952_63a6159ef6f20d6cb88ad67724062352.jpg treat image : temp/1757524829_3607106_1382885896_6d2202393c20828ed2a7f563eaeb2cf7.jpg treat image : temp/1757524829_3607106_1382885894_49c1550c90ec043f15db38c88046d7a9.jpg treat image : temp/1757524829_3607106_1382885891_5dd12e5d82da94ac03e6de9962c63a56.jpg treat image : temp/1757524829_3607106_1382885888_0ccc1435cc76d46fe147b903e155e983.jpg treat image : temp/1757524829_3607106_1382885879_0e3f33b2488a5a7d43b921d331fba6cc.jpg treat image : temp/1757524829_3607106_1382885854_b23913d2bb77768acb394ae55f01abc6.jpg treat image : temp/1757524829_3607106_1382885735_d5faf985c5c44a4469fa155c5f43a13b.jpg treat image : temp/1757524829_3607106_1382885733_8554fc4e74c4ecb441c4feacca652a5b.jpg treat image : temp/1757524829_3607106_1382885731_33e22ccb0e23d2f2ad875dd10ae91f50.jpg treat image : temp/1757524829_3607106_1382885729_36a24bdcac23874c10b9691368f04c6e.jpg treat image : temp/1757524829_3607106_1382885727_1c9c56a81eeb4c9325b94da08f081c39.jpg treat image : temp/1757524829_3607106_1382885707_e5317192157c552c559732c7d088af0a.jpg treat image : temp/1757524829_3607106_1382885706_dc762f3757275c18ccaccd43b33f5b17.jpg treat image : temp/1757524829_3607106_1382885705_270ad4636ce7113f947fbfe649cdfe25.jpg treat image : temp/1757524829_3607106_1382885704_91bbc83116078fa2496a0b3deed45ff0.jpg treat image : temp/1757524829_3607106_1382885702_d91e288c12b8a3d22a0860e971c586f3.jpg treat image : temp/1757524829_3607106_1382885687_a808bf56398e7b5d67f998bb55e48db5.jpg treat image : temp/1757524829_3607106_1382885685_28f53693ec2d9464f6c33959f776e5db.jpg treat image : temp/1757524829_3607106_1382885683_1bc64eb7c9925878c3858d61f83adfa9.jpg treat image : temp/1757524829_3607106_1382885681_2920728af2c40dcb1d39d55a0d3bcb3c.jpg treat image : temp/1757524829_3607106_1382885674_4456d161dc67ea6f141a79a145a7f900.jpg treat image : temp/1757524829_3607106_1382885651_0b803ba84f2ca8e342e0de3c8850cfc5.jpg treat image : temp/1757524829_3607106_1382885623_f0abf24b806439a2d5bdb3f2a428e505.jpg treat image : temp/1757524829_3607106_1382885621_c230fd013109bc261f820f7256ce7801.jpg treat image : temp/1757524829_3607106_1382885618_b78b4de7c3e16502354547abcdd443f7.jpg treat image : temp/1757524829_3607106_1382885615_e0ded61d1824dad54b971f74cfe3f5db.jpg treat image : temp/1757524829_3607106_1382885613_55f6742f59389dee8799f857c8dcc7ee.jpg treat image : temp/1757524829_3607106_1382885599_4591ccfffbc721292545441f7940ad0d.jpg treat image : temp/1757524829_3607106_1382885597_b21cf4f8d898ac225162bad02c699856.jpg treat image : temp/1757524829_3607106_1382885595_0eb6baf603eb4b4109fdf63163c254c9.jpg treat image : temp/1757524829_3607106_1382886039_da2eb7bb9a855fba383a8145edb635cc_rle_crop_3954379965_0.png treat image : temp/1757524829_3607106_1382886035_03c1b201e935ccfe415181f5d450fc70_rle_crop_3954379966_0.png treat image : temp/1757524829_3607106_1382886031_b970a19b3d535a547d0764c1e651d1a3_rle_crop_3954379970_0.png treat image : temp/1757524829_3607106_1382885965_ff8f88e8e11e3c3cb6fc55aeb346601b_rle_crop_3954379972_0.png treat image : temp/1757524829_3607106_1382885964_fe78f64656dd5bba3a3ab5928f0fd5ec_rle_crop_3954379974_0.png treat image : temp/1757524829_3607106_1382885964_fe78f64656dd5bba3a3ab5928f0fd5ec_rle_crop_3954379975_0.png treat image : temp/1757524829_3607106_1382885954_b53c0ab30d8fd9fa55317dde77d6e15d_rle_crop_3954379978_0.png treat image : temp/1757524829_3607106_1382885954_b53c0ab30d8fd9fa55317dde77d6e15d_rle_crop_3954379981_0.png treat image : temp/1757524829_3607106_1382885896_6d2202393c20828ed2a7f563eaeb2cf7_rle_crop_3954379984_0.png treat image : temp/1757524829_3607106_1382885894_49c1550c90ec043f15db38c88046d7a9_rle_crop_3954379987_0.png treat image : temp/1757524829_3607106_1382885888_0ccc1435cc76d46fe147b903e155e983_rle_crop_3954379988_0.png treat image : temp/1757524829_3607106_1382885879_0e3f33b2488a5a7d43b921d331fba6cc_rle_crop_3954379992_0.png treat image : temp/1757524829_3607106_1382885879_0e3f33b2488a5a7d43b921d331fba6cc_rle_crop_3954379993_0.png treat image : temp/1757524829_3607106_1382885854_b23913d2bb77768acb394ae55f01abc6_rle_crop_3954379994_0.png treat image : temp/1757524829_3607106_1382885735_d5faf985c5c44a4469fa155c5f43a13b_rle_crop_3954379995_0.png treat image : temp/1757524829_3607106_1382885735_d5faf985c5c44a4469fa155c5f43a13b_rle_crop_3954379996_0.png treat image : temp/1757524829_3607106_1382885727_1c9c56a81eeb4c9325b94da08f081c39_rle_crop_3954380003_0.png treat image : temp/1757524829_3607106_1382885707_e5317192157c552c559732c7d088af0a_rle_crop_3954380005_0.png treat image : temp/1757524829_3607106_1382885706_dc762f3757275c18ccaccd43b33f5b17_rle_crop_3954380009_0.png treat image : temp/1757524829_3607106_1382885702_d91e288c12b8a3d22a0860e971c586f3_rle_crop_3954380015_0.png treat image : temp/1757524829_3607106_1382885687_a808bf56398e7b5d67f998bb55e48db5_rle_crop_3954380018_0.png treat image : temp/1757524829_3607106_1382885683_1bc64eb7c9925878c3858d61f83adfa9_rle_crop_3954380020_0.png treat image : temp/1757524829_3607106_1382885683_1bc64eb7c9925878c3858d61f83adfa9_rle_crop_3954380021_0.png treat image : temp/1757524829_3607106_1382885683_1bc64eb7c9925878c3858d61f83adfa9_rle_crop_3954380022_0.png treat image : temp/1757524829_3607106_1382885651_0b803ba84f2ca8e342e0de3c8850cfc5_rle_crop_3954380024_0.png treat image : temp/1757524829_3607106_1382885651_0b803ba84f2ca8e342e0de3c8850cfc5_rle_crop_3954380025_0.png treat image : temp/1757524829_3607106_1382885623_f0abf24b806439a2d5bdb3f2a428e505_rle_crop_3954380027_0.png treat image : temp/1757524829_3607106_1382885621_c230fd013109bc261f820f7256ce7801_rle_crop_3954380033_0.png treat image : temp/1757524829_3607106_1382885615_e0ded61d1824dad54b971f74cfe3f5db_rle_crop_3954380037_0.png treat image : temp/1757524829_3607106_1382885615_e0ded61d1824dad54b971f74cfe3f5db_rle_crop_3954380038_0.png treat image : temp/1757524829_3607106_1382885613_55f6742f59389dee8799f857c8dcc7ee_rle_crop_3954380042_0.png treat image : temp/1757524829_3607106_1382885597_b21cf4f8d898ac225162bad02c699856_rle_crop_3954380044_0.png treat image : temp/1757524829_3607106_1382885595_0eb6baf603eb4b4109fdf63163c254c9_rle_crop_3954380046_0.png treat image : temp/1757524829_3607106_1382885595_0eb6baf603eb4b4109fdf63163c254c9_rle_crop_3954380047_0.png treat image : temp/1757524829_3607106_1382886031_b970a19b3d535a547d0764c1e651d1a3_rle_crop_3954379971_0.png treat image : temp/1757524829_3607106_1382885964_fe78f64656dd5bba3a3ab5928f0fd5ec_rle_crop_3954379977_0.png treat image : temp/1757524829_3607106_1382885888_0ccc1435cc76d46fe147b903e155e983_rle_crop_3954379989_0.png treat image : temp/1757524829_3607106_1382885735_d5faf985c5c44a4469fa155c5f43a13b_rle_crop_3954379997_0.png treat image : temp/1757524829_3607106_1382885727_1c9c56a81eeb4c9325b94da08f081c39_rle_crop_3954380004_0.png treat image : temp/1757524829_3607106_1382885707_e5317192157c552c559732c7d088af0a_rle_crop_3954380006_0.png treat image : temp/1757524829_3607106_1382885705_270ad4636ce7113f947fbfe649cdfe25_rle_crop_3954380010_0.png treat image : temp/1757524829_3607106_1382885705_270ad4636ce7113f947fbfe649cdfe25_rle_crop_3954380012_0.png treat image : temp/1757524829_3607106_1382885704_91bbc83116078fa2496a0b3deed45ff0_rle_crop_3954380014_0.png treat image : temp/1757524829_3607106_1382885702_d91e288c12b8a3d22a0860e971c586f3_rle_crop_3954380016_0.png treat image : temp/1757524829_3607106_1382885702_d91e288c12b8a3d22a0860e971c586f3_rle_crop_3954380017_0.png treat image : temp/1757524829_3607106_1382885618_b78b4de7c3e16502354547abcdd443f7_rle_crop_3954380035_0.png treat image : temp/1757524829_3607106_1382885613_55f6742f59389dee8799f857c8dcc7ee_rle_crop_3954380040_0.png treat image : temp/1757524829_3607106_1382885599_4591ccfffbc721292545441f7940ad0d_rle_crop_3954380043_0.png treat image : temp/1757524829_3607106_1382885595_0eb6baf603eb4b4109fdf63163c254c9_rle_crop_3954380045_0.png treat image : temp/1757524829_3607106_1382886035_03c1b201e935ccfe415181f5d450fc70_rle_crop_3954379968_0.png treat image : temp/1757524829_3607106_1382886042_5c493517227736ed6655f5cb4f8bfa28_rle_crop_3954379963_0.png treat image : temp/1757524829_3607106_1382886039_da2eb7bb9a855fba383a8145edb635cc_rle_crop_3954379964_0.png treat image : temp/1757524829_3607106_1382886035_03c1b201e935ccfe415181f5d450fc70_rle_crop_3954379967_0.png treat image : temp/1757524829_3607106_1382885965_ff8f88e8e11e3c3cb6fc55aeb346601b_rle_crop_3954379973_0.png treat image : temp/1757524829_3607106_1382885964_fe78f64656dd5bba3a3ab5928f0fd5ec_rle_crop_3954379976_0.png treat image : temp/1757524829_3607106_1382885954_b53c0ab30d8fd9fa55317dde77d6e15d_rle_crop_3954379979_0.png treat image : temp/1757524829_3607106_1382885954_b53c0ab30d8fd9fa55317dde77d6e15d_rle_crop_3954379980_0.png treat image : temp/1757524829_3607106_1382885954_b53c0ab30d8fd9fa55317dde77d6e15d_rle_crop_3954379982_0.png treat image : temp/1757524829_3607106_1382885952_63a6159ef6f20d6cb88ad67724062352_rle_crop_3954379983_0.png treat image : temp/1757524829_3607106_1382885896_6d2202393c20828ed2a7f563eaeb2cf7_rle_crop_3954379985_0.png treat image : temp/1757524829_3607106_1382885896_6d2202393c20828ed2a7f563eaeb2cf7_rle_crop_3954379986_0.png treat image : temp/1757524829_3607106_1382885879_0e3f33b2488a5a7d43b921d331fba6cc_rle_crop_3954379991_0.png treat image : temp/1757524829_3607106_1382885731_33e22ccb0e23d2f2ad875dd10ae91f50_rle_crop_3954379998_0.png treat image : temp/1757524829_3607106_1382885731_33e22ccb0e23d2f2ad875dd10ae91f50_rle_crop_3954379999_0.png treat image : temp/1757524829_3607106_1382885731_33e22ccb0e23d2f2ad875dd10ae91f50_rle_crop_3954380000_0.png treat image : temp/1757524829_3607106_1382885729_36a24bdcac23874c10b9691368f04c6e_rle_crop_3954380001_0.png treat image : temp/1757524829_3607106_1382885729_36a24bdcac23874c10b9691368f04c6e_rle_crop_3954380002_0.png treat image : temp/1757524829_3607106_1382885707_e5317192157c552c559732c7d088af0a_rle_crop_3954380007_0.png treat image : temp/1757524829_3607106_1382885706_dc762f3757275c18ccaccd43b33f5b17_rle_crop_3954380008_0.png treat image : temp/1757524829_3607106_1382885705_270ad4636ce7113f947fbfe649cdfe25_rle_crop_3954380011_0.png treat image : temp/1757524829_3607106_1382885704_91bbc83116078fa2496a0b3deed45ff0_rle_crop_3954380013_0.png treat image : temp/1757524829_3607106_1382885685_28f53693ec2d9464f6c33959f776e5db_rle_crop_3954380019_0.png treat image : temp/1757524829_3607106_1382885674_4456d161dc67ea6f141a79a145a7f900_rle_crop_3954380023_0.png treat image : temp/1757524829_3607106_1382885651_0b803ba84f2ca8e342e0de3c8850cfc5_rle_crop_3954380026_0.png treat image : temp/1757524829_3607106_1382885623_f0abf24b806439a2d5bdb3f2a428e505_rle_crop_3954380028_0.png treat image : temp/1757524829_3607106_1382885623_f0abf24b806439a2d5bdb3f2a428e505_rle_crop_3954380029_0.png treat image : temp/1757524829_3607106_1382885623_f0abf24b806439a2d5bdb3f2a428e505_rle_crop_3954380030_0.png treat image : temp/1757524829_3607106_1382885623_f0abf24b806439a2d5bdb3f2a428e505_rle_crop_3954380031_0.png treat image : temp/1757524829_3607106_1382885623_f0abf24b806439a2d5bdb3f2a428e505_rle_crop_3954380032_0.png treat image : temp/1757524829_3607106_1382885621_c230fd013109bc261f820f7256ce7801_rle_crop_3954380034_0.png treat image : temp/1757524829_3607106_1382885618_b78b4de7c3e16502354547abcdd443f7_rle_crop_3954380036_0.png treat image : temp/1757524829_3607106_1382885613_55f6742f59389dee8799f857c8dcc7ee_rle_crop_3954380039_0.png treat image : temp/1757524829_3607106_1382885613_55f6742f59389dee8799f857c8dcc7ee_rle_crop_3954380041_0.png treat image : temp/1757524829_3607106_1382886035_03c1b201e935ccfe415181f5d450fc70_rle_crop_3954379969_0.png treat image : temp/1757524829_3607106_1382885888_0ccc1435cc76d46fe147b903e155e983_rle_crop_3954379990_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 125 time used for this insertion : 0.016701936721801758 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 125 time used for this insertion : 0.030600547790527344 save missing photos in datou_result : time spend for datou_step_exec : 9.729751110076904 time spend to save output : 0.05288124084472656 total time spend for step 7 : 9.78263235092163 step8:velours_tree Wed Sep 10 19:23:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.14276504516601562 time spend to save output : 5.9604644775390625e-05 total time spend for step 8 : 0.14282464981079102 step9:send_mail_cod Wed Sep 10 19:23:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26713963_10-09-2025_19_23_06.pdf 26726936 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267269361757524986 26726937 imagette267269371757524987 26726938 imagette267269381757524987 26726939 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267269391757524987 26726940 imagette267269401757524988 26726942 imagette267269421757524988 26726943 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267269431757524988 26726944 change filename to text .imagette267269441757524989 26726945 imagette267269451757524989 26726946 change filename to text .change filename to text .imagette267269461757524989 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26713963 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26726936,26726937,26726938,26726939,26726940,26726941,26726942,26726943,26726944,26726945,26726946?tags=pet_clair,pehd,background,carton,mal_croppe,environnement,pet_fonce,papier,metal,flou,autre args[1382886044] : ((1382886044, -2.6094436491508572, 492609224), (1382886044, 0.49462519152047685, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382886042] : ((1382886042, -2.323413921036249, 492609224), (1382886042, 0.3595228311435893, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382886039] : ((1382886039, -2.4790012565357396, 492609224), (1382886039, 0.39835644399704695, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382886035] : ((1382886035, -1.6125432536802708, 492688767), (1382886035, 0.5410473257058791, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382886031] : ((1382886031, -1.842954749206439, 492688767), (1382886031, 0.3688055301887711, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382886020] : ((1382886020, -2.8080492732467084, 492609224), (1382886020, 0.6668632971793921, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885965] : ((1382885965, -2.4177063924984097, 492609224), (1382885965, 0.5902660639061319, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885964] : ((1382885964, -4.717970099643176, 492609224), (1382885964, 0.4678137863927569, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885954] : ((1382885954, -0.8502510445253179, 492688767), (1382885954, 0.5540052827881283, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885952] : ((1382885952, 0.40288933979085173, 492688767), (1382885952, 0.626783724551376, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885896] : ((1382885896, -4.655080563570292, 492609224), (1382885896, 0.4586588434078716, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885894] : ((1382885894, -2.335211895305695, 492609224), (1382885894, 0.7598252809298717, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885891] : ((1382885891, -2.292817580282036, 492609224), (1382885891, 0.6389143235447489, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885888] : ((1382885888, -4.599304818450221, 492609224), (1382885888, 0.45526284761156793, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885879] : ((1382885879, -2.697660813820512, 492609224), (1382885879, 0.4101364724215887, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885854] : ((1382885854, -1.852016378146236, 492688767), (1382885854, 0.5911227628753626, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885735] : ((1382885735, -2.8414608842733355, 492609224), (1382885735, 0.5051897055813487, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885733] : ((1382885733, -2.830994489206857, 492609224), (1382885733, 0.6683818143382353, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885731] : ((1382885731, -1.3327216602282357, 492688767), (1382885731, 0.7009361523663863, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885729] : ((1382885729, -1.5445850580064853, 492688767), (1382885729, 0.6333510773722957, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885727] : ((1382885727, -2.0547206568583087, 492609224), (1382885727, 0.6237744254475985, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885707] : ((1382885707, -2.684424222732671, 492609224), (1382885707, 0.46465199302852933, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885706] : ((1382885706, -3.645773792421154, 492609224), (1382885706, 0.4377766565251456, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885705] : ((1382885705, -1.7279546022292178, 492688767), (1382885705, 0.5942048526913564, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885704] : ((1382885704, -3.008749362535972, 492609224), (1382885704, 0.531104670088602, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885702] : ((1382885702, -4.091856850004319, 492609224), (1382885702, 0.2958624116779624, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885687] : ((1382885687, 1.6094653219682111, 492688767), (1382885687, 0.2436764405230987, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885685] : ((1382885685, -2.815243701911356, 492609224), (1382885685, 0.811620249248174, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885683] : ((1382885683, -2.7461736825149194, 492609224), (1382885683, 0.4072095940698863, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885681] : ((1382885681, -2.107615257691845, 492609224), (1382885681, 0.39122632483120867, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885674] : ((1382885674, -2.2669141688981873, 492609224), (1382885674, 0.7141240884410752, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885651] : ((1382885651, -1.5582312466854757, 492688767), (1382885651, 0.4991435769637094, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885623] : ((1382885623, -0.10912009358946817, 492688767), (1382885623, 0.4703032267806408, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885621] : ((1382885621, -1.9755695181732216, 492688767), (1382885621, 0.36761984540533393, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885618] : ((1382885618, -2.9549733924044936, 492609224), (1382885618, 0.6120989163406348, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885615] : ((1382885615, -1.6057744465494546, 492688767), (1382885615, 0.540738858990829, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885613] : ((1382885613, -2.9762865002991568, 492609224), (1382885613, 0.3624835352172946, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885599] : ((1382885599, -1.0196372178572606, 492688767), (1382885599, 0.5538490023768794, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885597] : ((1382885597, -1.1756307531806578, 492688767), (1382885597, 0.6669160485450019, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com args[1382885595] : ((1382885595, -2.49070643099956, 492609224), (1382885595, 0.6774874046075615, 2107752395), '0.050007933063271615') We are sending mail with results at report@fotonower.com refus_total : 0.050007933063271615 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26713963 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26713963_10-09-2025_19_23_06.pdf results_Auto_P26713963_10-09-2025_19_23_06.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26713963_10-09-2025_19_23_06.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26713963','results_Auto_P26713963_10-09-2025_19_23_06.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26713963_10-09-2025_19_23_06.pdf','pdf','','0.57','0.050007933063271615') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26713963

https://www.fotonower.com/image?json=false&list_photos_id=1382886044
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382886042
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382886039
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382886035
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382886031
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382886020
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885965
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885964
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885954
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885952
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885896
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885894
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885891
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885888
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885879
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885854
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885735
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885733
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885731
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885729
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885727
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885707
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885706
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885705
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885704
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885702
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885687
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.6094653219682111)
https://www.fotonower.com/image?json=false&list_photos_id=1382885685
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885683
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885681
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885674
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885651
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885623
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885621
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885618
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885615
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885613
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885599
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885597
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382885595
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 5.00%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/26726936?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26726939?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26726943?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26726944?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26726946?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26713963_10-09-2025_19_23_06.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26726936,26726937,26726938,26726939,26726940,26726941,26726942,26726943,26726944,26726945,26726946?tags=pet_clair,pehd,background,carton,mal_croppe,environnement,pet_fonce,papier,metal,flou,autre.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 10 Sep 2025 17:23:13 GMT Content-Length: 0 Connection: close X-Message-Id: lphzLQ2KT3qKuDi-1oHnJg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1382886044, 1382886042, 1382886039, 1382886035, 1382886031, 1382886020, 1382885965, 1382885964, 1382885954, 1382885952, 1382885896, 1382885894, 1382885891, 1382885888, 1382885879, 1382885854, 1382885735, 1382885733, 1382885731, 1382885729, 1382885727, 1382885707, 1382885706, 1382885705, 1382885704, 1382885702, 1382885687, 1382885685, 1382885683, 1382885681, 1382885674, 1382885651, 1382885623, 1382885621, 1382885618, 1382885615, 1382885613, 1382885599, 1382885597, 1382885595] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886044', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886042', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886039', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886035', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886031', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886020', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885965', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885964', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885954', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885952', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885896', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885894', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885891', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885888', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885879', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885854', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885735', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885733', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885731', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885729', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885727', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885707', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885706', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885705', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885704', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885702', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885687', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885685', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885683', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885681', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885674', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885651', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885623', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885621', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885618', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885615', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885613', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885599', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885597', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885595', None, None, None, None, None, '3689059') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 40 time used for this insertion : 0.0240170955657959 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.94968056678772 time spend to save output : 0.024557828903198242 total time spend for step 9 : 6.974238395690918 step10:split_time_score Wed Sep 10 19:23:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('08', 51),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 10092025 26713963 Nombre de photos uploadées : 51 / 23040 (0%) 10092025 26713963 Nombre de photos taguées (types de déchets): 0 / 51 (0%) 10092025 26713963 Nombre de photos taguées (volume) : 0 / 51 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ??????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.002462148666381836 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.22466111183166504 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.08979048295454548 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26712868_10-09-2025_17_26_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26712868 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26712868 AND mptpi.`type`=3594 To do Qualite : 0.17853288277116408 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26713944_10-09-2025_17_47_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26713944 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26713944 AND mptpi.`type`=3594 To do Qualite : 0.12233618812838642 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26713945_10-09-2025_09_12_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26713945 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26713945 AND mptpi.`type`=3726 To do Qualite : 0.050007933063271615 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26713963_10-09-2025_19_23_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26713963 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26713963 AND mptpi.`type`=3594 To do Qualite : 0.06722256263616558 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26716828_10-09-2025_18_52_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26716828 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26716828 AND mptpi.`type`=3594 To do Qualite : 0.18278127411265432 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26716830_10-09-2025_18_41_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26716830 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26716830 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26719857 order by id desc limit 1 Qualite : 0.03022143454218108 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26717897_10-09-2025_18_31_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26717897 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26717897 AND mptpi.`type`=3594 To do Qualite : 0.14878978587962963 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26722888_10-09-2025_18_12_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26722888 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26722888 AND mptpi.`type`=3594 To do Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26722891_10-09-2025_17_31_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26722891 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26722891 AND mptpi.`type`=3594 To do Qualite : 0.062443335262345676 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26722894_10-09-2025_17_21_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26722894 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26722894 AND mptpi.`type`=3594 To do Qualite : 0.07557032455632717 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26724005_10-09-2025_18_01_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26724005 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26724005 AND mptpi.`type`=3594 To do Qualite : 0.12398239776234568 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26724007_10-09-2025_17_51_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26724007 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26724007 AND mptpi.`type`=3594 To do Qualite : 0.18615648308899177 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26724009_10-09-2025_17_41_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26724009 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26724009 AND mptpi.`type`=3594 To do Qualite : 0.12872392123694207 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26725983_10-09-2025_19_01_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26725983 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26725983 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'10092025': {'nb_upload': 51, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1382886044, 1382886042, 1382886039, 1382886035, 1382886031, 1382886020, 1382885965, 1382885964, 1382885954, 1382885952, 1382885896, 1382885894, 1382885891, 1382885888, 1382885879, 1382885854, 1382885735, 1382885733, 1382885731, 1382885729, 1382885727, 1382885707, 1382885706, 1382885705, 1382885704, 1382885702, 1382885687, 1382885685, 1382885683, 1382885681, 1382885674, 1382885651, 1382885623, 1382885621, 1382885618, 1382885615, 1382885613, 1382885599, 1382885597, 1382885595] Looping around the photos to save general results len do output : 1 /26713963Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886044', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886042', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886039', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886035', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886031', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382886020', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885965', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885964', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885954', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885952', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885896', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885894', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885891', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885888', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885879', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885854', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885735', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885733', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885731', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885729', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885727', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885707', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885706', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885705', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885704', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885702', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885687', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885685', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885683', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885681', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885674', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885651', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885623', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885621', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885618', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885615', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885613', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885599', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885597', None, None, None, None, None, '3689059') ('3318', None, None, None, None, None, None, None, '3689059') ('3318', '26713963', '1382885595', None, None, None, None, None, '3689059') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 41 time used for this insertion : 0.021646976470947266 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.251331090927124 time spend to save output : 0.022019147872924805 total time spend for step 10 : 2.273350238800049 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 100.96user 36.04system 2:49.79elapsed 80%CPU (0avgtext+0avgdata 3365184maxresident)k 576088inputs+48616outputs (1328major+2928158minor)pagefaults 0swaps