python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2475663 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3747826'] with mtr_portfolio_ids : ['27045522'] and first list_photo_ids : [] new path : /proc/2475663/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 29 ; length of list_pids : 29 ; length of list_args : 29 time to download the photos : 3.8521273136138916 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Sep 19 17:20:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10112 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-19 17:20:36.767103: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-19 17:20:36.792488: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-19 17:20:36.794492: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f81ac000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-19 17:20:36.794539: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-19 17:20:36.797995: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-19 17:20:36.926283: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xae83d60 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-19 17:20:36.926328: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-19 17:20:36.927421: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-19 17:20:36.927750: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-19 17:20:36.929908: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-19 17:20:36.931948: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-19 17:20:36.932328: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-19 17:20:36.934696: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-19 17:20:36.935934: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-19 17:20:36.940693: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-19 17:20:36.942385: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-19 17:20:36.942476: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-19 17:20:36.943389: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-19 17:20:36.943408: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-19 17:20:36.943419: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-19 17:20:36.945088: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8847 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-19 17:20:37.213389: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-19 17:20:37.213467: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-19 17:20:37.213487: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-19 17:20:37.213505: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-19 17:20:37.213523: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-19 17:20:37.213541: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-19 17:20:37.213558: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-19 17:20:37.213575: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-19 17:20:37.215068: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-19 17:20:37.216421: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-19 17:20:37.216457: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-19 17:20:37.216476: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-19 17:20:37.216495: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-19 17:20:37.216512: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-19 17:20:37.216529: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-19 17:20:37.216546: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-19 17:20:37.216563: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-19 17:20:37.218031: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-19 17:20:37.218061: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-19 17:20:37.218071: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-19 17:20:37.218081: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-19 17:20:37.219601: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8847 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-19 17:20:44.932091: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-19 17:20:45.193410: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 29 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 Detection mask done ! Trying to reset tf kernel 2476580 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 253 tf kernel not reseted sub process len(results) : 29 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 29 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5542 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.000225067138671875 nb_pixel_total : 3449 time to create 1 rle with old method : 0.004026174545288086 length of segment : 63 time for calcul the mask position with numpy : 0.0002651214599609375 nb_pixel_total : 9447 time to create 1 rle with old method : 0.01046299934387207 length of segment : 147 time for calcul the mask position with numpy : 0.00011301040649414062 nb_pixel_total : 5089 time to create 1 rle with old method : 0.00594782829284668 length of segment : 46 time for calcul the mask position with numpy : 0.0021944046020507812 nb_pixel_total : 117240 time to create 1 rle with old method : 0.13059759140014648 length of segment : 537 time for calcul the mask position with numpy : 0.00026226043701171875 nb_pixel_total : 10640 time to create 1 rle with old method : 0.012416601181030273 length of segment : 160 time for calcul the mask position with numpy : 0.00011229515075683594 nb_pixel_total : 4971 time to create 1 rle with old method : 0.005827665328979492 length of segment : 55 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 3303 time to create 1 rle with old method : 0.0038390159606933594 length of segment : 76 time for calcul the mask position with numpy : 0.00023865699768066406 nb_pixel_total : 10430 time to create 1 rle with old method : 0.011574029922485352 length of segment : 172 time for calcul the mask position with numpy : 0.0002617835998535156 nb_pixel_total : 11315 time to create 1 rle with old method : 0.012998819351196289 length of segment : 158 time for calcul the mask position with numpy : 0.00012087821960449219 nb_pixel_total : 5011 time to create 1 rle with old method : 0.0059201717376708984 length of segment : 73 time for calcul the mask position with numpy : 0.00021886825561523438 nb_pixel_total : 10435 time to create 1 rle with old method : 0.011878252029418945 length of segment : 134 time for calcul the mask position with numpy : 0.0001704692840576172 nb_pixel_total : 7485 time to create 1 rle with old method : 0.008795738220214844 length of segment : 89 time for calcul the mask position with numpy : 0.0002422332763671875 nb_pixel_total : 11056 time to create 1 rle with old method : 0.012582063674926758 length of segment : 167 time for calcul the mask position with numpy : 0.00014829635620117188 nb_pixel_total : 7443 time to create 1 rle with old method : 0.00841975212097168 length of segment : 116 time for calcul the mask position with numpy : 0.00019621849060058594 nb_pixel_total : 11105 time to create 1 rle with old method : 0.013028144836425781 length of segment : 104 time for calcul the mask position with numpy : 0.0002906322479248047 nb_pixel_total : 12870 time to create 1 rle with old method : 0.014401912689208984 length of segment : 188 time for calcul the mask position with numpy : 0.00011563301086425781 nb_pixel_total : 4227 time to create 1 rle with old method : 0.004743337631225586 length of segment : 142 time for calcul the mask position with numpy : 0.001560211181640625 nb_pixel_total : 95009 time to create 1 rle with old method : 0.10286188125610352 length of segment : 521 time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 2668 time to create 1 rle with old method : 0.0032835006713867188 length of segment : 47 time for calcul the mask position with numpy : 0.00011491775512695312 nb_pixel_total : 5275 time to create 1 rle with old method : 0.0063343048095703125 length of segment : 107 time for calcul the mask position with numpy : 0.05865144729614258 nb_pixel_total : 1530272 time to create 1 rle with new method : 0.7689812183380127 length of segment : 1285 time for calcul the mask position with numpy : 0.0005562305450439453 nb_pixel_total : 11955 time to create 1 rle with old method : 0.012998580932617188 length of segment : 179 time for calcul the mask position with numpy : 0.0034971237182617188 nb_pixel_total : 116878 time to create 1 rle with old method : 0.12782812118530273 length of segment : 565 time for calcul the mask position with numpy : 0.0006895065307617188 nb_pixel_total : 28302 time to create 1 rle with old method : 0.03170347213745117 length of segment : 164 time for calcul the mask position with numpy : 0.0004286766052246094 nb_pixel_total : 13952 time to create 1 rle with old method : 0.015889883041381836 length of segment : 144 time for calcul the mask position with numpy : 0.00041365623474121094 nb_pixel_total : 10446 time to create 1 rle with old method : 0.011683464050292969 length of segment : 140 time for calcul the mask position with numpy : 0.0006644725799560547 nb_pixel_total : 24720 time to create 1 rle with old method : 0.027024507522583008 length of segment : 227 time for calcul the mask position with numpy : 0.0001766681671142578 nb_pixel_total : 2953 time to create 1 rle with old method : 0.0035436153411865234 length of segment : 60 time for calcul the mask position with numpy : 0.0004267692565917969 nb_pixel_total : 10884 time to create 1 rle with old method : 0.01274871826171875 length of segment : 153 time for calcul the mask position with numpy : 0.0005850791931152344 nb_pixel_total : 12524 time to create 1 rle with old method : 0.019963979721069336 length of segment : 181 time for calcul the mask position with numpy : 0.0005805492401123047 nb_pixel_total : 9754 time to create 1 rle with old method : 0.01598048210144043 length of segment : 188 time for calcul the mask position with numpy : 0.00054931640625 nb_pixel_total : 10202 time to create 1 rle with old method : 0.011773347854614258 length of segment : 167 time for calcul the mask position with numpy : 0.0002853870391845703 nb_pixel_total : 5190 time to create 1 rle with old method : 0.006151676177978516 length of segment : 95 time for calcul the mask position with numpy : 0.0001735687255859375 nb_pixel_total : 4291 time to create 1 rle with old method : 0.005095243453979492 length of segment : 69 time for calcul the mask position with numpy : 0.00044035911560058594 nb_pixel_total : 9874 time to create 1 rle with old method : 0.010981082916259766 length of segment : 152 time for calcul the mask position with numpy : 0.002709627151489258 nb_pixel_total : 109270 time to create 1 rle with old method : 0.11881685256958008 length of segment : 643 time for calcul the mask position with numpy : 0.0005800724029541016 nb_pixel_total : 24278 time to create 1 rle with old method : 0.026310205459594727 length of segment : 209 time for calcul the mask position with numpy : 0.000415802001953125 nb_pixel_total : 16702 time to create 1 rle with old method : 0.018407821655273438 length of segment : 138 time for calcul the mask position with numpy : 0.0025420188903808594 nb_pixel_total : 102748 time to create 1 rle with old method : 0.10912299156188965 length of segment : 545 time for calcul the mask position with numpy : 0.0003466606140136719 nb_pixel_total : 11387 time to create 1 rle with old method : 0.012524604797363281 length of segment : 177 time for calcul the mask position with numpy : 0.014386653900146484 nb_pixel_total : 738110 time to create 1 rle with new method : 0.02547311782836914 length of segment : 908 time for calcul the mask position with numpy : 0.00031280517578125 nb_pixel_total : 9906 time to create 1 rle with old method : 0.010833263397216797 length of segment : 134 time for calcul the mask position with numpy : 0.0004305839538574219 nb_pixel_total : 17673 time to create 1 rle with old method : 0.01942133903503418 length of segment : 181 time for calcul the mask position with numpy : 0.00015115737915039062 nb_pixel_total : 3136 time to create 1 rle with old method : 0.0036389827728271484 length of segment : 53 time for calcul the mask position with numpy : 0.0004582405090332031 nb_pixel_total : 8362 time to create 1 rle with old method : 0.009263992309570312 length of segment : 164 time for calcul the mask position with numpy : 0.00025343894958496094 nb_pixel_total : 4090 time to create 1 rle with old method : 0.004541635513305664 length of segment : 110 time for calcul the mask position with numpy : 0.00030875205993652344 nb_pixel_total : 6893 time to create 1 rle with old method : 0.007628202438354492 length of segment : 121 time for calcul the mask position with numpy : 0.0004780292510986328 nb_pixel_total : 11897 time to create 1 rle with old method : 0.012813806533813477 length of segment : 165 time for calcul the mask position with numpy : 0.0006186962127685547 nb_pixel_total : 20508 time to create 1 rle with old method : 0.022092819213867188 length of segment : 212 time for calcul the mask position with numpy : 0.000194549560546875 nb_pixel_total : 4375 time to create 1 rle with old method : 0.004971981048583984 length of segment : 79 time for calcul the mask position with numpy : 0.01703047752380371 nb_pixel_total : 736037 time to create 1 rle with new method : 0.02412724494934082 length of segment : 913 time for calcul the mask position with numpy : 0.002483844757080078 nb_pixel_total : 82818 time to create 1 rle with old method : 0.08795690536499023 length of segment : 536 time for calcul the mask position with numpy : 0.0005891323089599609 nb_pixel_total : 8730 time to create 1 rle with old method : 0.009745597839355469 length of segment : 158 time for calcul the mask position with numpy : 0.0004563331604003906 nb_pixel_total : 10235 time to create 1 rle with old method : 0.011544227600097656 length of segment : 137 time for calcul the mask position with numpy : 0.00014734268188476562 nb_pixel_total : 2007 time to create 1 rle with old method : 0.002501249313354492 length of segment : 40 time for calcul the mask position with numpy : 0.0002048015594482422 nb_pixel_total : 4161 time to create 1 rle with old method : 0.004897117614746094 length of segment : 83 time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 1359 time to create 1 rle with old method : 0.0017390251159667969 length of segment : 33 time for calcul the mask position with numpy : 0.00019741058349609375 nb_pixel_total : 3455 time to create 1 rle with old method : 0.004019975662231445 length of segment : 71 time for calcul the mask position with numpy : 0.00014734268188476562 nb_pixel_total : 3000 time to create 1 rle with old method : 0.003552675247192383 length of segment : 68 time for calcul the mask position with numpy : 0.0004668235778808594 nb_pixel_total : 10206 time to create 1 rle with old method : 0.011415719985961914 length of segment : 170 time for calcul the mask position with numpy : 0.00024318695068359375 nb_pixel_total : 4417 time to create 1 rle with old method : 0.004862546920776367 length of segment : 139 time for calcul the mask position with numpy : 0.00018906593322753906 nb_pixel_total : 5630 time to create 1 rle with old method : 0.006388425827026367 length of segment : 62 time for calcul the mask position with numpy : 0.00032067298889160156 nb_pixel_total : 8967 time to create 1 rle with old method : 0.00994110107421875 length of segment : 113 time for calcul the mask position with numpy : 0.0006704330444335938 nb_pixel_total : 25757 time to create 1 rle with old method : 0.028162717819213867 length of segment : 159 time for calcul the mask position with numpy : 0.00047850608825683594 nb_pixel_total : 11549 time to create 1 rle with old method : 0.013045549392700195 length of segment : 175 time for calcul the mask position with numpy : 0.00015616416931152344 nb_pixel_total : 6127 time to create 1 rle with old method : 0.007021188735961914 length of segment : 87 time for calcul the mask position with numpy : 0.0002930164337158203 nb_pixel_total : 8109 time to create 1 rle with old method : 0.009163618087768555 length of segment : 110 time for calcul the mask position with numpy : 0.0001614093780517578 nb_pixel_total : 4089 time to create 1 rle with old method : 0.004733562469482422 length of segment : 47 time for calcul the mask position with numpy : 0.019757986068725586 nb_pixel_total : 941942 time to create 1 rle with new method : 0.06961822509765625 length of segment : 1656 time for calcul the mask position with numpy : 0.00048065185546875 nb_pixel_total : 5225 time to create 1 rle with old method : 0.006118059158325195 length of segment : 246 time for calcul the mask position with numpy : 0.00044918060302734375 nb_pixel_total : 10764 time to create 1 rle with old method : 0.012090206146240234 length of segment : 158 time for calcul the mask position with numpy : 0.0003108978271484375 nb_pixel_total : 6682 time to create 1 rle with old method : 0.011362314224243164 length of segment : 97 time for calcul the mask position with numpy : 0.0010693073272705078 nb_pixel_total : 31476 time to create 1 rle with old method : 0.04675006866455078 length of segment : 257 time for calcul the mask position with numpy : 0.0006337165832519531 nb_pixel_total : 11672 time to create 1 rle with old method : 0.013710737228393555 length of segment : 172 time for calcul the mask position with numpy : 0.0004582405090332031 nb_pixel_total : 14247 time to create 1 rle with old method : 0.01706719398498535 length of segment : 140 time for calcul the mask position with numpy : 0.0031671524047851562 nb_pixel_total : 113182 time to create 1 rle with old method : 0.13138699531555176 length of segment : 598 time for calcul the mask position with numpy : 0.00035119056701660156 nb_pixel_total : 6397 time to create 1 rle with old method : 0.007478475570678711 length of segment : 151 time for calcul the mask position with numpy : 0.0002033710479736328 nb_pixel_total : 7545 time to create 1 rle with old method : 0.008845806121826172 length of segment : 92 time for calcul the mask position with numpy : 0.0004336833953857422 nb_pixel_total : 11605 time to create 1 rle with old method : 0.012958049774169922 length of segment : 179 time for calcul the mask position with numpy : 0.00026679039001464844 nb_pixel_total : 7226 time to create 1 rle with old method : 0.008299589157104492 length of segment : 118 time for calcul the mask position with numpy : 0.001733541488647461 nb_pixel_total : 78906 time to create 1 rle with old method : 0.08730578422546387 length of segment : 661 time for calcul the mask position with numpy : 0.00036334991455078125 nb_pixel_total : 14411 time to create 1 rle with old method : 0.01664900779724121 length of segment : 149 time for calcul the mask position with numpy : 0.02617025375366211 nb_pixel_total : 1514263 time to create 1 rle with new method : 0.5578174591064453 length of segment : 1201 time for calcul the mask position with numpy : 0.00020313262939453125 nb_pixel_total : 9893 time to create 1 rle with old method : 0.010996103286743164 length of segment : 113 time for calcul the mask position with numpy : 0.0003001689910888672 nb_pixel_total : 10979 time to create 1 rle with old method : 0.012856006622314453 length of segment : 103 time for calcul the mask position with numpy : 0.0002009868621826172 nb_pixel_total : 4011 time to create 1 rle with old method : 0.006127595901489258 length of segment : 62 time for calcul the mask position with numpy : 0.000354766845703125 nb_pixel_total : 5579 time to create 1 rle with old method : 0.006433010101318359 length of segment : 145 time for calcul the mask position with numpy : 0.00038433074951171875 nb_pixel_total : 9663 time to create 1 rle with old method : 0.01117396354675293 length of segment : 153 time for calcul the mask position with numpy : 0.0003426074981689453 nb_pixel_total : 8578 time to create 1 rle with old method : 0.009932518005371094 length of segment : 236 time for calcul the mask position with numpy : 0.0018718242645263672 nb_pixel_total : 88972 time to create 1 rle with old method : 0.10398530960083008 length of segment : 478 time for calcul the mask position with numpy : 0.0001957416534423828 nb_pixel_total : 5584 time to create 1 rle with old method : 0.006473064422607422 length of segment : 73 time for calcul the mask position with numpy : 0.0004482269287109375 nb_pixel_total : 10944 time to create 1 rle with old method : 0.014163970947265625 length of segment : 172 time for calcul the mask position with numpy : 0.002387523651123047 nb_pixel_total : 83987 time to create 1 rle with old method : 0.09162020683288574 length of segment : 523 time for calcul the mask position with numpy : 0.00014662742614746094 nb_pixel_total : 3503 time to create 1 rle with old method : 0.004227399826049805 length of segment : 52 time for calcul the mask position with numpy : 0.00024247169494628906 nb_pixel_total : 6316 time to create 1 rle with old method : 0.007275581359863281 length of segment : 117 time for calcul the mask position with numpy : 0.00039076805114746094 nb_pixel_total : 11589 time to create 1 rle with old method : 0.013296365737915039 length of segment : 158 time for calcul the mask position with numpy : 0.00035381317138671875 nb_pixel_total : 13416 time to create 1 rle with old method : 0.015325546264648438 length of segment : 142 time for calcul the mask position with numpy : 0.0007693767547607422 nb_pixel_total : 28588 time to create 1 rle with old method : 0.03198385238647461 length of segment : 317 time for calcul the mask position with numpy : 0.0003018379211425781 nb_pixel_total : 10152 time to create 1 rle with old method : 0.011426925659179688 length of segment : 111 time for calcul the mask position with numpy : 0.00014519691467285156 nb_pixel_total : 4575 time to create 1 rle with old method : 0.005445957183837891 length of segment : 58 time for calcul the mask position with numpy : 0.00011181831359863281 nb_pixel_total : 5593 time to create 1 rle with old method : 0.0065996646881103516 length of segment : 72 time for calcul the mask position with numpy : 0.0002460479736328125 nb_pixel_total : 8863 time to create 1 rle with old method : 0.00998377799987793 length of segment : 172 time for calcul the mask position with numpy : 0.00039076805114746094 nb_pixel_total : 11581 time to create 1 rle with old method : 0.01307225227355957 length of segment : 170 time for calcul the mask position with numpy : 0.0004024505615234375 nb_pixel_total : 11236 time to create 1 rle with old method : 0.012502908706665039 length of segment : 169 time for calcul the mask position with numpy : 0.00011801719665527344 nb_pixel_total : 3040 time to create 1 rle with old method : 0.005614757537841797 length of segment : 61 time for calcul the mask position with numpy : 0.00024390220642089844 nb_pixel_total : 4807 time to create 1 rle with old method : 0.005469322204589844 length of segment : 137 time for calcul the mask position with numpy : 0.0003829002380371094 nb_pixel_total : 11174 time to create 1 rle with old method : 0.012701988220214844 length of segment : 158 time for calcul the mask position with numpy : 0.0003218650817871094 nb_pixel_total : 14474 time to create 1 rle with old method : 0.01659393310546875 length of segment : 119 time spent for convertir_results : 7.160138845443726 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 108 chid ids of type : 3594 Number RLEs to save : 23757 save missing photos in datou_result : time spend for datou_step_exec : 41.375704765319824 time spend to save output : 2.1516313552856445 total time spend for step 1 : 43.52733612060547 step2:crop_condition Fri Sep 19 17:21:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 29 ! batch 1 Loaded 108 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 48 About to insert : list_path_to_insert length 48 new photo from crops ! About to upload 48 photos upload in portfolio : 3736932 init cache_photo without model_param we have 48 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758295280_2475663 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 48 photos in the portfolio 3736932 time of upload the photos Elapsed time : 13.978841543197632 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758295295_2475663 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.1927616596221924 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758295299_2475663 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.4305481910705566 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 35 About to insert : list_path_to_insert length 35 new photo from crops ! About to upload 35 photos upload in portfolio : 3736932 init cache_photo without model_param we have 35 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758295328_2475663 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 35 photos in the portfolio 3736932 time of upload the photos Elapsed time : 31.552764892578125 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3736932 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758295360_2475663 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 12 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.290950775146484 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1385114441, 1385114419, 1385114417, 1385114416, 1385114414, 1385114389, 1385114387, 1385114385, 1385114382, 1385114378, 1385114376, 1385114370, 1385114367, 1385114366, 1385114363, 1385114360, 1385114356, 1385114347, 1385114345, 1385114344, 1385114343, 1385114341, 1385114338, 1385114297, 1385114296, 1385114294, 1385114290, 1385114288, 1385114285] Looping around the photos to save general results len do output : 108 /1385122615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385122824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114441', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114419', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114417', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114416', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114414', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114389', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114387', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114385', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114382', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114378', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114376', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114370', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114367', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114366', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114363', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114360', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114356', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114347', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114345', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114344', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114343', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114341', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114338', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114297', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114296', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114294', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114290', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114288', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114285', None, None, None, None, None, '3747826') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 353 time used for this insertion : 0.029298782348632812 save_final save missing photos in datou_result : time spend for datou_step_exec : 88.12637424468994 time spend to save output : 0.034636497497558594 total time spend for step 2 : 88.1610107421875 step3:rle_unique_nms_with_priority Fri Sep 19 17:22:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 108 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 2.2248659133911133 time for calcul the mask position with numpy : 0.26543354988098145 nb_pixel_total : 1922764 time to create 1 rle with new method : 0.4955599308013916 time for calcul the mask position with numpy : 0.006038665771484375 nb_pixel_total : 4971 time to create 1 rle with old method : 0.0056650638580322266 time for calcul the mask position with numpy : 0.0060577392578125 nb_pixel_total : 10640 time to create 1 rle with old method : 0.012015104293823242 time for calcul the mask position with numpy : 0.006688356399536133 nb_pixel_total : 117240 time to create 1 rle with old method : 0.13234782218933105 time for calcul the mask position with numpy : 0.0062062740325927734 nb_pixel_total : 5089 time to create 1 rle with old method : 0.005667924880981445 time for calcul the mask position with numpy : 0.006147146224975586 nb_pixel_total : 9447 time to create 1 rle with old method : 0.010681390762329102 time for calcul the mask position with numpy : 0.006106853485107422 nb_pixel_total : 3449 time to create 1 rle with old method : 0.0037355422973632812 create new chi : 0.9695749282836914 time to delete rle : 0.0234832763671875 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 3096 TO DO : save crop sub photo not yet done ! save time : 0.2286837100982666 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.07218384742736816 time for calcul the mask position with numpy : 0.022045135498046875 nb_pixel_total : 2059867 time to create 1 rle with new method : 0.0311429500579834 time for calcul the mask position with numpy : 0.006613492965698242 nb_pixel_total : 10430 time to create 1 rle with old method : 0.014028549194335938 time for calcul the mask position with numpy : 0.006619691848754883 nb_pixel_total : 3303 time to create 1 rle with old method : 0.003810405731201172 create new chi : 0.08460760116577148 time to delete rle : 0.00026702880859375 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1576 TO DO : save crop sub photo not yet done ! save time : 0.14036178588867188 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.0454716682434082 time for calcul the mask position with numpy : 0.018634796142578125 nb_pixel_total : 2046839 time to create 1 rle with new method : 0.030544042587280273 time for calcul the mask position with numpy : 0.006158113479614258 nb_pixel_total : 10435 time to create 1 rle with old method : 0.012144088745117188 time for calcul the mask position with numpy : 0.006077766418457031 nb_pixel_total : 5011 time to create 1 rle with old method : 0.0057413578033447266 time for calcul the mask position with numpy : 0.006055593490600586 nb_pixel_total : 11315 time to create 1 rle with old method : 0.013363361358642578 create new chi : 0.09906840324401855 time to delete rle : 0.0002930164337158203 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1810 TO DO : save crop sub photo not yet done ! save time : 0.13995027542114258 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05165243148803711 time for calcul the mask position with numpy : 0.019314050674438477 nb_pixel_total : 2047616 time to create 1 rle with new method : 0.029578208923339844 time for calcul the mask position with numpy : 0.006035566329956055 nb_pixel_total : 7443 time to create 1 rle with old method : 0.00840139389038086 time for calcul the mask position with numpy : 0.006297111511230469 nb_pixel_total : 11056 time to create 1 rle with old method : 0.012218475341796875 time for calcul the mask position with numpy : 0.006675243377685547 nb_pixel_total : 7485 time to create 1 rle with old method : 0.008408784866333008 create new chi : 0.0972890853881836 time to delete rle : 0.0003285408020019531 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1824 TO DO : save crop sub photo not yet done ! save time : 0.15197134017944336 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 0.09808969497680664 time for calcul the mask position with numpy : 0.009073019027709961 nb_pixel_total : 429824 time to create 1 rle with new method : 0.05708503723144531 time for calcul the mask position with numpy : 0.017325162887573242 nb_pixel_total : 1512622 time to create 1 rle with new method : 0.031487464904785156 time for calcul the mask position with numpy : 0.007506370544433594 nb_pixel_total : 5275 time to create 1 rle with old method : 0.0075321197509765625 time for calcul the mask position with numpy : 0.0061092376708984375 nb_pixel_total : 2668 time to create 1 rle with old method : 0.0033648014068603516 time for calcul the mask position with numpy : 0.007921934127807617 nb_pixel_total : 95009 time to create 1 rle with old method : 0.11370730400085449 time for calcul the mask position with numpy : 0.005944728851318359 nb_pixel_total : 4227 time to create 1 rle with old method : 0.004963874816894531 time for calcul the mask position with numpy : 0.0062024593353271484 nb_pixel_total : 12870 time to create 1 rle with old method : 0.015567302703857422 time for calcul the mask position with numpy : 0.006622314453125 nb_pixel_total : 11105 time to create 1 rle with old method : 0.012309789657592773 create new chi : 0.3138313293457031 time to delete rle : 0.0007975101470947266 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 5663 TO DO : save crop sub photo not yet done ! save time : 0.3711998462677002 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04885244369506836 time for calcul the mask position with numpy : 0.01784658432006836 nb_pixel_total : 1916465 time to create 1 rle with new method : 0.037782907485961914 time for calcul the mask position with numpy : 0.006441593170166016 nb_pixel_total : 28302 time to create 1 rle with old method : 0.030998945236206055 time for calcul the mask position with numpy : 0.010717153549194336 nb_pixel_total : 116878 time to create 1 rle with old method : 0.12938976287841797 time for calcul the mask position with numpy : 0.009940147399902344 nb_pixel_total : 11955 time to create 1 rle with old method : 0.013638973236083984 create new chi : 0.25740575790405273 time to delete rle : 0.0004649162292480469 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 2896 TO DO : save crop sub photo not yet done ! save time : 0.2196364402770996 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.09926724433898926 time for calcul the mask position with numpy : 0.02471923828125 nb_pixel_total : 2010645 time to create 1 rle with new method : 0.032164573669433594 time for calcul the mask position with numpy : 0.005884408950805664 nb_pixel_total : 10884 time to create 1 rle with old method : 0.011849164962768555 time for calcul the mask position with numpy : 0.006092548370361328 nb_pixel_total : 2953 time to create 1 rle with old method : 0.003267049789428711 time for calcul the mask position with numpy : 0.006026506423950195 nb_pixel_total : 24720 time to create 1 rle with old method : 0.030152320861816406 time for calcul the mask position with numpy : 0.006052255630493164 nb_pixel_total : 10446 time to create 1 rle with old method : 0.011631250381469727 time for calcul the mask position with numpy : 0.005954742431640625 nb_pixel_total : 13952 time to create 1 rle with old method : 0.015194177627563477 create new chi : 0.15946531295776367 time to delete rle : 0.0004153251647949219 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2528 TO DO : save crop sub photo not yet done ! save time : 0.20161938667297363 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.0416722297668457 time for calcul the mask position with numpy : 0.02194976806640625 nb_pixel_total : 2051322 time to create 1 rle with new method : 0.03581976890563965 time for calcul the mask position with numpy : 0.006401777267456055 nb_pixel_total : 9754 time to create 1 rle with old method : 0.01231694221496582 time for calcul the mask position with numpy : 0.010937690734863281 nb_pixel_total : 12524 time to create 1 rle with old method : 0.015148639678955078 create new chi : 0.10299348831176758 time to delete rle : 0.00036525726318359375 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 1818 TO DO : save crop sub photo not yet done ! save time : 0.14822030067443848 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.058706045150756836 time for calcul the mask position with numpy : 0.01898813247680664 nb_pixel_total : 2058208 time to create 1 rle with new method : 0.04114961624145508 time for calcul the mask position with numpy : 0.0061817169189453125 nb_pixel_total : 5190 time to create 1 rle with old method : 0.005816221237182617 time for calcul the mask position with numpy : 0.006277561187744141 nb_pixel_total : 10202 time to create 1 rle with old method : 0.011275291442871094 create new chi : 0.09003233909606934 time to delete rle : 0.0003540515899658203 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1604 TO DO : save crop sub photo not yet done ! save time : 0.14820647239685059 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.0671396255493164 time for calcul the mask position with numpy : 0.01868605613708496 nb_pixel_total : 1909185 time to create 1 rle with new method : 0.04061579704284668 time for calcul the mask position with numpy : 0.00599980354309082 nb_pixel_total : 16702 time to create 1 rle with old method : 0.018384218215942383 time for calcul the mask position with numpy : 0.005922794342041016 nb_pixel_total : 24278 time to create 1 rle with old method : 0.02644944190979004 time for calcul the mask position with numpy : 0.006530046463012695 nb_pixel_total : 109270 time to create 1 rle with old method : 0.12398695945739746 time for calcul the mask position with numpy : 0.006682634353637695 nb_pixel_total : 9874 time to create 1 rle with old method : 0.012623310089111328 time for calcul the mask position with numpy : 0.006157398223876953 nb_pixel_total : 4291 time to create 1 rle with old method : 0.0046291351318359375 create new chi : 0.27742791175842285 time to delete rle : 0.0007462501525878906 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 3502 TO DO : save crop sub photo not yet done ! save time : 0.24723005294799805 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.08151841163635254 time for calcul the mask position with numpy : 0.015814542770385742 nb_pixel_total : 1193776 time to create 1 rle with new method : 0.03378152847290039 time for calcul the mask position with numpy : 0.00617671012878418 nb_pixel_total : 17673 time to create 1 rle with old method : 0.020061492919921875 time for calcul the mask position with numpy : 0.006086111068725586 nb_pixel_total : 9906 time to create 1 rle with old method : 0.01112508773803711 time for calcul the mask position with numpy : 0.01107025146484375 nb_pixel_total : 738110 time to create 1 rle with new method : 0.027864456176757812 time for calcul the mask position with numpy : 0.0060977935791015625 nb_pixel_total : 11387 time to create 1 rle with old method : 0.018260717391967773 time for calcul the mask position with numpy : 0.00894308090209961 nb_pixel_total : 102748 time to create 1 rle with old method : 0.1145622730255127 create new chi : 0.28072214126586914 time to delete rle : 0.0007340908050537109 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 4967 TO DO : save crop sub photo not yet done ! save time : 0.30191898345947266 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.05724501609802246 time for calcul the mask position with numpy : 0.018849611282348633 nb_pixel_total : 2051119 time to create 1 rle with new method : 0.02763676643371582 time for calcul the mask position with numpy : 0.005892515182495117 nb_pixel_total : 6893 time to create 1 rle with old method : 0.007368326187133789 time for calcul the mask position with numpy : 0.005803108215332031 nb_pixel_total : 4090 time to create 1 rle with old method : 0.004521608352661133 time for calcul the mask position with numpy : 0.005965232849121094 nb_pixel_total : 8362 time to create 1 rle with old method : 0.009377717971801758 time for calcul the mask position with numpy : 0.0059893131256103516 nb_pixel_total : 3136 time to create 1 rle with old method : 0.0034317970275878906 create new chi : 0.09523534774780273 time to delete rle : 0.00036907196044921875 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1976 TO DO : save crop sub photo not yet done ! save time : 0.15578246116638184 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.057762861251831055 time for calcul the mask position with numpy : 0.014768838882446289 nb_pixel_total : 1300783 time to create 1 rle with new method : 0.031159162521362305 time for calcul the mask position with numpy : 0.01126718521118164 nb_pixel_total : 736037 time to create 1 rle with new method : 0.030651569366455078 time for calcul the mask position with numpy : 0.006316184997558594 nb_pixel_total : 4375 time to create 1 rle with old method : 0.005084991455078125 time for calcul the mask position with numpy : 0.0063741207122802734 nb_pixel_total : 20508 time to create 1 rle with old method : 0.02320718765258789 time for calcul the mask position with numpy : 0.006259441375732422 nb_pixel_total : 11897 time to create 1 rle with old method : 0.013248443603515625 create new chi : 0.1490159034729004 time to delete rle : 0.0007960796356201172 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 3818 TO DO : save crop sub photo not yet done ! save time : 0.250316858291626 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04703855514526367 time for calcul the mask position with numpy : 0.025194168090820312 nb_pixel_total : 1982052 time to create 1 rle with new method : 0.03525424003601074 time for calcul the mask position with numpy : 0.010538101196289062 nb_pixel_total : 8730 time to create 1 rle with old method : 0.00958704948425293 time for calcul the mask position with numpy : 0.006361961364746094 nb_pixel_total : 82818 time to create 1 rle with old method : 0.1076817512512207 create new chi : 0.19512701034545898 time to delete rle : 0.0005183219909667969 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2468 TO DO : save crop sub photo not yet done ! save time : 0.17695116996765137 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.12145185470581055 time for calcul the mask position with numpy : 0.024192333221435547 nb_pixel_total : 2052383 time to create 1 rle with new method : 0.03193807601928711 time for calcul the mask position with numpy : 0.006276607513427734 nb_pixel_total : 3455 time to create 1 rle with old method : 0.004003047943115234 time for calcul the mask position with numpy : 0.006254434585571289 nb_pixel_total : 1359 time to create 1 rle with old method : 0.0015773773193359375 time for calcul the mask position with numpy : 0.0062024593353271484 nb_pixel_total : 4161 time to create 1 rle with old method : 0.004786968231201172 time for calcul the mask position with numpy : 0.0061380863189697266 nb_pixel_total : 2007 time to create 1 rle with old method : 0.0023581981658935547 time for calcul the mask position with numpy : 0.0061855316162109375 nb_pixel_total : 10235 time to create 1 rle with old method : 0.01162576675415039 create new chi : 0.11191940307617188 time to delete rle : 0.0003814697265625 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 1808 TO DO : save crop sub photo not yet done ! save time : 0.14675283432006836 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.0578618049621582 time for calcul the mask position with numpy : 0.019244909286499023 nb_pixel_total : 2050347 time to create 1 rle with new method : 0.0280611515045166 time for calcul the mask position with numpy : 0.0068359375 nb_pixel_total : 5630 time to create 1 rle with old method : 0.00626826286315918 time for calcul the mask position with numpy : 0.00581669807434082 nb_pixel_total : 4417 time to create 1 rle with old method : 0.005057573318481445 time for calcul the mask position with numpy : 0.006226301193237305 nb_pixel_total : 10206 time to create 1 rle with old method : 0.011725664138793945 time for calcul the mask position with numpy : 0.006518363952636719 nb_pixel_total : 3000 time to create 1 rle with old method : 0.004468202590942383 create new chi : 0.10061168670654297 time to delete rle : 0.0003986358642578125 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 1958 TO DO : save crop sub photo not yet done ! save time : 0.15861272811889648 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 0.09467601776123047 time for calcul the mask position with numpy : 0.012961149215698242 nb_pixel_total : 1073243 time to create 1 rle with new method : 0.1490323543548584 time for calcul the mask position with numpy : 0.0060062408447265625 nb_pixel_total : 2285 time to create 1 rle with old method : 0.0026450157165527344 time for calcul the mask position with numpy : 0.014496803283691406 nb_pixel_total : 933474 time to create 1 rle with new method : 0.07250261306762695 time for calcul the mask position with numpy : 0.005966901779174805 nb_pixel_total : 4089 time to create 1 rle with old method : 0.004422903060913086 time for calcul the mask position with numpy : 0.006041288375854492 nb_pixel_total : 8109 time to create 1 rle with old method : 0.008930683135986328 time for calcul the mask position with numpy : 0.00622105598449707 nb_pixel_total : 6127 time to create 1 rle with old method : 0.006767749786376953 time for calcul the mask position with numpy : 0.006310462951660156 nb_pixel_total : 11549 time to create 1 rle with old method : 0.012716531753540039 time for calcul the mask position with numpy : 0.0064697265625 nb_pixel_total : 25757 time to create 1 rle with old method : 0.033049583435058594 time for calcul the mask position with numpy : 0.010320663452148438 nb_pixel_total : 8967 time to create 1 rle with old method : 0.00986337661743164 create new chi : 0.3849034309387207 time to delete rle : 0.001064300537109375 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++Number RLEs to save : 5914 TO DO : save crop sub photo not yet done ! save time : 0.37428784370422363 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.06121349334716797 time for calcul the mask position with numpy : 0.025774002075195312 nb_pixel_total : 2024678 time to create 1 rle with new method : 0.04193758964538574 time for calcul the mask position with numpy : 0.006074428558349609 nb_pixel_total : 31476 time to create 1 rle with old method : 0.03501248359680176 time for calcul the mask position with numpy : 0.005858898162841797 nb_pixel_total : 6682 time to create 1 rle with old method : 0.007366657257080078 time for calcul the mask position with numpy : 0.005942821502685547 nb_pixel_total : 10764 time to create 1 rle with old method : 0.011937379837036133 create new chi : 0.1402757167816162 time to delete rle : 0.0003380775451660156 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 2104 TO DO : save crop sub photo not yet done ! save time : 0.16351699829101562 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.06495451927185059 time for calcul the mask position with numpy : 0.0184171199798584 nb_pixel_total : 1920564 time to create 1 rle with new method : 0.03523969650268555 time for calcul the mask position with numpy : 0.005892038345336914 nb_pixel_total : 7538 time to create 1 rle with old method : 0.008206367492675781 time for calcul the mask position with numpy : 0.005830049514770508 nb_pixel_total : 6397 time to create 1 rle with old method : 0.007069826126098633 time for calcul the mask position with numpy : 0.006370067596435547 nb_pixel_total : 113182 time to create 1 rle with old method : 0.12191915512084961 time for calcul the mask position with numpy : 0.005888223648071289 nb_pixel_total : 14247 time to create 1 rle with old method : 0.015264511108398438 time for calcul the mask position with numpy : 0.0058155059814453125 nb_pixel_total : 11672 time to create 1 rle with old method : 0.012888908386230469 create new chi : 0.24941134452819824 time to delete rle : 0.0005331039428710938 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 3376 TO DO : save crop sub photo not yet done ! save time : 0.24805617332458496 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 0.07903122901916504 time for calcul the mask position with numpy : 0.008681774139404297 nb_pixel_total : 454767 time to create 1 rle with new method : 0.03347182273864746 time for calcul the mask position with numpy : 0.005919456481933594 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001513957977294922 time for calcul the mask position with numpy : 0.015744924545288086 nb_pixel_total : 1506575 time to create 1 rle with new method : 0.030757904052734375 time for calcul the mask position with numpy : 0.00630950927734375 nb_pixel_total : 14411 time to create 1 rle with old method : 0.016541004180908203 time for calcul the mask position with numpy : 0.006790637969970703 nb_pixel_total : 78906 time to create 1 rle with old method : 0.08805966377258301 time for calcul the mask position with numpy : 0.006124258041381836 nb_pixel_total : 7226 time to create 1 rle with old method : 0.008119583129882812 time for calcul the mask position with numpy : 0.005922555923461914 nb_pixel_total : 11605 time to create 1 rle with old method : 0.012823104858398438 create new chi : 0.24641990661621094 time to delete rle : 0.0008804798126220703 batch 1 Loaded 13 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 5646 TO DO : save crop sub photo not yet done ! save time : 0.381105899810791 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04975628852844238 time for calcul the mask position with numpy : 0.024445772171020508 nb_pixel_total : 2058610 time to create 1 rle with new method : 0.03110337257385254 time for calcul the mask position with numpy : 0.006596803665161133 nb_pixel_total : 4011 time to create 1 rle with old method : 0.004640340805053711 time for calcul the mask position with numpy : 0.0065784454345703125 nb_pixel_total : 10979 time to create 1 rle with old method : 0.012578487396240234 create new chi : 0.08635354042053223 time to delete rle : 0.0003802776336669922 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1410 TO DO : save crop sub photo not yet done ! save time : 0.12108802795410156 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.05269217491149902 time for calcul the mask position with numpy : 0.019678592681884766 nb_pixel_total : 2049780 time to create 1 rle with new method : 0.02833080291748047 time for calcul the mask position with numpy : 0.005928754806518555 nb_pixel_total : 8578 time to create 1 rle with old method : 0.00955510139465332 time for calcul the mask position with numpy : 0.005890846252441406 nb_pixel_total : 9663 time to create 1 rle with old method : 0.010725736618041992 time for calcul the mask position with numpy : 0.00585174560546875 nb_pixel_total : 5579 time to create 1 rle with old method : 0.0061266422271728516 create new chi : 0.09248161315917969 time to delete rle : 0.00036072731018066406 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 2148 TO DO : save crop sub photo not yet done ! save time : 0.16120409965515137 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.038561344146728516 time for calcul the mask position with numpy : 0.018002033233642578 nb_pixel_total : 1979044 time to create 1 rle with new method : 0.027577877044677734 time for calcul the mask position with numpy : 0.005741119384765625 nb_pixel_total : 5584 time to create 1 rle with old method : 0.005988121032714844 time for calcul the mask position with numpy : 0.006104230880737305 nb_pixel_total : 88972 time to create 1 rle with old method : 0.09407639503479004 create new chi : 0.15782833099365234 time to delete rle : 0.00031948089599609375 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2182 TO DO : save crop sub photo not yet done ! save time : 0.165513277053833 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.04616284370422363 time for calcul the mask position with numpy : 0.018773794174194336 nb_pixel_total : 1975166 time to create 1 rle with new method : 0.02901458740234375 time for calcul the mask position with numpy : 0.00597071647644043 nb_pixel_total : 3503 time to create 1 rle with old method : 0.003864765167236328 time for calcul the mask position with numpy : 0.006398439407348633 nb_pixel_total : 83987 time to create 1 rle with old method : 0.09136819839477539 time for calcul the mask position with numpy : 0.0060689449310302734 nb_pixel_total : 10944 time to create 1 rle with old method : 0.012375116348266602 create new chi : 0.1743018627166748 time to delete rle : 0.0004703998565673828 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2574 TO DO : save crop sub photo not yet done ! save time : 0.1903374195098877 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.04602766036987305 time for calcul the mask position with numpy : 0.018743276596069336 nb_pixel_total : 2042279 time to create 1 rle with new method : 0.02764606475830078 time for calcul the mask position with numpy : 0.005895376205444336 nb_pixel_total : 13416 time to create 1 rle with old method : 0.014746904373168945 time for calcul the mask position with numpy : 0.006506204605102539 nb_pixel_total : 11589 time to create 1 rle with old method : 0.012572765350341797 time for calcul the mask position with numpy : 0.0058917999267578125 nb_pixel_total : 6316 time to create 1 rle with old method : 0.0067212581634521484 create new chi : 0.09904980659484863 time to delete rle : 0.00034046173095703125 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1914 TO DO : save crop sub photo not yet done ! save time : 0.155226469039917 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.06849455833435059 time for calcul the mask position with numpy : 0.019790172576904297 nb_pixel_total : 2015829 time to create 1 rle with new method : 0.028561115264892578 time for calcul the mask position with numpy : 0.006007671356201172 nb_pixel_total : 8863 time to create 1 rle with old method : 0.009794235229492188 time for calcul the mask position with numpy : 0.007459402084350586 nb_pixel_total : 5593 time to create 1 rle with old method : 0.006022453308105469 time for calcul the mask position with numpy : 0.006081342697143555 nb_pixel_total : 4575 time to create 1 rle with old method : 0.005039691925048828 time for calcul the mask position with numpy : 0.0061473846435546875 nb_pixel_total : 10152 time to create 1 rle with old method : 0.011064291000366211 time for calcul the mask position with numpy : 0.006046772003173828 nb_pixel_total : 28588 time to create 1 rle with old method : 0.031019210815429688 create new chi : 0.1434946060180664 time to delete rle : 0.0003986358642578125 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 2540 TO DO : save crop sub photo not yet done ! save time : 0.19594931602478027 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.036080121994018555 time for calcul the mask position with numpy : 0.025873422622680664 nb_pixel_total : 2062019 time to create 1 rle with new method : 0.03241395950317383 time for calcul the mask position with numpy : 0.006748676300048828 nb_pixel_total : 11581 time to create 1 rle with old method : 0.015067815780639648 create new chi : 0.08038806915283203 time to delete rle : 0.00027441978454589844 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1420 TO DO : save crop sub photo not yet done ! save time : 0.11960077285766602 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.039685726165771484 time for calcul the mask position with numpy : 0.019423484802246094 nb_pixel_total : 2059324 time to create 1 rle with new method : 0.02815556526184082 time for calcul the mask position with numpy : 0.00573277473449707 nb_pixel_total : 3040 time to create 1 rle with old method : 0.003348827362060547 time for calcul the mask position with numpy : 0.005965232849121094 nb_pixel_total : 11236 time to create 1 rle with old method : 0.012015104293823242 create new chi : 0.07492184638977051 time to delete rle : 0.0002677440643310547 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 1540 TO DO : save crop sub photo not yet done ! save time : 0.14017891883850098 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04852032661437988 time for calcul the mask position with numpy : 0.018317222595214844 nb_pixel_total : 2043145 time to create 1 rle with new method : 0.027263402938842773 time for calcul the mask position with numpy : 0.0056362152099609375 nb_pixel_total : 14474 time to create 1 rle with old method : 0.015303850173950195 time for calcul the mask position with numpy : 0.005613803863525391 nb_pixel_total : 11174 time to create 1 rle with old method : 0.01157069206237793 time for calcul the mask position with numpy : 0.005682945251464844 nb_pixel_total : 4807 time to create 1 rle with old method : 0.0050394535064697266 create new chi : 0.0947728157043457 time to delete rle : 0.00031447410583496094 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1908 TO DO : save crop sub photo not yet done ! save time : 0.14634990692138672 map_output_result : {1385114441: (0.0, 'Should be the crop_list due to order', 0), 1385114419: (0.0, 'Should be the crop_list due to order', 0), 1385114417: (0.0, 'Should be the crop_list due to order', 0), 1385114416: (0.0, 'Should be the crop_list due to order', 0), 1385114414: (0.0, 'Should be the crop_list due to order', 0), 1385114389: (0.0, 'Should be the crop_list due to order', 0), 1385114387: (0.0, 'Should be the crop_list due to order', 0), 1385114385: (0.0, 'Should be the crop_list due to order', 0), 1385114382: (0.0, 'Should be the crop_list due to order', 0), 1385114378: (0.0, 'Should be the crop_list due to order', 0), 1385114376: (0.0, 'Should be the crop_list due to order', 0), 1385114370: (0.0, 'Should be the crop_list due to order', 0), 1385114367: (0.0, 'Should be the crop_list due to order', 0), 1385114366: (0.0, 'Should be the crop_list due to order', 0), 1385114363: (0.0, 'Should be the crop_list due to order', 0), 1385114360: (0.0, 'Should be the crop_list due to order', 0), 1385114356: (0.0, 'Should be the crop_list due to order', 0), 1385114347: (0.0, 'Should be the crop_list due to order', 0), 1385114345: (0.0, 'Should be the crop_list due to order', 0), 1385114344: (0.0, 'Should be the crop_list due to order', 0), 1385114343: (0.0, 'Should be the crop_list due to order', 0), 1385114341: (0.0, 'Should be the crop_list due to order', 0), 1385114338: (0.0, 'Should be the crop_list due to order', 0), 1385114297: (0.0, 'Should be the crop_list due to order', 0), 1385114296: (0.0, 'Should be the crop_list due to order', 0), 1385114294: (0.0, 'Should be the crop_list due to order', 0), 1385114290: (0.0, 'Should be the crop_list due to order', 0), 1385114288: (0.0, 'Should be the crop_list due to order', 0), 1385114285: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1385114441, 1385114419, 1385114417, 1385114416, 1385114414, 1385114389, 1385114387, 1385114385, 1385114382, 1385114378, 1385114376, 1385114370, 1385114367, 1385114366, 1385114363, 1385114360, 1385114356, 1385114347, 1385114345, 1385114344, 1385114343, 1385114341, 1385114338, 1385114297, 1385114296, 1385114294, 1385114290, 1385114288, 1385114285] Looping around the photos to save general results len do output : 29 /1385114441.Didn't retrieve data . /1385114419.Didn't retrieve data . /1385114417.Didn't retrieve data . /1385114416.Didn't retrieve data . /1385114414.Didn't retrieve data . /1385114389.Didn't retrieve data . /1385114387.Didn't retrieve data . /1385114385.Didn't retrieve data . /1385114382.Didn't retrieve data . /1385114378.Didn't retrieve data . /1385114376.Didn't retrieve data . /1385114370.Didn't retrieve data . /1385114367.Didn't retrieve data . /1385114366.Didn't retrieve data . /1385114363.Didn't retrieve data . /1385114360.Didn't retrieve data . /1385114356.Didn't retrieve data . /1385114347.Didn't retrieve data . /1385114345.Didn't retrieve data . /1385114344.Didn't retrieve data . /1385114343.Didn't retrieve data . /1385114341.Didn't retrieve data . /1385114338.Didn't retrieve data . /1385114297.Didn't retrieve data . /1385114296.Didn't retrieve data . /1385114294.Didn't retrieve data . /1385114290.Didn't retrieve data . /1385114288.Didn't retrieve data . /1385114285.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114441', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114419', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114417', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114416', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114414', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114389', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114387', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114385', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114382', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114378', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114376', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114370', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114367', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114366', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114363', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114360', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114356', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114347', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114345', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114344', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114343', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114341', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114338', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114297', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114296', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114294', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114290', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114288', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114285', None, None, None, None, None, '3747826') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 87 time used for this insertion : 0.022984981536865234 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.073432683944702 time spend to save output : 0.024260759353637695 total time spend for step 3 : 16.09769344329834 step4:ventilate_hashtags_in_portfolio Fri Sep 19 17:23:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27045522 get user id for portfolio 27045522 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27045522 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','papier','environnement','pet_clair','background','metal','pet_fonce','mal_croppe','autre','flou','carton')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27045522 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','papier','environnement','pet_clair','background','metal','pet_fonce','mal_croppe','autre','flou','carton')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27045522 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','papier','environnement','pet_clair','background','metal','pet_fonce','mal_croppe','autre','flou','carton')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27045732,27045733,27045734,27045735,27045736,27045737,27045738,27045739,27045740,27045741,27045742?tags=pehd,papier,environnement,pet_clair,background,metal,pet_fonce,mal_croppe,autre,flou,carton Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1385114441, 1385114419, 1385114417, 1385114416, 1385114414, 1385114389, 1385114387, 1385114385, 1385114382, 1385114378, 1385114376, 1385114370, 1385114367, 1385114366, 1385114363, 1385114360, 1385114356, 1385114347, 1385114345, 1385114344, 1385114343, 1385114341, 1385114338, 1385114297, 1385114296, 1385114294, 1385114290, 1385114288, 1385114285] Looping around the photos to save general results len do output : 1 /27045522. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114441', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114419', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114417', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114416', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114414', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114389', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114387', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114385', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114382', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114378', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114376', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114370', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114367', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114366', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114363', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114360', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114356', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114347', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114345', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114344', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114343', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114341', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114338', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114297', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114296', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114294', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114290', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114288', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114285', None, None, None, None, None, '3747826') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.01638484001159668 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6745877265930176 time spend to save output : 0.01680302619934082 total time spend for step 4 : 1.6913907527923584 step5:final Fri Sep 19 17:23:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1385114441: ('0.12127429557790552',), 1385114419: ('0.12127429557790552',), 1385114417: ('0.12127429557790552',), 1385114416: ('0.12127429557790552',), 1385114414: ('0.12127429557790552',), 1385114389: ('0.12127429557790552',), 1385114387: ('0.12127429557790552',), 1385114385: ('0.12127429557790552',), 1385114382: ('0.12127429557790552',), 1385114378: ('0.12127429557790552',), 1385114376: ('0.12127429557790552',), 1385114370: ('0.12127429557790552',), 1385114367: ('0.12127429557790552',), 1385114366: ('0.12127429557790552',), 1385114363: ('0.12127429557790552',), 1385114360: ('0.12127429557790552',), 1385114356: ('0.12127429557790552',), 1385114347: ('0.12127429557790552',), 1385114345: ('0.12127429557790552',), 1385114344: ('0.12127429557790552',), 1385114343: ('0.12127429557790552',), 1385114341: ('0.12127429557790552',), 1385114338: ('0.12127429557790552',), 1385114297: ('0.12127429557790552',), 1385114296: ('0.12127429557790552',), 1385114294: ('0.12127429557790552',), 1385114290: ('0.12127429557790552',), 1385114288: ('0.12127429557790552',), 1385114285: ('0.12127429557790552',)} new output for save of step final : {1385114441: ('0.12127429557790552',), 1385114419: ('0.12127429557790552',), 1385114417: ('0.12127429557790552',), 1385114416: ('0.12127429557790552',), 1385114414: ('0.12127429557790552',), 1385114389: ('0.12127429557790552',), 1385114387: ('0.12127429557790552',), 1385114385: ('0.12127429557790552',), 1385114382: ('0.12127429557790552',), 1385114378: ('0.12127429557790552',), 1385114376: ('0.12127429557790552',), 1385114370: ('0.12127429557790552',), 1385114367: ('0.12127429557790552',), 1385114366: ('0.12127429557790552',), 1385114363: ('0.12127429557790552',), 1385114360: ('0.12127429557790552',), 1385114356: ('0.12127429557790552',), 1385114347: ('0.12127429557790552',), 1385114345: ('0.12127429557790552',), 1385114344: ('0.12127429557790552',), 1385114343: ('0.12127429557790552',), 1385114341: ('0.12127429557790552',), 1385114338: ('0.12127429557790552',), 1385114297: ('0.12127429557790552',), 1385114296: ('0.12127429557790552',), 1385114294: ('0.12127429557790552',), 1385114290: ('0.12127429557790552',), 1385114288: ('0.12127429557790552',), 1385114285: ('0.12127429557790552',)} [1385114441, 1385114419, 1385114417, 1385114416, 1385114414, 1385114389, 1385114387, 1385114385, 1385114382, 1385114378, 1385114376, 1385114370, 1385114367, 1385114366, 1385114363, 1385114360, 1385114356, 1385114347, 1385114345, 1385114344, 1385114343, 1385114341, 1385114338, 1385114297, 1385114296, 1385114294, 1385114290, 1385114288, 1385114285] Looping around the photos to save general results len do output : 29 /1385114441.Didn't retrieve data . /1385114419.Didn't retrieve data . /1385114417.Didn't retrieve data . /1385114416.Didn't retrieve data . /1385114414.Didn't retrieve data . /1385114389.Didn't retrieve data . /1385114387.Didn't retrieve data . /1385114385.Didn't retrieve data . /1385114382.Didn't retrieve data . /1385114378.Didn't retrieve data . /1385114376.Didn't retrieve data . /1385114370.Didn't retrieve data . /1385114367.Didn't retrieve data . /1385114366.Didn't retrieve data . /1385114363.Didn't retrieve data . /1385114360.Didn't retrieve data . /1385114356.Didn't retrieve data . /1385114347.Didn't retrieve data . /1385114345.Didn't retrieve data . /1385114344.Didn't retrieve data . /1385114343.Didn't retrieve data . /1385114341.Didn't retrieve data . /1385114338.Didn't retrieve data . /1385114297.Didn't retrieve data . /1385114296.Didn't retrieve data . /1385114294.Didn't retrieve data . /1385114290.Didn't retrieve data . /1385114288.Didn't retrieve data . /1385114285.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114441', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114419', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114417', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114416', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114414', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114389', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114387', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114385', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114382', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114378', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114376', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114370', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114367', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114366', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114363', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114360', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114356', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114347', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114345', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114344', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114343', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114341', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114338', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114297', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114296', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114294', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114290', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114288', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114285', None, None, None, None, None, '3747826') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 87 time used for this insertion : 0.015819549560546875 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12104201316833496 time spend to save output : 0.04983258247375488 total time spend for step 5 : 0.17087459564208984 step6:blur_detection Fri Sep 19 17:23:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1758295230_2475663_1385114441_af22438e64ff09118aeb7f04d7af2157.jpg resize: (1080, 1920) 1385114441 -4.493297727452069 treat image : temp/1758295230_2475663_1385114419_3f28186882a268251af96d62719005db.jpg resize: (1080, 1920) 1385114419 -2.709885815842123 treat image : temp/1758295230_2475663_1385114417_0cb18d378b7c3fd42886f64ecebf273b.jpg resize: (1080, 1920) 1385114417 -0.7440781496001609 treat image : temp/1758295230_2475663_1385114416_ef0c5ebc2ac9af188bdbf612bdc77c8f.jpg resize: (1080, 1920) 1385114416 -2.464843884781539 treat image : temp/1758295230_2475663_1385114414_abcbbaaad0b18935c8e73820d7d5d4f4.jpg resize: (1080, 1920) 1385114414 -1.3359000768091656 treat image : temp/1758295230_2475663_1385114389_29604bb5e396815b7d6701121c512543.jpg resize: (1080, 1920) 1385114389 -1.7338418096780788 treat image : temp/1758295230_2475663_1385114387_7dd9904395e490ea4d27002584931517.jpg resize: (1080, 1920) 1385114387 -2.0986552871541146 treat image : temp/1758295230_2475663_1385114385_66f4fce08f23410c56fed55665c7a81e.jpg resize: (1080, 1920) 1385114385 -0.7036927918155619 treat image : temp/1758295230_2475663_1385114382_32bdb283090095beba68538719a58c5a.jpg resize: (1080, 1920) 1385114382 -2.050903674292459 treat image : temp/1758295230_2475663_1385114378_e8b1fc670abc660ff3515d338883160f.jpg resize: (1080, 1920) 1385114378 -1.8481751240093554 treat image : temp/1758295230_2475663_1385114376_f8b7f8319ab8631017901bc69833d530.jpg resize: (1080, 1920) 1385114376 -1.8255778803809994 treat image : temp/1758295230_2475663_1385114370_56c28f0fa13607092479e460f29709b8.jpg resize: (1080, 1920) 1385114370 -1.2901496776354713 treat image : temp/1758295230_2475663_1385114367_85ea78b695e9ee7bad35e0d963537d3e.jpg resize: (1080, 1920) 1385114367 -2.2418614784819573 treat image : temp/1758295230_2475663_1385114366_ab56666be0f185d57d9f1ef57dd01262.jpg resize: (1080, 1920) 1385114366 -1.750120050484162 treat image : temp/1758295230_2475663_1385114363_9e886673c914a7eecc2f7741cc383256.jpg resize: (1080, 1920) 1385114363 -2.558481228024 treat image : temp/1758295230_2475663_1385114360_76fe50434518779268b727c4a1ca0077.jpg resize: (1080, 1920) 1385114360 -1.962238171277156 treat image : temp/1758295230_2475663_1385114356_889b91e3911be19b00cebed63a1fb16c.jpg resize: (1080, 1920) 1385114356 -1.264998095657095 treat image : temp/1758295230_2475663_1385114347_b61031f6093f35441705554610da3549.jpg resize: (1080, 1920) 1385114347 -1.6389109677061229 treat image : temp/1758295230_2475663_1385114345_a7f70a85b5be2521369b672a4105609e.jpg resize: (1080, 1920) 1385114345 -2.5647025336512184 treat image : temp/1758295230_2475663_1385114344_09c6acb669682cb688362eceb565ae0c.jpg resize: (1080, 1920) 1385114344 -1.3729626015574232 treat image : temp/1758295230_2475663_1385114343_990f7e01a4c68c320ce24d88e20f523b.jpg resize: (1080, 1920) 1385114343 -2.4687403724721855 treat image : temp/1758295230_2475663_1385114341_465cf7b0f1f5c2451d4e25cb6f64d062.jpg resize: (1080, 1920) 1385114341 -0.06164528401210387 treat image : temp/1758295230_2475663_1385114338_bb63c009cd67e407a246ece485d38153.jpg resize: (1080, 1920) 1385114338 -1.9349262472825035 treat image : temp/1758295230_2475663_1385114297_6e20b1f50164224bfcad25de20aa6a0a.jpg resize: (1080, 1920) 1385114297 -1.5746031978977397 treat image : temp/1758295230_2475663_1385114296_5182fcb591be217a7ec8c1ec0bc9b639.jpg resize: (1080, 1920) 1385114296 -2.837376183628796 treat image : temp/1758295230_2475663_1385114294_764db71ef9c4d30ea1dffb4367aa27fd.jpg resize: (1080, 1920) 1385114294 -1.611207566233524 treat image : temp/1758295230_2475663_1385114290_adc7283189f9f9c43eaa0bb003f6578b.jpg resize: (1080, 1920) 1385114290 -0.9734266308578204 treat image : temp/1758295230_2475663_1385114288_5dd8d73ba5e8079aeb027224672d2cb7.jpg resize: (1080, 1920) 1385114288 -1.457380371799785 treat image : temp/1758295230_2475663_1385114285_fcbd7165e82f5e9a36c110ef13ae3721.jpg resize: (1080, 1920) 1385114285 -2.442688213295491 treat image : temp/1758295230_2475663_1385114441_af22438e64ff09118aeb7f04d7af2157_rle_crop_3968015389_0.png resize: (63, 78) 1385122615 -3.3828933395213796 treat image : temp/1758295230_2475663_1385114441_af22438e64ff09118aeb7f04d7af2157_rle_crop_3968015390_0.png resize: (127, 149) 1385122616 -3.1377779612021315 treat image : temp/1758295230_2475663_1385114441_af22438e64ff09118aeb7f04d7af2157_rle_crop_3968015391_0.png resize: (43, 139) 1385122617 -2.424517222846568 treat image : temp/1758295230_2475663_1385114441_af22438e64ff09118aeb7f04d7af2157_rle_crop_3968015393_0.png resize: (160, 101) 1385122618 -0.681279697375897 treat image : temp/1758295230_2475663_1385114419_3f28186882a268251af96d62719005db_rle_crop_3968015395_0.png resize: (76, 59) 1385122620 -2.2413946460526377 treat image : temp/1758295230_2475663_1385114419_3f28186882a268251af96d62719005db_rle_crop_3968015396_0.png resize: (170, 111) 1385122621 -1.430670939376085 treat image : temp/1758295230_2475663_1385114417_0cb18d378b7c3fd42886f64ecebf273b_rle_crop_3968015397_0.png resize: (158, 115) 1385122622 -0.5516278105342746 treat image : temp/1758295230_2475663_1385114416_ef0c5ebc2ac9af188bdbf612bdc77c8f_rle_crop_3968015400_0.png resize: (89, 116) 1385122624 -2.0693089812842436 treat image : temp/1758295230_2475663_1385114416_ef0c5ebc2ac9af188bdbf612bdc77c8f_rle_crop_3968015401_0.png resize: (165, 110) 1385122625 -0.7028033995016618 treat image : temp/1758295230_2475663_1385114414_abcbbaaad0b18935c8e73820d7d5d4f4_rle_crop_3968015404_0.png resize: (187, 113) 1385122626 -0.29746289235138546 treat image : temp/1758295230_2475663_1385114414_abcbbaaad0b18935c8e73820d7d5d4f4_rle_crop_3968015405_0.png resize: (141, 39) 1385122627 2.456810248306064 treat image : temp/1758295230_2475663_1385114389_29604bb5e396815b7d6701121c512543_rle_crop_3968015410_0.png resize: (179, 108) 1385122629 -0.2647509482928114 treat image : temp/1758295230_2475663_1385114387_7dd9904395e490ea4d27002584931517_rle_crop_3968015413_0.png resize: (142, 146) 1385122630 -0.4964664061133521 treat image : temp/1758295230_2475663_1385114387_7dd9904395e490ea4d27002584931517_rle_crop_3968015414_0.png resize: (140, 109) 1385122632 -0.6493476734085516 treat image : temp/1758295230_2475663_1385114385_66f4fce08f23410c56fed55665c7a81e_rle_crop_3968015418_0.png resize: (181, 124) 1385122634 -0.8781289945241435 treat image : temp/1758295230_2475663_1385114382_32bdb283090095beba68538719a58c5a_rle_crop_3968015420_0.png resize: (164, 99) 1385122635 -0.6079175135032323 treat image : temp/1758295230_2475663_1385114378_e8b1fc670abc660ff3515d338883160f_rle_crop_3968015423_0.png resize: (152, 104) 1385122636 -0.8942276694446366 treat image : temp/1758295230_2475663_1385114376_f8b7f8319ab8631017901bc69833d530_rle_crop_3968015428_0.png resize: (177, 112) 1385122637 -0.711410182749183 treat image : temp/1758295230_2475663_1385114370_56c28f0fa13607092479e460f29709b8_rle_crop_3968015433_0.png resize: (162, 91) 1385122639 -1.402911421934197 treat image : temp/1758295230_2475663_1385114370_56c28f0fa13607092479e460f29709b8_rle_crop_3968015434_0.png resize: (110, 59) 1385122640 -1.2979441514606584 treat image : temp/1758295230_2475663_1385114367_85ea78b695e9ee7bad35e0d963537d3e_rle_crop_3968015436_0.png resize: (171, 117) 1385122641 -0.8135003045494207 treat image : temp/1758295230_2475663_1385114367_85ea78b695e9ee7bad35e0d963537d3e_rle_crop_3968015438_0.png resize: (79, 75) 1385122643 -0.6405263088319508 treat image : temp/1758295230_2475663_1385114366_ab56666be0f185d57d9f1ef57dd01262_rle_crop_3968015441_0.png resize: (158, 115) 1385122644 -2.1990689393440053 treat image : temp/1758295230_2475663_1385114363_9e886673c914a7eecc2f7741cc383256_rle_crop_3968015442_0.png resize: (137, 111) 1385122645 -0.7009494317707894 treat image : temp/1758295230_2475663_1385114363_9e886673c914a7eecc2f7741cc383256_rle_crop_3968015443_0.png resize: (38, 88) 1385122646 -1.8177496570076366 treat image : temp/1758295230_2475663_1385114363_9e886673c914a7eecc2f7741cc383256_rle_crop_3968015444_0.png resize: (83, 83) 1385122648 -0.6446782726697773 treat image : temp/1758295230_2475663_1385114360_76fe50434518779268b727c4a1ca0077_rle_crop_3968015448_0.png resize: (168, 102) 1385122649 -1.1696708717483781 treat image : temp/1758295230_2475663_1385114360_76fe50434518779268b727c4a1ca0077_rle_crop_3968015449_0.png resize: (138, 42) 1385122650 0.22069588165515838 treat image : temp/1758295230_2475663_1385114360_76fe50434518779268b727c4a1ca0077_rle_crop_3968015450_0.png resize: (59, 116) 1385122652 2.2468546979026707 treat image : temp/1758295230_2475663_1385114356_889b91e3911be19b00cebed63a1fb16c_rle_crop_3968015453_0.png resize: (173, 114) 1385122653 -0.920721681247286 treat image : temp/1758295230_2475663_1385114356_889b91e3911be19b00cebed63a1fb16c_rle_crop_3968015458_0.png resize: (264, 165) 1385122654 -1.5932834503097708 treat image : temp/1758295230_2475663_1385114347_b61031f6093f35441705554610da3549_rle_crop_3968015459_0.png resize: (155, 112) 1385122655 -0.7117370842574378 treat image : temp/1758295230_2475663_1385114345_a7f70a85b5be2521369b672a4105609e_rle_crop_3968015462_0.png resize: (171, 120) 1385122657 -0.9734349055246704 treat image : temp/1758295230_2475663_1385114344_09c6acb669682cb688362eceb565ae0c_rle_crop_3968015467_0.png resize: (175, 113) 1385122658 -0.5981765473292742 treat image : temp/1758295230_2475663_1385114344_09c6acb669682cb688362eceb565ae0c_rle_crop_3968015470_0.png resize: (149, 142) 1385122659 -0.3904353232718777 treat image : temp/1758295230_2475663_1385114343_990f7e01a4c68c320ce24d88e20f523b_rle_crop_3968015474_0.png resize: (55, 106) 1385122661 -1.107879235072387 treat image : temp/1758295230_2475663_1385114341_465cf7b0f1f5c2451d4e25cb6f64d062_rle_crop_3968015475_0.png resize: (145, 60) 1385122662 -0.9764438163048949 treat image : temp/1758295230_2475663_1385114341_465cf7b0f1f5c2451d4e25cb6f64d062_rle_crop_3968015476_0.png resize: (153, 76) 1385122663 -0.24720803722870283 treat image : temp/1758295230_2475663_1385114341_465cf7b0f1f5c2451d4e25cb6f64d062_rle_crop_3968015477_0.png resize: (170, 97) 1385122664 -2.979972583483631 treat image : temp/1758295230_2475663_1385114338_bb63c009cd67e407a246ece485d38153_rle_crop_3968015479_0.png resize: (73, 148) 1385122666 -1.0373401511658848 treat image : temp/1758295230_2475663_1385114297_6e20b1f50164224bfcad25de20aa6a0a_rle_crop_3968015480_0.png resize: (171, 112) 1385122667 -1.2912803851767263 treat image : temp/1758295230_2475663_1385114296_5182fcb591be217a7ec8c1ec0bc9b639_rle_crop_3968015484_0.png resize: (157, 116) 1385122668 -0.6249588090028757 treat image : temp/1758295230_2475663_1385114294_764db71ef9c4d30ea1dffb4367aa27fd_rle_crop_3968015488_0.png resize: (58, 98) 1385122670 -2.6601480491311906 treat image : temp/1758295230_2475663_1385114294_764db71ef9c4d30ea1dffb4367aa27fd_rle_crop_3968015490_0.png resize: (172, 68) 1385122671 -0.6870057274850048 treat image : temp/1758295230_2475663_1385114290_adc7283189f9f9c43eaa0bb003f6578b_rle_crop_3968015491_0.png resize: (168, 110) 1385122672 -0.5875701101241575 treat image : temp/1758295230_2475663_1385114288_5dd8d73ba5e8079aeb027224672d2cb7_rle_crop_3968015492_0.png resize: (170, 112) 1385122673 -0.7790753992022883 treat image : temp/1758295230_2475663_1385114285_fcbd7165e82f5e9a36c110ef13ae3721_rle_crop_3968015494_0.png resize: (137, 47) 1385122675 -0.2799901671166015 treat image : temp/1758295230_2475663_1385114285_fcbd7165e82f5e9a36c110ef13ae3721_rle_crop_3968015495_0.png resize: (158, 114) 1385122676 -0.7767774406788769 treat image : temp/1758295230_2475663_1385114417_0cb18d378b7c3fd42886f64ecebf273b_rle_crop_3968015399_0.png resize: (132, 107) 1385122703 -1.2880508707748892 treat image : temp/1758295230_2475663_1385114385_66f4fce08f23410c56fed55665c7a81e_rle_crop_3968015419_0.png resize: (184, 86) 1385122705 -1.179978809208524 treat image : temp/1758295230_2475663_1385114382_32bdb283090095beba68538719a58c5a_rle_crop_3968015421_0.png resize: (92, 91) 1385122706 -1.6826116472873378 treat image : temp/1758295230_2475663_1385114376_f8b7f8319ab8631017901bc69833d530_rle_crop_3968015430_0.png resize: (134, 102) 1385122707 -0.9290018137691848 treat image : temp/1758295230_2475663_1385114367_85ea78b695e9ee7bad35e0d963537d3e_rle_crop_3968015437_0.png resize: (212, 135) 1385122709 -1.1995109255123042 treat image : temp/1758295230_2475663_1385114356_889b91e3911be19b00cebed63a1fb16c_rle_crop_3968015456_0.png resize: (47, 113) 1385122710 2.6355732016617357 treat image : temp/1758295230_2475663_1385114344_09c6acb669682cb688362eceb565ae0c_rle_crop_3968015468_0.png resize: (116, 91) 1385122711 -1.107156449054671 treat image : temp/1758295230_2475663_1385114296_5182fcb591be217a7ec8c1ec0bc9b639_rle_crop_3968015483_0.png resize: (117, 66) 1385122712 1.3025620837015288 treat image : temp/1758295230_2475663_1385114294_764db71ef9c4d30ea1dffb4367aa27fd_rle_crop_3968015489_0.png resize: (72, 120) 1385122714 -1.9390659167384694 treat image : temp/1758295230_2475663_1385114416_ef0c5ebc2ac9af188bdbf612bdc77c8f_rle_crop_3968015402_0.png resize: (116, 83) 1385122726 -0.7752462106013601 treat image : temp/1758295230_2475663_1385114356_889b91e3911be19b00cebed63a1fb16c_rle_crop_3968015451_0.png resize: (110, 128) 1385122728 -1.173889124884046 treat image : temp/1758295230_2475663_1385114356_889b91e3911be19b00cebed63a1fb16c_rle_crop_3968015454_0.png resize: (84, 90) 1385122729 0.4317073934267015 treat image : temp/1758295230_2475663_1385114347_b61031f6093f35441705554610da3549_rle_crop_3968015460_0.png resize: (97, 92) 1385122730 -0.7593448825156507 treat image : temp/1758295230_2475663_1385114441_af22438e64ff09118aeb7f04d7af2157_rle_crop_3968015392_0.png resize: (536, 336) 1385122774 -0.39161250727355074 treat image : temp/1758295230_2475663_1385114417_0cb18d378b7c3fd42886f64ecebf273b_rle_crop_3968015398_0.png resize: (73, 98) 1385122775 -2.237685281132275 treat image : temp/1758295230_2475663_1385114414_abcbbaaad0b18935c8e73820d7d5d4f4_rle_crop_3968015403_0.png resize: (104, 135) 1385122776 -0.98659693440712 treat image : temp/1758295230_2475663_1385114414_abcbbaaad0b18935c8e73820d7d5d4f4_rle_crop_3968015406_0.png resize: (500, 327) 1385122777 -0.567066011363178 treat image : temp/1758295230_2475663_1385114414_abcbbaaad0b18935c8e73820d7d5d4f4_rle_crop_3968015409_0.png resize: (1014, 1688) 1385122778 -2.3238890521509465 treat image : temp/1758295230_2475663_1385114389_29604bb5e396815b7d6701121c512543_rle_crop_3968015411_0.png resize: (551, 349) 1385122779 0.058072975923676044 treat image : temp/1758295230_2475663_1385114389_29604bb5e396815b7d6701121c512543_rle_crop_3968015412_0.png resize: (147, 274) 1385122780 -2.0500137220008408 treat image : temp/1758295230_2475663_1385114387_7dd9904395e490ea4d27002584931517_rle_crop_3968015415_0.png resize: (227, 149) 1385122781 -2.0928750302827273 treat image : temp/1758295230_2475663_1385114387_7dd9904395e490ea4d27002584931517_rle_crop_3968015417_0.png resize: (152, 104) 1385122782 -2.026691924561655 treat image : temp/1758295230_2475663_1385114378_e8b1fc670abc660ff3515d338883160f_rle_crop_3968015424_0.png resize: (530, 361) 1385122783 -0.8443639860197552 treat image : temp/1758295230_2475663_1385114378_e8b1fc670abc660ff3515d338883160f_rle_crop_3968015425_0.png resize: (209, 148) 1385122784 -3.6182290416699514 treat image : temp/1758295230_2475663_1385114376_f8b7f8319ab8631017901bc69833d530_rle_crop_3968015427_0.png resize: (536, 329) 1385122785 0.4677470058787683 treat image : temp/1758295230_2475663_1385114376_f8b7f8319ab8631017901bc69833d530_rle_crop_3968015429_0.png resize: (904, 1046) 1385122786 0.3339133132836553 treat image : temp/1758295230_2475663_1385114376_f8b7f8319ab8631017901bc69833d530_rle_crop_3968015431_0.png resize: (164, 152) 1385122788 -2.7379827897798523 treat image : temp/1758295230_2475663_1385114370_56c28f0fa13607092479e460f29709b8_rle_crop_3968015432_0.png resize: (53, 74) 1385122789 -1.792632442222423 treat image : temp/1758295230_2475663_1385114370_56c28f0fa13607092479e460f29709b8_rle_crop_3968015435_0.png resize: (121, 76) 1385122790 0.3497612046970724 treat image : temp/1758295230_2475663_1385114367_85ea78b695e9ee7bad35e0d963537d3e_rle_crop_3968015439_0.png resize: (908, 1014) 1385122791 0.24284780194777594 treat image : temp/1758295230_2475663_1385114366_ab56666be0f185d57d9f1ef57dd01262_rle_crop_3968015440_0.png resize: (511, 322) 1385122792 -0.5792469169125799 treat image : temp/1758295230_2475663_1385114356_889b91e3911be19b00cebed63a1fb16c_rle_crop_3968015452_0.png resize: (157, 229) 1385122793 -2.0558536597128527 treat image : temp/1758295230_2475663_1385114356_889b91e3911be19b00cebed63a1fb16c_rle_crop_3968015455_0.png resize: (110, 94) 1385122794 -2.1255234932708227 treat image : temp/1758295230_2475663_1385114356_889b91e3911be19b00cebed63a1fb16c_rle_crop_3968015457_0.png resize: (1007, 1328) 1385122795 -0.8475346574648526 treat image : temp/1758295230_2475663_1385114347_b61031f6093f35441705554610da3549_rle_crop_3968015461_0.png resize: (195, 409) 1385122796 -1.6361057513271864 treat image : temp/1758295230_2475663_1385114345_a7f70a85b5be2521369b672a4105609e_rle_crop_3968015464_0.png resize: (578, 347) 1385122797 0.0642594870031805 treat image : temp/1758295230_2475663_1385114345_a7f70a85b5be2521369b672a4105609e_rle_crop_3968015465_0.png resize: (151, 58) 1385122798 -4.508458057196875 treat image : temp/1758295230_2475663_1385114345_a7f70a85b5be2521369b672a4105609e_rle_crop_3968015466_0.png resize: (84, 146) 1385122799 -1.4484650185999062 treat image : temp/1758295230_2475663_1385114344_09c6acb669682cb688362eceb565ae0c_rle_crop_3968015469_0.png resize: (467, 317) 1385122800 -2.124083285502477 treat image : temp/1758295230_2475663_1385114344_09c6acb669682cb688362eceb565ae0c_rle_crop_3968015471_0.png resize: (990, 1664) 1385122801 -2.0428295075154286 treat image : temp/1758295230_2475663_1385114343_990f7e01a4c68c320ce24d88e20f523b_rle_crop_3968015473_0.png resize: (103, 117) 1385122802 -0.6512147015153232 treat image : temp/1758295230_2475663_1385114338_bb63c009cd67e407a246ece485d38153_rle_crop_3968015478_0.png resize: (470, 337) 1385122803 -0.29912718729150584 treat image : temp/1758295230_2475663_1385114297_6e20b1f50164224bfcad25de20aa6a0a_rle_crop_3968015481_0.png resize: (508, 336) 1385122804 -0.551466810516164 treat image : temp/1758295230_2475663_1385114296_5182fcb591be217a7ec8c1ec0bc9b639_rle_crop_3968015485_0.png resize: (140, 139) 1385122805 -4.2518192216303845 treat image : temp/1758295230_2475663_1385114294_764db71ef9c4d30ea1dffb4367aa27fd_rle_crop_3968015486_0.png resize: (229, 193) 1385122806 -2.469117158169269 treat image : temp/1758295230_2475663_1385114294_764db71ef9c4d30ea1dffb4367aa27fd_rle_crop_3968015487_0.png resize: (111, 117) 1385122807 -1.9354114136659761 treat image : temp/1758295230_2475663_1385114288_5dd8d73ba5e8079aeb027224672d2cb7_rle_crop_3968015493_0.png resize: (61, 70) 1385122808 -3.2418349973950207 treat image : temp/1758295230_2475663_1385114285_fcbd7165e82f5e9a36c110ef13ae3721_rle_crop_3968015496_0.png resize: (115, 155) 1385122809 -2.0092177954973773 treat image : temp/1758295230_2475663_1385114441_af22438e64ff09118aeb7f04d7af2157_rle_crop_3968015394_0.png resize: (55, 135) 1385122813 -4.578279387951654 treat image : temp/1758295230_2475663_1385114414_abcbbaaad0b18935c8e73820d7d5d4f4_rle_crop_3968015407_0.png resize: (45, 76) 1385122814 -1.5428241657032526 treat image : temp/1758295230_2475663_1385114414_abcbbaaad0b18935c8e73820d7d5d4f4_rle_crop_3968015408_0.png resize: (82, 79) 1385122815 -0.33365834248650317 treat image : temp/1758295230_2475663_1385114387_7dd9904395e490ea4d27002584931517_rle_crop_3968015416_0.png resize: (60, 62) 1385122816 0.5479340871159731 treat image : temp/1758295230_2475663_1385114378_e8b1fc670abc660ff3515d338883160f_rle_crop_3968015422_0.png resize: (67, 79) 1385122817 0.4797919952087961 treat image : temp/1758295230_2475663_1385114378_e8b1fc670abc660ff3515d338883160f_rle_crop_3968015426_0.png resize: (133, 159) 1385122818 -0.35006881523485034 treat image : temp/1758295230_2475663_1385114363_9e886673c914a7eecc2f7741cc383256_rle_crop_3968015445_0.png resize: (32, 68) 1385122819 -2.681398745690593 treat image : temp/1758295230_2475663_1385114363_9e886673c914a7eecc2f7741cc383256_rle_crop_3968015446_0.png resize: (70, 63) 1385122820 -2.802619329751303 treat image : temp/1758295230_2475663_1385114360_76fe50434518779268b727c4a1ca0077_rle_crop_3968015447_0.png resize: (61, 80) 1385122821 -1.9159685995825955 treat image : temp/1758295230_2475663_1385114345_a7f70a85b5be2521369b672a4105609e_rle_crop_3968015463_0.png resize: (140, 135) 1385122822 -1.4303205127208745 treat image : temp/1758295230_2475663_1385114344_09c6acb669682cb688362eceb565ae0c_rle_crop_3968015472_0.png resize: (113, 112) 1385122823 -3.2479576034042448 treat image : temp/1758295230_2475663_1385114297_6e20b1f50164224bfcad25de20aa6a0a_rle_crop_3968015482_0.png resize: (52, 80) 1385122824 0.7333413920185153 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 137 time used for this insertion : 0.022682905197143555 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 137 time used for this insertion : 0.03040027618408203 save missing photos in datou_result : time spend for datou_step_exec : 26.75043225288391 time spend to save output : 0.05873537063598633 total time spend for step 6 : 26.809167623519897 step7:brightness Fri Sep 19 17:23:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1758295230_2475663_1385114441_af22438e64ff09118aeb7f04d7af2157.jpg treat image : temp/1758295230_2475663_1385114419_3f28186882a268251af96d62719005db.jpg treat image : temp/1758295230_2475663_1385114417_0cb18d378b7c3fd42886f64ecebf273b.jpg treat image : temp/1758295230_2475663_1385114416_ef0c5ebc2ac9af188bdbf612bdc77c8f.jpg treat image : temp/1758295230_2475663_1385114414_abcbbaaad0b18935c8e73820d7d5d4f4.jpg treat image : temp/1758295230_2475663_1385114389_29604bb5e396815b7d6701121c512543.jpg treat image : temp/1758295230_2475663_1385114387_7dd9904395e490ea4d27002584931517.jpg treat image : temp/1758295230_2475663_1385114385_66f4fce08f23410c56fed55665c7a81e.jpg treat image : temp/1758295230_2475663_1385114382_32bdb283090095beba68538719a58c5a.jpg treat image : temp/1758295230_2475663_1385114378_e8b1fc670abc660ff3515d338883160f.jpg treat image : temp/1758295230_2475663_1385114376_f8b7f8319ab8631017901bc69833d530.jpg treat image : temp/1758295230_2475663_1385114370_56c28f0fa13607092479e460f29709b8.jpg treat image : temp/1758295230_2475663_1385114367_85ea78b695e9ee7bad35e0d963537d3e.jpg treat image : temp/1758295230_2475663_1385114366_ab56666be0f185d57d9f1ef57dd01262.jpg treat image : temp/1758295230_2475663_1385114363_9e886673c914a7eecc2f7741cc383256.jpg treat image : temp/1758295230_2475663_1385114360_76fe50434518779268b727c4a1ca0077.jpg treat image : temp/1758295230_2475663_1385114356_889b91e3911be19b00cebed63a1fb16c.jpg treat image : temp/1758295230_2475663_1385114347_b61031f6093f35441705554610da3549.jpg treat image : temp/1758295230_2475663_1385114345_a7f70a85b5be2521369b672a4105609e.jpg treat image : temp/1758295230_2475663_1385114344_09c6acb669682cb688362eceb565ae0c.jpg treat image : temp/1758295230_2475663_1385114343_990f7e01a4c68c320ce24d88e20f523b.jpg treat image : temp/1758295230_2475663_1385114341_465cf7b0f1f5c2451d4e25cb6f64d062.jpg treat image : temp/1758295230_2475663_1385114338_bb63c009cd67e407a246ece485d38153.jpg treat image : temp/1758295230_2475663_1385114297_6e20b1f50164224bfcad25de20aa6a0a.jpg treat image : temp/1758295230_2475663_1385114296_5182fcb591be217a7ec8c1ec0bc9b639.jpg treat image : temp/1758295230_2475663_1385114294_764db71ef9c4d30ea1dffb4367aa27fd.jpg treat image : temp/1758295230_2475663_1385114290_adc7283189f9f9c43eaa0bb003f6578b.jpg treat image : temp/1758295230_2475663_1385114288_5dd8d73ba5e8079aeb027224672d2cb7.jpg treat image : temp/1758295230_2475663_1385114285_fcbd7165e82f5e9a36c110ef13ae3721.jpg treat image : temp/1758295230_2475663_1385114441_af22438e64ff09118aeb7f04d7af2157_rle_crop_3968015389_0.png treat image : temp/1758295230_2475663_1385114441_af22438e64ff09118aeb7f04d7af2157_rle_crop_3968015390_0.png treat image : temp/1758295230_2475663_1385114441_af22438e64ff09118aeb7f04d7af2157_rle_crop_3968015391_0.png treat image : temp/1758295230_2475663_1385114441_af22438e64ff09118aeb7f04d7af2157_rle_crop_3968015393_0.png treat image : temp/1758295230_2475663_1385114419_3f28186882a268251af96d62719005db_rle_crop_3968015395_0.png treat image : temp/1758295230_2475663_1385114419_3f28186882a268251af96d62719005db_rle_crop_3968015396_0.png treat image : temp/1758295230_2475663_1385114417_0cb18d378b7c3fd42886f64ecebf273b_rle_crop_3968015397_0.png treat image : temp/1758295230_2475663_1385114416_ef0c5ebc2ac9af188bdbf612bdc77c8f_rle_crop_3968015400_0.png treat image : temp/1758295230_2475663_1385114416_ef0c5ebc2ac9af188bdbf612bdc77c8f_rle_crop_3968015401_0.png treat image : temp/1758295230_2475663_1385114414_abcbbaaad0b18935c8e73820d7d5d4f4_rle_crop_3968015404_0.png treat image : temp/1758295230_2475663_1385114414_abcbbaaad0b18935c8e73820d7d5d4f4_rle_crop_3968015405_0.png treat image : temp/1758295230_2475663_1385114389_29604bb5e396815b7d6701121c512543_rle_crop_3968015410_0.png treat image : temp/1758295230_2475663_1385114387_7dd9904395e490ea4d27002584931517_rle_crop_3968015413_0.png treat image : temp/1758295230_2475663_1385114387_7dd9904395e490ea4d27002584931517_rle_crop_3968015414_0.png treat image : temp/1758295230_2475663_1385114385_66f4fce08f23410c56fed55665c7a81e_rle_crop_3968015418_0.png treat image : temp/1758295230_2475663_1385114382_32bdb283090095beba68538719a58c5a_rle_crop_3968015420_0.png treat image : temp/1758295230_2475663_1385114378_e8b1fc670abc660ff3515d338883160f_rle_crop_3968015423_0.png treat image : temp/1758295230_2475663_1385114376_f8b7f8319ab8631017901bc69833d530_rle_crop_3968015428_0.png treat image : temp/1758295230_2475663_1385114370_56c28f0fa13607092479e460f29709b8_rle_crop_3968015433_0.png treat image : temp/1758295230_2475663_1385114370_56c28f0fa13607092479e460f29709b8_rle_crop_3968015434_0.png treat image : temp/1758295230_2475663_1385114367_85ea78b695e9ee7bad35e0d963537d3e_rle_crop_3968015436_0.png treat image : temp/1758295230_2475663_1385114367_85ea78b695e9ee7bad35e0d963537d3e_rle_crop_3968015438_0.png treat image : temp/1758295230_2475663_1385114366_ab56666be0f185d57d9f1ef57dd01262_rle_crop_3968015441_0.png treat image : temp/1758295230_2475663_1385114363_9e886673c914a7eecc2f7741cc383256_rle_crop_3968015442_0.png treat image : temp/1758295230_2475663_1385114363_9e886673c914a7eecc2f7741cc383256_rle_crop_3968015443_0.png treat image : temp/1758295230_2475663_1385114363_9e886673c914a7eecc2f7741cc383256_rle_crop_3968015444_0.png treat image : temp/1758295230_2475663_1385114360_76fe50434518779268b727c4a1ca0077_rle_crop_3968015448_0.png treat image : temp/1758295230_2475663_1385114360_76fe50434518779268b727c4a1ca0077_rle_crop_3968015449_0.png treat image : temp/1758295230_2475663_1385114360_76fe50434518779268b727c4a1ca0077_rle_crop_3968015450_0.png treat image : temp/1758295230_2475663_1385114356_889b91e3911be19b00cebed63a1fb16c_rle_crop_3968015453_0.png treat image : temp/1758295230_2475663_1385114356_889b91e3911be19b00cebed63a1fb16c_rle_crop_3968015458_0.png treat image : temp/1758295230_2475663_1385114347_b61031f6093f35441705554610da3549_rle_crop_3968015459_0.png treat image : temp/1758295230_2475663_1385114345_a7f70a85b5be2521369b672a4105609e_rle_crop_3968015462_0.png treat image : temp/1758295230_2475663_1385114344_09c6acb669682cb688362eceb565ae0c_rle_crop_3968015467_0.png treat image : temp/1758295230_2475663_1385114344_09c6acb669682cb688362eceb565ae0c_rle_crop_3968015470_0.png treat image : temp/1758295230_2475663_1385114343_990f7e01a4c68c320ce24d88e20f523b_rle_crop_3968015474_0.png treat image : temp/1758295230_2475663_1385114341_465cf7b0f1f5c2451d4e25cb6f64d062_rle_crop_3968015475_0.png treat image : temp/1758295230_2475663_1385114341_465cf7b0f1f5c2451d4e25cb6f64d062_rle_crop_3968015476_0.png treat image : temp/1758295230_2475663_1385114341_465cf7b0f1f5c2451d4e25cb6f64d062_rle_crop_3968015477_0.png treat image : temp/1758295230_2475663_1385114338_bb63c009cd67e407a246ece485d38153_rle_crop_3968015479_0.png treat image : temp/1758295230_2475663_1385114297_6e20b1f50164224bfcad25de20aa6a0a_rle_crop_3968015480_0.png treat image : temp/1758295230_2475663_1385114296_5182fcb591be217a7ec8c1ec0bc9b639_rle_crop_3968015484_0.png treat image : temp/1758295230_2475663_1385114294_764db71ef9c4d30ea1dffb4367aa27fd_rle_crop_3968015488_0.png treat image : temp/1758295230_2475663_1385114294_764db71ef9c4d30ea1dffb4367aa27fd_rle_crop_3968015490_0.png treat image : temp/1758295230_2475663_1385114290_adc7283189f9f9c43eaa0bb003f6578b_rle_crop_3968015491_0.png treat image : temp/1758295230_2475663_1385114288_5dd8d73ba5e8079aeb027224672d2cb7_rle_crop_3968015492_0.png treat image : temp/1758295230_2475663_1385114285_fcbd7165e82f5e9a36c110ef13ae3721_rle_crop_3968015494_0.png treat image : temp/1758295230_2475663_1385114285_fcbd7165e82f5e9a36c110ef13ae3721_rle_crop_3968015495_0.png treat image : temp/1758295230_2475663_1385114417_0cb18d378b7c3fd42886f64ecebf273b_rle_crop_3968015399_0.png treat image : temp/1758295230_2475663_1385114385_66f4fce08f23410c56fed55665c7a81e_rle_crop_3968015419_0.png treat image : temp/1758295230_2475663_1385114382_32bdb283090095beba68538719a58c5a_rle_crop_3968015421_0.png treat image : temp/1758295230_2475663_1385114376_f8b7f8319ab8631017901bc69833d530_rle_crop_3968015430_0.png treat image : temp/1758295230_2475663_1385114367_85ea78b695e9ee7bad35e0d963537d3e_rle_crop_3968015437_0.png treat image : temp/1758295230_2475663_1385114356_889b91e3911be19b00cebed63a1fb16c_rle_crop_3968015456_0.png treat image : temp/1758295230_2475663_1385114344_09c6acb669682cb688362eceb565ae0c_rle_crop_3968015468_0.png treat image : temp/1758295230_2475663_1385114296_5182fcb591be217a7ec8c1ec0bc9b639_rle_crop_3968015483_0.png treat image : temp/1758295230_2475663_1385114294_764db71ef9c4d30ea1dffb4367aa27fd_rle_crop_3968015489_0.png treat image : temp/1758295230_2475663_1385114416_ef0c5ebc2ac9af188bdbf612bdc77c8f_rle_crop_3968015402_0.png treat image : temp/1758295230_2475663_1385114356_889b91e3911be19b00cebed63a1fb16c_rle_crop_3968015451_0.png treat image : temp/1758295230_2475663_1385114356_889b91e3911be19b00cebed63a1fb16c_rle_crop_3968015454_0.png treat image : temp/1758295230_2475663_1385114347_b61031f6093f35441705554610da3549_rle_crop_3968015460_0.png treat image : temp/1758295230_2475663_1385114441_af22438e64ff09118aeb7f04d7af2157_rle_crop_3968015392_0.png treat image : temp/1758295230_2475663_1385114417_0cb18d378b7c3fd42886f64ecebf273b_rle_crop_3968015398_0.png treat image : temp/1758295230_2475663_1385114414_abcbbaaad0b18935c8e73820d7d5d4f4_rle_crop_3968015403_0.png treat image : temp/1758295230_2475663_1385114414_abcbbaaad0b18935c8e73820d7d5d4f4_rle_crop_3968015406_0.png treat image : temp/1758295230_2475663_1385114414_abcbbaaad0b18935c8e73820d7d5d4f4_rle_crop_3968015409_0.png treat image : temp/1758295230_2475663_1385114389_29604bb5e396815b7d6701121c512543_rle_crop_3968015411_0.png treat image : temp/1758295230_2475663_1385114389_29604bb5e396815b7d6701121c512543_rle_crop_3968015412_0.png treat image : temp/1758295230_2475663_1385114387_7dd9904395e490ea4d27002584931517_rle_crop_3968015415_0.png treat image : temp/1758295230_2475663_1385114387_7dd9904395e490ea4d27002584931517_rle_crop_3968015417_0.png treat image : temp/1758295230_2475663_1385114378_e8b1fc670abc660ff3515d338883160f_rle_crop_3968015424_0.png treat image : temp/1758295230_2475663_1385114378_e8b1fc670abc660ff3515d338883160f_rle_crop_3968015425_0.png treat image : temp/1758295230_2475663_1385114376_f8b7f8319ab8631017901bc69833d530_rle_crop_3968015427_0.png treat image : temp/1758295230_2475663_1385114376_f8b7f8319ab8631017901bc69833d530_rle_crop_3968015429_0.png treat image : temp/1758295230_2475663_1385114376_f8b7f8319ab8631017901bc69833d530_rle_crop_3968015431_0.png treat image : temp/1758295230_2475663_1385114370_56c28f0fa13607092479e460f29709b8_rle_crop_3968015432_0.png treat image : temp/1758295230_2475663_1385114370_56c28f0fa13607092479e460f29709b8_rle_crop_3968015435_0.png treat image : temp/1758295230_2475663_1385114367_85ea78b695e9ee7bad35e0d963537d3e_rle_crop_3968015439_0.png treat image : temp/1758295230_2475663_1385114366_ab56666be0f185d57d9f1ef57dd01262_rle_crop_3968015440_0.png treat image : temp/1758295230_2475663_1385114356_889b91e3911be19b00cebed63a1fb16c_rle_crop_3968015452_0.png treat image : temp/1758295230_2475663_1385114356_889b91e3911be19b00cebed63a1fb16c_rle_crop_3968015455_0.png treat image : temp/1758295230_2475663_1385114356_889b91e3911be19b00cebed63a1fb16c_rle_crop_3968015457_0.png treat image : temp/1758295230_2475663_1385114347_b61031f6093f35441705554610da3549_rle_crop_3968015461_0.png treat image : temp/1758295230_2475663_1385114345_a7f70a85b5be2521369b672a4105609e_rle_crop_3968015464_0.png treat image : temp/1758295230_2475663_1385114345_a7f70a85b5be2521369b672a4105609e_rle_crop_3968015465_0.png treat image : temp/1758295230_2475663_1385114345_a7f70a85b5be2521369b672a4105609e_rle_crop_3968015466_0.png treat image : temp/1758295230_2475663_1385114344_09c6acb669682cb688362eceb565ae0c_rle_crop_3968015469_0.png treat image : temp/1758295230_2475663_1385114344_09c6acb669682cb688362eceb565ae0c_rle_crop_3968015471_0.png treat image : temp/1758295230_2475663_1385114343_990f7e01a4c68c320ce24d88e20f523b_rle_crop_3968015473_0.png treat image : temp/1758295230_2475663_1385114338_bb63c009cd67e407a246ece485d38153_rle_crop_3968015478_0.png treat image : temp/1758295230_2475663_1385114297_6e20b1f50164224bfcad25de20aa6a0a_rle_crop_3968015481_0.png treat image : temp/1758295230_2475663_1385114296_5182fcb591be217a7ec8c1ec0bc9b639_rle_crop_3968015485_0.png treat image : temp/1758295230_2475663_1385114294_764db71ef9c4d30ea1dffb4367aa27fd_rle_crop_3968015486_0.png treat image : temp/1758295230_2475663_1385114294_764db71ef9c4d30ea1dffb4367aa27fd_rle_crop_3968015487_0.png treat image : temp/1758295230_2475663_1385114288_5dd8d73ba5e8079aeb027224672d2cb7_rle_crop_3968015493_0.png treat image : temp/1758295230_2475663_1385114285_fcbd7165e82f5e9a36c110ef13ae3721_rle_crop_3968015496_0.png treat image : temp/1758295230_2475663_1385114441_af22438e64ff09118aeb7f04d7af2157_rle_crop_3968015394_0.png treat image : temp/1758295230_2475663_1385114414_abcbbaaad0b18935c8e73820d7d5d4f4_rle_crop_3968015407_0.png treat image : temp/1758295230_2475663_1385114414_abcbbaaad0b18935c8e73820d7d5d4f4_rle_crop_3968015408_0.png treat image : temp/1758295230_2475663_1385114387_7dd9904395e490ea4d27002584931517_rle_crop_3968015416_0.png treat image : temp/1758295230_2475663_1385114378_e8b1fc670abc660ff3515d338883160f_rle_crop_3968015422_0.png treat image : temp/1758295230_2475663_1385114378_e8b1fc670abc660ff3515d338883160f_rle_crop_3968015426_0.png treat image : temp/1758295230_2475663_1385114363_9e886673c914a7eecc2f7741cc383256_rle_crop_3968015445_0.png treat image : temp/1758295230_2475663_1385114363_9e886673c914a7eecc2f7741cc383256_rle_crop_3968015446_0.png treat image : temp/1758295230_2475663_1385114360_76fe50434518779268b727c4a1ca0077_rle_crop_3968015447_0.png treat image : temp/1758295230_2475663_1385114345_a7f70a85b5be2521369b672a4105609e_rle_crop_3968015463_0.png treat image : temp/1758295230_2475663_1385114344_09c6acb669682cb688362eceb565ae0c_rle_crop_3968015472_0.png treat image : temp/1758295230_2475663_1385114297_6e20b1f50164224bfcad25de20aa6a0a_rle_crop_3968015482_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 137 time used for this insertion : 0.018431901931762695 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 137 time used for this insertion : 0.029967546463012695 save missing photos in datou_result : time spend for datou_step_exec : 7.451278448104858 time spend to save output : 0.054024457931518555 total time spend for step 7 : 7.505302906036377 step8:velours_tree Fri Sep 19 17:23:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.27573442459106445 time spend to save output : 5.340576171875e-05 total time spend for step 8 : 0.2757878303527832 step9:send_mail_cod Fri Sep 19 17:23:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27045522_19-09-2025_17_23_38.pdf 27045732 imagette270457321758295418 27045733 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette270457331758295418 27045735 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette270457351758295420 27045736 imagette270457361758295422 27045737 change filename to text .change filename to text .change filename to text .change filename to text .imagette270457371758295422 27045738 imagette270457381758295423 27045739 imagette270457391758295423 27045740 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette270457401758295423 27045741 imagette270457411758295424 27045742 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette270457421758295424 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27045522 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27045732,27045733,27045734,27045735,27045736,27045737,27045738,27045739,27045740,27045741,27045742?tags=pehd,papier,environnement,pet_clair,background,metal,pet_fonce,mal_croppe,autre,flou,carton args[1385114441] : ((1385114441, -4.493297727452069, 492609224), (1385114441, 0.2310049667545, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114419] : ((1385114419, -2.709885815842123, 492609224), (1385114419, 0.5629556363765479, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114417] : ((1385114417, -0.7440781496001609, 492688767), (1385114417, 0.32171198857695876, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114416] : ((1385114416, -2.464843884781539, 492609224), (1385114416, 0.3672757483424521, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114414] : ((1385114414, -1.3359000768091656, 492688767), (1385114414, 0.3961173544544374, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114389] : ((1385114389, -1.7338418096780788, 492688767), (1385114389, 0.4490086220426359, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114387] : ((1385114387, -2.0986552871541146, 492609224), (1385114387, 0.42999760410813564, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114385] : ((1385114385, -0.7036927918155619, 492688767), (1385114385, 0.5317625730274336, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114382] : ((1385114382, -2.050903674292459, 492609224), (1385114382, 0.46911817327088756, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114378] : ((1385114378, -1.8481751240093554, 492688767), (1385114378, 0.3563821866042479, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114376] : ((1385114376, -1.8255778803809994, 492688767), (1385114376, 0.5311469433787495, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114370] : ((1385114370, -1.2901496776354713, 492688767), (1385114370, 0.4593855294718042, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114367] : ((1385114367, -2.2418614784819573, 492609224), (1385114367, 0.5197332531928126, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114366] : ((1385114366, -1.750120050484162, 492688767), (1385114366, 0.49416993464108977, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114363] : ((1385114363, -2.558481228024, 492609224), (1385114363, 0.498883651525475, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114360] : ((1385114360, -1.962238171277156, 492688767), (1385114360, 0.3045166256349382, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114356] : ((1385114356, -1.264998095657095, 492688767), (1385114356, 0.5215698842140454, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114347] : ((1385114347, -1.6389109677061229, 492688767), (1385114347, 0.29871172314563565, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114345] : ((1385114345, -2.5647025336512184, 492609224), (1385114345, 0.37922904843080313, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114344] : ((1385114344, -1.3729626015574232, 492688767), (1385114344, 0.37207424691810737, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114343] : ((1385114343, -2.4687403724721855, 492609224), (1385114343, 0.35579519052943087, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114341] : ((1385114341, -0.06164528401210387, 492688767), (1385114341, 0.42688186869996964, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114338] : ((1385114338, -1.9349262472825035, 492688767), (1385114338, 0.5107468298131711, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114297] : ((1385114297, -1.5746031978977397, 492688767), (1385114297, 0.43081199894521505, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114296] : ((1385114296, -2.837376183628796, 492609224), (1385114296, 0.25482894362171377, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114294] : ((1385114294, -1.611207566233524, 492688767), (1385114294, 0.29157092013018054, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114290] : ((1385114290, -0.9734266308578204, 492688767), (1385114290, 0.27957837018647896, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114288] : ((1385114288, -1.457380371799785, 492688767), (1385114288, 0.3529585600150085, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com args[1385114285] : ((1385114285, -2.442688213295491, 492609224), (1385114285, 0.45831740267731125, 2107752395), '0.12127429557790552') We are sending mail with results at report@fotonower.com refus_total : 0.12127429557790552 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27045522 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27045522_19-09-2025_17_23_38.pdf results_Auto_P27045522_19-09-2025_17_23_38.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27045522_19-09-2025_17_23_38.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27045522','results_Auto_P27045522_19-09-2025_17_23_38.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27045522_19-09-2025_17_23_38.pdf','pdf','','0.61','0.12127429557790552') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27045522

https://www.fotonower.com/image?json=false&list_photos_id=1385114441
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114419
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114417
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114416
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114414
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114389
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114387
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114385
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114382
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114378
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114376
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114370
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114367
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114366
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114363
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114360
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114356
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114347
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114345
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114344
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114343
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114341
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114338
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114297
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114296
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114294
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114290
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114288
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385114285
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.13%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/27045733?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/27045735?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/27045737?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/27045740?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/27045742?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27045522_19-09-2025_17_23_38.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27045732,27045733,27045734,27045735,27045736,27045737,27045738,27045739,27045740,27045741,27045742?tags=pehd,papier,environnement,pet_clair,background,metal,pet_fonce,mal_croppe,autre,flou,carton.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 19 Sep 2025 15:23:47 GMT Content-Length: 0 Connection: close X-Message-Id: v86tLC4zR8KNDivnLRKyyA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1385114441, 1385114419, 1385114417, 1385114416, 1385114414, 1385114389, 1385114387, 1385114385, 1385114382, 1385114378, 1385114376, 1385114370, 1385114367, 1385114366, 1385114363, 1385114360, 1385114356, 1385114347, 1385114345, 1385114344, 1385114343, 1385114341, 1385114338, 1385114297, 1385114296, 1385114294, 1385114290, 1385114288, 1385114285] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114441', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114419', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114417', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114416', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114414', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114389', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114387', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114385', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114382', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114378', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114376', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114370', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114367', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114366', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114363', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114360', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114356', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114347', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114345', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114344', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114343', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114341', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114338', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114297', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114296', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114294', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114290', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114288', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114285', None, None, None, None, None, '3747826') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 29 time used for this insertion : 0.018714189529418945 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.418620347976685 time spend to save output : 0.019052743911743164 total time spend for step 9 : 9.437673091888428 step10:split_time_score Fri Sep 19 17:23:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 29),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 19092025 27045522 Nombre de photos uploadées : 29 / 23040 (0%) 19092025 27045522 Nombre de photos taguées (types de déchets): 0 / 29 (0%) 19092025 27045522 Nombre de photos taguées (volume) : 0 / 29 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0013244152069091797 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.23176002502441406 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.0988384452160494 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27041269_19-09-2025_13_12_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27041269 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27041269 AND mptpi.`type`=3594 To do Qualite : 0.12457906194885363 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27041271_19-09-2025_13_22_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27041271 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27041271 AND mptpi.`type`=3594 To do Qualite : 0.21399369855967076 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27041273_19-09-2025_13_21_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27041273 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27041273 AND mptpi.`type`=3594 To do Qualite : 0.0757153420781893 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27032986_19-09-2025_09_26_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27032986 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27032986 AND mptpi.`type`=3594 To do Qualite : 0.06073209728157643 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27033020_19-09-2025_09_31_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27033020 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27033020 AND mptpi.`type`=3594 To do Qualite : 0.10538957281144778 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27033023_19-09-2025_09_21_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27033023 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27033023 AND mptpi.`type`=3594 To do Qualite : 0.12652753665123456 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27033025_19-09-2025_09_11_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27033025 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27033025 AND mptpi.`type`=3594 To do Qualite : 0.03437041859567901 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27035434_19-09-2025_11_41_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27035434 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27035434 AND mptpi.`type`=3594 To do Qualite : 0.04673382750090779 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27038968_19-09-2025_11_39_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27038968 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27038968 AND mptpi.`type`=3594 To do Qualite : 0.22215760030864198 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27038976_19-09-2025_12_37_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27038976 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27038976 AND mptpi.`type`=3594 To do Qualite : 0.13753438464506174 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27038977_19-09-2025_12_32_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27038977 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27038977 AND mptpi.`type`=3594 To do Qualite : 0.049932113603988616 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27040464_19-09-2025_12_11_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27040464 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27040464 AND mptpi.`type`=3594 To do Qualite : 0.05774874614197532 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27041276_19-09-2025_13_11_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27041276 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27041276 AND mptpi.`type`=3594 To do Qualite : 0.12905743634259262 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27043948_19-09-2025_15_41_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27043948 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27043948 AND mptpi.`type`=3594 To do Qualite : 0.11416597007887518 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27045517_19-09-2025_17_16_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27045517 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27045517 AND mptpi.`type`=3594 To do Qualite : 0.12731412950779727 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27045520_19-09-2025_17_22_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27045520 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27045520 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27045521 order by id desc limit 1 Qualite : 0.12127429557790552 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27045522_19-09-2025_17_23_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27045522 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27045522 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'19092025': {'nb_upload': 29, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1385114441, 1385114419, 1385114417, 1385114416, 1385114414, 1385114389, 1385114387, 1385114385, 1385114382, 1385114378, 1385114376, 1385114370, 1385114367, 1385114366, 1385114363, 1385114360, 1385114356, 1385114347, 1385114345, 1385114344, 1385114343, 1385114341, 1385114338, 1385114297, 1385114296, 1385114294, 1385114290, 1385114288, 1385114285] Looping around the photos to save general results len do output : 1 /27045522Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114441', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114419', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114417', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114416', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114414', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114389', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114387', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114385', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114382', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114378', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114376', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114370', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114367', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114366', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114363', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114360', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114356', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114347', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114345', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114344', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114343', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114341', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114338', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114297', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114296', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114294', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114290', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114288', None, None, None, None, None, '3747826') ('3318', None, None, None, None, None, None, None, '3747826') ('3318', '27045522', '1385114285', None, None, None, None, None, '3747826') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.0236814022064209 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.366122245788574 time spend to save output : 0.02405714988708496 total time spend for step 10 : 2.390179395675659 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 29 set_done_treatment 101.09user 32.49system 3:24.72elapsed 65%CPU (0avgtext+0avgdata 3223876maxresident)k 726024inputs+58168outputs (29148major+2393669minor)pagefaults 0swaps