python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3358006 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3452685'] with mtr_portfolio_ids : ['25698117'] and first list_photo_ids : [] new path : /proc/3358006/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 24 ; length of list_pids : 24 ; length of list_args : 24 time to download the photos : 3.1832399368286133 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Aug 5 20:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10957 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-05 20:20:32.838021: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-05 20:20:32.863308: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-08-05 20:20:32.865390: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f2a90000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-05 20:20:32.865439: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-05 20:20:32.868951: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-05 20:20:33.032461: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x37f89a70 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-05 20:20:33.032509: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-05 20:20:33.033883: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-05 20:20:33.034269: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-05 20:20:33.037143: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-05 20:20:33.039741: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-05 20:20:33.040249: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-05 20:20:33.042755: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-05 20:20:33.044025: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-05 20:20:33.048869: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-05 20:20:33.050598: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-05 20:20:33.050663: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-05 20:20:33.051624: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-05 20:20:33.051645: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-05 20:20:33.051655: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-05 20:20:33.053200: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10154 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-05 20:20:33.305361: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-05 20:20:33.305450: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-05 20:20:33.305471: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-05 20:20:33.305489: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-05 20:20:33.305507: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-05 20:20:33.305524: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-05 20:20:33.305541: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-05 20:20:33.305558: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-05 20:20:33.307141: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-05 20:20:33.308521: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-05 20:20:33.308560: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-05 20:20:33.308579: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-05 20:20:33.308597: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-05 20:20:33.308613: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-05 20:20:33.308630: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-05 20:20:33.308647: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-05 20:20:33.308664: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-05 20:20:33.310239: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-05 20:20:33.310270: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-05 20:20:33.310281: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-05 20:20:33.310290: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-05 20:20:33.311945: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10154 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-05 20:20:42.560269: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-05 20:20:42.757928: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 24 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 44.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 56.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 57.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 50.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 63.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 46.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 Detection mask done ! Trying to reset tf kernel 3358609 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5665 tf kernel not reseted sub process len(results) : 24 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 24 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10957 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0004322528839111328 nb_pixel_total : 13628 time to create 1 rle with old method : 0.015829086303710938 length of segment : 233 time for calcul the mask position with numpy : 0.00012922286987304688 nb_pixel_total : 6562 time to create 1 rle with old method : 0.007517576217651367 length of segment : 76 time for calcul the mask position with numpy : 0.021613359451293945 nb_pixel_total : 1145318 time to create 1 rle with new method : 0.08110475540161133 length of segment : 1567 time for calcul the mask position with numpy : 0.0001614093780517578 nb_pixel_total : 6199 time to create 1 rle with old method : 0.007014274597167969 length of segment : 111 time for calcul the mask position with numpy : 0.00019097328186035156 nb_pixel_total : 6674 time to create 1 rle with old method : 0.007725954055786133 length of segment : 98 time for calcul the mask position with numpy : 0.00020051002502441406 nb_pixel_total : 9103 time to create 1 rle with old method : 0.010476827621459961 length of segment : 176 time for calcul the mask position with numpy : 0.0008187294006347656 nb_pixel_total : 45728 time to create 1 rle with old method : 0.04991888999938965 length of segment : 467 time for calcul the mask position with numpy : 0.00018787384033203125 nb_pixel_total : 6184 time to create 1 rle with old method : 0.0069348812103271484 length of segment : 172 time for calcul the mask position with numpy : 0.00011324882507324219 nb_pixel_total : 4986 time to create 1 rle with old method : 0.005783796310424805 length of segment : 72 time for calcul the mask position with numpy : 0.00089263916015625 nb_pixel_total : 70856 time to create 1 rle with old method : 0.07855868339538574 length of segment : 255 time for calcul the mask position with numpy : 0.0009999275207519531 nb_pixel_total : 59486 time to create 1 rle with old method : 0.06752777099609375 length of segment : 436 time for calcul the mask position with numpy : 0.00021123886108398438 nb_pixel_total : 15123 time to create 1 rle with old method : 0.01669168472290039 length of segment : 186 time for calcul the mask position with numpy : 0.0011484622955322266 nb_pixel_total : 71259 time to create 1 rle with old method : 0.08559203147888184 length of segment : 250 time for calcul the mask position with numpy : 0.0007581710815429688 nb_pixel_total : 19044 time to create 1 rle with old method : 0.02222418785095215 length of segment : 150 time for calcul the mask position with numpy : 0.022176742553710938 nb_pixel_total : 759271 time to create 1 rle with new method : 0.025979995727539062 length of segment : 996 time for calcul the mask position with numpy : 0.0002808570861816406 nb_pixel_total : 11906 time to create 1 rle with old method : 0.015859365463256836 length of segment : 167 time for calcul the mask position with numpy : 0.0002186298370361328 nb_pixel_total : 13588 time to create 1 rle with old method : 0.015497922897338867 length of segment : 95 time for calcul the mask position with numpy : 0.0005781650543212891 nb_pixel_total : 34223 time to create 1 rle with old method : 0.03784465789794922 length of segment : 209 time for calcul the mask position with numpy : 0.0020308494567871094 nb_pixel_total : 113632 time to create 1 rle with old method : 0.12406349182128906 length of segment : 539 time for calcul the mask position with numpy : 0.00025773048400878906 nb_pixel_total : 7855 time to create 1 rle with old method : 0.008867740631103516 length of segment : 111 time for calcul the mask position with numpy : 0.00017452239990234375 nb_pixel_total : 7750 time to create 1 rle with old method : 0.009116888046264648 length of segment : 114 time for calcul the mask position with numpy : 9.131431579589844e-05 nb_pixel_total : 3921 time to create 1 rle with old method : 0.004637241363525391 length of segment : 68 time for calcul the mask position with numpy : 0.00022459030151367188 nb_pixel_total : 11707 time to create 1 rle with old method : 0.013366222381591797 length of segment : 131 time for calcul the mask position with numpy : 0.0014698505401611328 nb_pixel_total : 72673 time to create 1 rle with old method : 0.08070898056030273 length of segment : 257 time for calcul the mask position with numpy : 0.0002655982971191406 nb_pixel_total : 12856 time to create 1 rle with old method : 0.01491689682006836 length of segment : 115 time for calcul the mask position with numpy : 0.000293731689453125 nb_pixel_total : 12219 time to create 1 rle with old method : 0.014884471893310547 length of segment : 137 time for calcul the mask position with numpy : 0.00026679039001464844 nb_pixel_total : 6157 time to create 1 rle with old method : 0.0072443485260009766 length of segment : 112 time for calcul the mask position with numpy : 0.0001773834228515625 nb_pixel_total : 3471 time to create 1 rle with old method : 0.004166364669799805 length of segment : 72 time for calcul the mask position with numpy : 0.0003094673156738281 nb_pixel_total : 11194 time to create 1 rle with old method : 0.012944698333740234 length of segment : 112 time for calcul the mask position with numpy : 0.00029468536376953125 nb_pixel_total : 7450 time to create 1 rle with old method : 0.008249521255493164 length of segment : 171 time for calcul the mask position with numpy : 0.0023806095123291016 nb_pixel_total : 115445 time to create 1 rle with old method : 0.12548160552978516 length of segment : 577 time for calcul the mask position with numpy : 0.00032329559326171875 nb_pixel_total : 12930 time to create 1 rle with old method : 0.01457357406616211 length of segment : 104 time for calcul the mask position with numpy : 0.00024771690368652344 nb_pixel_total : 6316 time to create 1 rle with old method : 0.007165670394897461 length of segment : 139 time for calcul the mask position with numpy : 0.00037479400634765625 nb_pixel_total : 11574 time to create 1 rle with old method : 0.012911319732666016 length of segment : 182 time for calcul the mask position with numpy : 0.0002262592315673828 nb_pixel_total : 4816 time to create 1 rle with old method : 0.005442619323730469 length of segment : 120 time for calcul the mask position with numpy : 0.0002980232238769531 nb_pixel_total : 7603 time to create 1 rle with old method : 0.008843421936035156 length of segment : 107 time for calcul the mask position with numpy : 0.002192974090576172 nb_pixel_total : 107154 time to create 1 rle with old method : 0.11845755577087402 length of segment : 521 time for calcul the mask position with numpy : 0.0003426074981689453 nb_pixel_total : 12071 time to create 1 rle with old method : 0.015587091445922852 length of segment : 186 time for calcul the mask position with numpy : 0.0016674995422363281 nb_pixel_total : 61400 time to create 1 rle with old method : 0.07051515579223633 length of segment : 323 time for calcul the mask position with numpy : 0.00048160552978515625 nb_pixel_total : 24524 time to create 1 rle with old method : 0.026948213577270508 length of segment : 247 time for calcul the mask position with numpy : 0.0003631114959716797 nb_pixel_total : 18392 time to create 1 rle with old method : 0.020585298538208008 length of segment : 160 time for calcul the mask position with numpy : 0.0015408992767333984 nb_pixel_total : 87178 time to create 1 rle with old method : 0.09491133689880371 length of segment : 505 time for calcul the mask position with numpy : 0.002039194107055664 nb_pixel_total : 109526 time to create 1 rle with old method : 0.11933469772338867 length of segment : 540 time for calcul the mask position with numpy : 7.939338684082031e-05 nb_pixel_total : 2245 time to create 1 rle with old method : 0.0025827884674072266 length of segment : 49 time for calcul the mask position with numpy : 0.0003247261047363281 nb_pixel_total : 14003 time to create 1 rle with old method : 0.0156097412109375 length of segment : 147 time for calcul the mask position with numpy : 0.00026488304138183594 nb_pixel_total : 8138 time to create 1 rle with old method : 0.009255647659301758 length of segment : 186 time for calcul the mask position with numpy : 0.00022125244140625 nb_pixel_total : 9413 time to create 1 rle with old method : 0.011117696762084961 length of segment : 71 time for calcul the mask position with numpy : 0.0016324520111083984 nb_pixel_total : 88151 time to create 1 rle with old method : 0.09548115730285645 length of segment : 496 time for calcul the mask position with numpy : 0.00749969482421875 nb_pixel_total : 478487 time to create 1 rle with new method : 0.02189493179321289 length of segment : 1004 time for calcul the mask position with numpy : 0.0005834102630615234 nb_pixel_total : 16381 time to create 1 rle with old method : 0.019748926162719727 length of segment : 292 time for calcul the mask position with numpy : 0.002072572708129883 nb_pixel_total : 108753 time to create 1 rle with old method : 0.12627673149108887 length of segment : 539 time for calcul the mask position with numpy : 0.0010166168212890625 nb_pixel_total : 23395 time to create 1 rle with old method : 0.032996177673339844 length of segment : 191 time for calcul the mask position with numpy : 0.000171661376953125 nb_pixel_total : 4595 time to create 1 rle with old method : 0.005408287048339844 length of segment : 96 time for calcul the mask position with numpy : 0.00028204917907714844 nb_pixel_total : 8932 time to create 1 rle with old method : 0.010703086853027344 length of segment : 92 time for calcul the mask position with numpy : 0.0006778240203857422 nb_pixel_total : 40964 time to create 1 rle with old method : 0.04700279235839844 length of segment : 182 time for calcul the mask position with numpy : 0.00036907196044921875 nb_pixel_total : 14621 time to create 1 rle with old method : 0.01684284210205078 length of segment : 147 time for calcul the mask position with numpy : 0.0019745826721191406 nb_pixel_total : 117180 time to create 1 rle with old method : 0.1327366828918457 length of segment : 532 time for calcul the mask position with numpy : 0.0002899169921875 nb_pixel_total : 10609 time to create 1 rle with old method : 0.012160301208496094 length of segment : 186 time for calcul the mask position with numpy : 0.0001685619354248047 nb_pixel_total : 6669 time to create 1 rle with old method : 0.007859230041503906 length of segment : 116 time for calcul the mask position with numpy : 0.00017642974853515625 nb_pixel_total : 6539 time to create 1 rle with old method : 0.007759571075439453 length of segment : 103 time for calcul the mask position with numpy : 0.00044155120849609375 nb_pixel_total : 21695 time to create 1 rle with old method : 0.026813268661499023 length of segment : 116 time for calcul the mask position with numpy : 0.0008616447448730469 nb_pixel_total : 49924 time to create 1 rle with old method : 0.056519269943237305 length of segment : 313 time for calcul the mask position with numpy : 0.0003376007080078125 nb_pixel_total : 23620 time to create 1 rle with old method : 0.027524709701538086 length of segment : 143 time spent for convertir_results : 4.491669654846191 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 63 chid ids of type : 3594 Number RLEs to save : 16367 save missing photos in datou_result : time spend for datou_step_exec : 35.472259759902954 time spend to save output : 1.0227749347686768 total time spend for step 1 : 36.49503469467163 step2:crop_condition Tue Aug 5 20:21:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 24 ! batch 1 Loaded 63 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 3736932 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754418068_3358006 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 17 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.033708572387695 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754418073_3358006 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.0435237884521484 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 33 About to insert : list_path_to_insert length 33 new photo from crops ! About to upload 33 photos upload in portfolio : 3736932 init cache_photo without model_param we have 33 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754418091_3358006 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 33 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.427448272705078 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754418101_3358006 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.743591547012329 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754418104_3358006 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.4745616912841797 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1375341554, 1375341308, 1375341279, 1375341249, 1375341225, 1375341199, 1375341107, 1375341105, 1375341103, 1375341101, 1375341096, 1375340804, 1375340778, 1375340753, 1375340702, 1375340642, 1375340566, 1375340563, 1375340560, 1375340556, 1375340554, 1375340552, 1375340536, 1375340535] Looping around the photos to save general results len do output : 63 /1375363816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375363978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341554', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341308', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341279', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341249', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341225', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341199', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341107', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341105', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341103', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341101', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341096', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340804', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340778', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340753', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340702', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340642', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340566', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340563', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340560', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340556', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340554', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340552', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340536', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340535', None, None, None, None, None, '3452685') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 213 time used for this insertion : 0.022042512893676758 save_final save missing photos in datou_result : time spend for datou_step_exec : 37.52631378173828 time spend to save output : 0.024641036987304688 total time spend for step 2 : 37.550954818725586 step3:rle_unique_nms_with_priority Tue Aug 5 20:21:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 63 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 0.3819541931152344 time for calcul the mask position with numpy : 0.24184894561767578 nb_pixel_total : 901491 time to create 1 rle with new method : 0.1053931713104248 time for calcul the mask position with numpy : 0.006585121154785156 nb_pixel_total : 6674 time to create 1 rle with old method : 0.007814645767211914 time for calcul the mask position with numpy : 0.11597895622253418 nb_pixel_total : 1145245 time to create 1 rle with new method : 0.09994792938232422 time for calcul the mask position with numpy : 0.006405830383300781 nb_pixel_total : 6562 time to create 1 rle with old method : 0.007536411285400391 time for calcul the mask position with numpy : 0.006537914276123047 nb_pixel_total : 13628 time to create 1 rle with old method : 0.015543699264526367 create new chi : 0.6322133541107178 time to delete rle : 0.022057056427001953 batch 1 Loaded 10 chid ids of type : 3594 ++++++Number RLEs to save : 5021 TO DO : save crop sub photo not yet done ! save time : 0.3315417766571045 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.29067373275756836 time for calcul the mask position with numpy : 0.24650359153747559 nb_pixel_total : 1936743 time to create 1 rle with new method : 0.28698253631591797 time for calcul the mask position with numpy : 0.006182193756103516 nb_pixel_total : 70856 time to create 1 rle with old method : 0.07922101020812988 time for calcul the mask position with numpy : 0.006413459777832031 nb_pixel_total : 4986 time to create 1 rle with old method : 0.005691051483154297 time for calcul the mask position with numpy : 0.005897045135498047 nb_pixel_total : 6184 time to create 1 rle with old method : 0.0071201324462890625 time for calcul the mask position with numpy : 0.006264925003051758 nb_pixel_total : 45728 time to create 1 rle with old method : 0.049916982650756836 time for calcul the mask position with numpy : 0.00588679313659668 nb_pixel_total : 9103 time to create 1 rle with old method : 0.010040044784545898 create new chi : 0.7254281044006348 time to delete rle : 0.00044536590576171875 batch 1 Loaded 11 chid ids of type : 3594 +++++++++Number RLEs to save : 3364 TO DO : save crop sub photo not yet done ! save time : 0.23288536071777344 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05567598342895508 time for calcul the mask position with numpy : 0.019613981246948242 nb_pixel_total : 1940748 time to create 1 rle with new method : 0.1282188892364502 time for calcul the mask position with numpy : 0.007253885269165039 nb_pixel_total : 71259 time to create 1 rle with old method : 0.08244490623474121 time for calcul the mask position with numpy : 0.0065457820892333984 nb_pixel_total : 2107 time to create 1 rle with old method : 0.002635955810546875 time for calcul the mask position with numpy : 0.007794618606567383 nb_pixel_total : 59486 time to create 1 rle with old method : 0.07017946243286133 create new chi : 0.333024263381958 time to delete rle : 0.0003788471221923828 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 2567 TO DO : save crop sub photo not yet done ! save time : 0.19635748863220215 No data in photo_id : 1375341249 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.05260825157165527 time for calcul the mask position with numpy : 0.0497894287109375 nb_pixel_total : 1295285 time to create 1 rle with new method : 0.2560698986053467 time for calcul the mask position with numpy : 0.01571798324584961 nb_pixel_total : 759271 time to create 1 rle with new method : 0.08618569374084473 time for calcul the mask position with numpy : 0.005860328674316406 nb_pixel_total : 19044 time to create 1 rle with old method : 0.02065730094909668 create new chi : 0.4432661533355713 time to delete rle : 0.0005128383636474609 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3372 TO DO : save crop sub photo not yet done ! save time : 0.2267768383026123 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 0.7242512702941895 time for calcul the mask position with numpy : 0.06819939613342285 nb_pixel_total : 1782752 time to create 1 rle with new method : 0.20969581604003906 time for calcul the mask position with numpy : 0.006219387054443359 nb_pixel_total : 737 time to create 1 rle with old method : 0.0009911060333251953 time for calcul the mask position with numpy : 0.006702899932861328 nb_pixel_total : 12856 time to create 1 rle with old method : 0.014277219772338867 time for calcul the mask position with numpy : 0.006224393844604492 nb_pixel_total : 72673 time to create 1 rle with old method : 0.07928752899169922 time for calcul the mask position with numpy : 0.006153106689453125 nb_pixel_total : 11707 time to create 1 rle with old method : 0.013032674789428711 time for calcul the mask position with numpy : 0.005944967269897461 nb_pixel_total : 3921 time to create 1 rle with old method : 0.004439592361450195 time for calcul the mask position with numpy : 0.0059356689453125 nb_pixel_total : 7750 time to create 1 rle with old method : 0.00863337516784668 time for calcul the mask position with numpy : 0.005951404571533203 nb_pixel_total : 7855 time to create 1 rle with old method : 0.008949995040893555 time for calcul the mask position with numpy : 0.007274150848388672 nb_pixel_total : 113632 time to create 1 rle with old method : 0.12538838386535645 time for calcul the mask position with numpy : 0.00609278678894043 nb_pixel_total : 34223 time to create 1 rle with old method : 0.03744387626647949 time for calcul the mask position with numpy : 0.0057146549224853516 nb_pixel_total : 13588 time to create 1 rle with old method : 0.014933109283447266 time for calcul the mask position with numpy : 0.0063686370849609375 nb_pixel_total : 11906 time to create 1 rle with old method : 0.013008594512939453 create new chi : 0.6772580146789551 time to delete rle : 0.0006678104400634766 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++Number RLEs to save : 4793 TO DO : save crop sub photo not yet done ! save time : 0.3258819580078125 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.041275978088378906 time for calcul the mask position with numpy : 0.018065452575683594 nb_pixel_total : 2063972 time to create 1 rle with new method : 0.02698802947998047 time for calcul the mask position with numpy : 0.0059316158294677734 nb_pixel_total : 3471 time to create 1 rle with old method : 0.0038089752197265625 time for calcul the mask position with numpy : 0.00561213493347168 nb_pixel_total : 6157 time to create 1 rle with old method : 0.006647586822509766 create new chi : 0.07644391059875488 time to delete rle : 0.00022125244140625 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1448 TO DO : save crop sub photo not yet done ! save time : 0.123504638671875 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.07813906669616699 time for calcul the mask position with numpy : 0.17529749870300293 nb_pixel_total : 1939511 time to create 1 rle with new method : 0.18265032768249512 time for calcul the mask position with numpy : 0.006337404251098633 nb_pixel_total : 115445 time to create 1 rle with old method : 0.12327313423156738 time for calcul the mask position with numpy : 0.005821704864501953 nb_pixel_total : 7450 time to create 1 rle with old method : 0.008037567138671875 time for calcul the mask position with numpy : 0.00557708740234375 nb_pixel_total : 11194 time to create 1 rle with old method : 0.012287378311157227 create new chi : 0.5295302867889404 time to delete rle : 0.0002601146697998047 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2800 TO DO : save crop sub photo not yet done ! save time : 0.19448590278625488 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.07273387908935547 time for calcul the mask position with numpy : 0.15630459785461426 nb_pixel_total : 2042780 time to create 1 rle with new method : 0.0919489860534668 time for calcul the mask position with numpy : 0.005867958068847656 nb_pixel_total : 11574 time to create 1 rle with old method : 0.012480974197387695 time for calcul the mask position with numpy : 0.005803585052490234 nb_pixel_total : 6316 time to create 1 rle with old method : 0.006750345230102539 time for calcul the mask position with numpy : 0.005688667297363281 nb_pixel_total : 12930 time to create 1 rle with old method : 0.013664722442626953 create new chi : 0.3086705207824707 time to delete rle : 0.00028777122497558594 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1930 TO DO : save crop sub photo not yet done ! save time : 0.15256071090698242 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03228044509887695 time for calcul the mask position with numpy : 0.018390655517578125 nb_pixel_total : 2068784 time to create 1 rle with new method : 0.17522168159484863 time for calcul the mask position with numpy : 0.0056226253509521484 nb_pixel_total : 4816 time to create 1 rle with old method : 0.005094289779663086 create new chi : 0.20453643798828125 time to delete rle : 0.00021719932556152344 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1320 TO DO : save crop sub photo not yet done ! save time : 0.11717677116394043 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.11350250244140625 time for calcul the mask position with numpy : 0.18236899375915527 nb_pixel_total : 2065997 time to create 1 rle with new method : 0.09224534034729004 time for calcul the mask position with numpy : 0.005773067474365234 nb_pixel_total : 7603 time to create 1 rle with old method : 0.00810098648071289 create new chi : 0.2986443042755127 time to delete rle : 0.0002560615539550781 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1294 TO DO : save crop sub photo not yet done ! save time : 0.1425011157989502 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03376317024230957 time for calcul the mask position with numpy : 0.12226319313049316 nb_pixel_total : 1966446 time to create 1 rle with new method : 0.14640092849731445 time for calcul the mask position with numpy : 0.0068929195404052734 nb_pixel_total : 107154 time to create 1 rle with old method : 0.1174626350402832 create new chi : 0.40297937393188477 time to delete rle : 0.00030422210693359375 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2122 TO DO : save crop sub photo not yet done ! save time : 0.16995835304260254 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.032572269439697266 time for calcul the mask position with numpy : 0.07513284683227539 nb_pixel_total : 2061529 time to create 1 rle with new method : 0.1521134376525879 time for calcul the mask position with numpy : 0.006087303161621094 nb_pixel_total : 12071 time to create 1 rle with old method : 0.01303720474243164 create new chi : 0.25667357444763184 time to delete rle : 0.0002760887145996094 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1452 TO DO : save crop sub photo not yet done ! save time : 0.1292567253112793 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.19325828552246094 time for calcul the mask position with numpy : 0.12952780723571777 nb_pixel_total : 1969284 time to create 1 rle with new method : 0.09447956085205078 time for calcul the mask position with numpy : 0.005968570709228516 nb_pixel_total : 18392 time to create 1 rle with old method : 0.020092248916625977 time for calcul the mask position with numpy : 0.005841970443725586 nb_pixel_total : 24524 time to create 1 rle with old method : 0.026283740997314453 time for calcul the mask position with numpy : 0.006270408630371094 nb_pixel_total : 61400 time to create 1 rle with old method : 0.06533360481262207 create new chi : 0.36449623107910156 time to delete rle : 0.00038886070251464844 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 2540 TO DO : save crop sub photo not yet done ! save time : 0.20281696319580078 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03366971015930176 time for calcul the mask position with numpy : 0.019407272338867188 nb_pixel_total : 1986422 time to create 1 rle with new method : 0.154313325881958 time for calcul the mask position with numpy : 0.006577730178833008 nb_pixel_total : 87178 time to create 1 rle with old method : 0.09417557716369629 create new chi : 0.28163886070251465 time to delete rle : 0.0003101825714111328 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2090 TO DO : save crop sub photo not yet done ! save time : 0.1728510856628418 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.4114060401916504 time for calcul the mask position with numpy : 0.14080357551574707 nb_pixel_total : 1930275 time to create 1 rle with new method : 0.19583559036254883 time for calcul the mask position with numpy : 0.005807399749755859 nb_pixel_total : 9413 time to create 1 rle with old method : 0.010356664657592773 time for calcul the mask position with numpy : 0.005954742431640625 nb_pixel_total : 8138 time to create 1 rle with old method : 0.008971929550170898 time for calcul the mask position with numpy : 0.005766630172729492 nb_pixel_total : 14003 time to create 1 rle with old method : 0.015317201614379883 time for calcul the mask position with numpy : 0.0060367584228515625 nb_pixel_total : 2245 time to create 1 rle with old method : 0.002457141876220703 time for calcul the mask position with numpy : 0.006409406661987305 nb_pixel_total : 109526 time to create 1 rle with old method : 0.1192471981048584 create new chi : 0.5323953628540039 time to delete rle : 0.00040984153747558594 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 3066 TO DO : save crop sub photo not yet done ! save time : 0.23140740394592285 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04434776306152344 time for calcul the mask position with numpy : 0.015620946884155273 nb_pixel_total : 1506962 time to create 1 rle with new method : 0.05879998207092285 time for calcul the mask position with numpy : 0.00874471664428711 nb_pixel_total : 478487 time to create 1 rle with new method : 0.027531147003173828 time for calcul the mask position with numpy : 0.0059969425201416016 nb_pixel_total : 88151 time to create 1 rle with old method : 0.09321808815002441 create new chi : 0.21041417121887207 time to delete rle : 0.0006258487701416016 batch 1 Loaded 5 chid ids of type : 3594 +++++Number RLEs to save : 4080 TO DO : save crop sub photo not yet done ! save time : 0.27250218391418457 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04121208190917969 time for calcul the mask position with numpy : 0.13511967658996582 nb_pixel_total : 2057219 time to create 1 rle with new method : 0.088348388671875 time for calcul the mask position with numpy : 0.005786895751953125 nb_pixel_total : 16381 time to create 1 rle with old method : 0.01776266098022461 create new chi : 0.2555203437805176 time to delete rle : 0.00026988983154296875 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1664 TO DO : save crop sub photo not yet done ! save time : 0.14338302612304688 No data in photo_id : 1375340560 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.18612933158874512 time for calcul the mask position with numpy : 0.12530064582824707 nb_pixel_total : 1936857 time to create 1 rle with new method : 0.0903017520904541 time for calcul the mask position with numpy : 0.0058591365814208984 nb_pixel_total : 4595 time to create 1 rle with old method : 0.004945516586303711 time for calcul the mask position with numpy : 0.0058345794677734375 nb_pixel_total : 23395 time to create 1 rle with old method : 0.025231122970581055 time for calcul the mask position with numpy : 0.006168365478515625 nb_pixel_total : 108753 time to create 1 rle with old method : 0.11644101142883301 create new chi : 0.39023804664611816 time to delete rle : 0.00028514862060546875 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2732 TO DO : save crop sub photo not yet done ! save time : 0.20593476295471191 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.040497779846191406 time for calcul the mask position with numpy : 0.01787424087524414 nb_pixel_total : 2023704 time to create 1 rle with new method : 0.1401963233947754 time for calcul the mask position with numpy : 0.005933523178100586 nb_pixel_total : 40964 time to create 1 rle with old method : 0.04359865188598633 time for calcul the mask position with numpy : 0.005719661712646484 nb_pixel_total : 8932 time to create 1 rle with old method : 0.00991964340209961 create new chi : 0.23016023635864258 time to delete rle : 0.00029921531677246094 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1628 TO DO : save crop sub photo not yet done ! save time : 0.14790821075439453 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.0425572395324707 time for calcul the mask position with numpy : 0.017985820770263672 nb_pixel_total : 1941799 time to create 1 rle with new method : 0.1378188133239746 time for calcul the mask position with numpy : 0.006254434585571289 nb_pixel_total : 117180 time to create 1 rle with old method : 0.12393045425415039 time for calcul the mask position with numpy : 0.005772590637207031 nb_pixel_total : 14621 time to create 1 rle with old method : 0.01566767692565918 create new chi : 0.31763696670532227 time to delete rle : 0.0003757476806640625 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2438 TO DO : save crop sub photo not yet done ! save time : 0.18468236923217773 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.09319686889648438 time for calcul the mask position with numpy : 0.15349674224853516 nb_pixel_total : 2049783 time to create 1 rle with new method : 0.09597229957580566 time for calcul the mask position with numpy : 0.005940437316894531 nb_pixel_total : 6539 time to create 1 rle with old method : 0.007291555404663086 time for calcul the mask position with numpy : 0.005797624588012695 nb_pixel_total : 6669 time to create 1 rle with old method : 0.007239580154418945 time for calcul the mask position with numpy : 0.005803108215332031 nb_pixel_total : 10609 time to create 1 rle with old method : 0.011458396911621094 create new chi : 0.30312466621398926 time to delete rle : 0.0003294944763183594 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 1890 TO DO : save crop sub photo not yet done ! save time : 0.15006327629089355 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.1380140781402588 time for calcul the mask position with numpy : 0.07042217254638672 nb_pixel_total : 1978361 time to create 1 rle with new method : 0.21315217018127441 time for calcul the mask position with numpy : 0.00583648681640625 nb_pixel_total : 23620 time to create 1 rle with old method : 0.025243282318115234 time for calcul the mask position with numpy : 0.0058138370513916016 nb_pixel_total : 49924 time to create 1 rle with old method : 0.0553131103515625 time for calcul the mask position with numpy : 0.006168842315673828 nb_pixel_total : 21695 time to create 1 rle with old method : 0.02460956573486328 create new chi : 0.41582393646240234 time to delete rle : 0.0003800392150878906 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2224 TO DO : save crop sub photo not yet done ! save time : 0.17036843299865723 map_output_result : {1375341554: (0.0, 'Should be the crop_list due to order', 0), 1375341308: (0.0, 'Should be the crop_list due to order', 0), 1375341279: (0.0, 'Should be the crop_list due to order', 0), 1375341249: (0.0, 'Should be the crop_list due to order', 0.0), 1375341225: (0.0, 'Should be the crop_list due to order', 0), 1375341199: (0.0, 'Should be the crop_list due to order', 0), 1375341107: (0.0, 'Should be the crop_list due to order', 0), 1375341105: (0.0, 'Should be the crop_list due to order', 0), 1375341103: (0.0, 'Should be the crop_list due to order', 0), 1375341101: (0.0, 'Should be the crop_list due to order', 0), 1375341096: (0.0, 'Should be the crop_list due to order', 0), 1375340804: (0.0, 'Should be the crop_list due to order', 0), 1375340778: (0.0, 'Should be the crop_list due to order', 0), 1375340753: (0.0, 'Should be the crop_list due to order', 0), 1375340702: (0.0, 'Should be the crop_list due to order', 0), 1375340642: (0.0, 'Should be the crop_list due to order', 0), 1375340566: (0.0, 'Should be the crop_list due to order', 0), 1375340563: (0.0, 'Should be the crop_list due to order', 0), 1375340560: (0.0, 'Should be the crop_list due to order', 0.0), 1375340556: (0.0, 'Should be the crop_list due to order', 0), 1375340554: (0.0, 'Should be the crop_list due to order', 0), 1375340552: (0.0, 'Should be the crop_list due to order', 0), 1375340536: (0.0, 'Should be the crop_list due to order', 0), 1375340535: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1375341554, 1375341308, 1375341279, 1375341249, 1375341225, 1375341199, 1375341107, 1375341105, 1375341103, 1375341101, 1375341096, 1375340804, 1375340778, 1375340753, 1375340702, 1375340642, 1375340566, 1375340563, 1375340560, 1375340556, 1375340554, 1375340552, 1375340536, 1375340535] Looping around the photos to save general results len do output : 24 /1375341554.Didn't retrieve data . /1375341308.Didn't retrieve data . /1375341279.Didn't retrieve data . /1375341249.Didn't retrieve data . /1375341225.Didn't retrieve data . /1375341199.Didn't retrieve data . /1375341107.Didn't retrieve data . /1375341105.Didn't retrieve data . /1375341103.Didn't retrieve data . /1375341101.Didn't retrieve data . /1375341096.Didn't retrieve data . /1375340804.Didn't retrieve data . /1375340778.Didn't retrieve data . /1375340753.Didn't retrieve data . /1375340702.Didn't retrieve data . /1375340642.Didn't retrieve data . /1375340566.Didn't retrieve data . /1375340563.Didn't retrieve data . /1375340560.Didn't retrieve data . /1375340556.Didn't retrieve data . /1375340554.Didn't retrieve data . /1375340552.Didn't retrieve data . /1375340536.Didn't retrieve data . /1375340535.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341554', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341308', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341279', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341249', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341225', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341199', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341107', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341105', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341103', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341101', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341096', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340804', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340778', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340753', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340702', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340642', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340566', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340563', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340560', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340556', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340554', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340552', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340536', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340535', None, None, None, None, None, '3452685') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 72 time used for this insertion : 0.01658034324645996 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.265607357025146 time spend to save output : 0.017196178436279297 total time spend for step 3 : 16.282803535461426 step4:ventilate_hashtags_in_portfolio Tue Aug 5 20:22:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25698117 get user id for portfolio 25698117 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25698117 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','background','papier','metal','pehd','autre','carton','mal_croppe','pet_clair','environnement','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25698117 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','background','papier','metal','pehd','autre','carton','mal_croppe','pet_clair','environnement','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25698117 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','background','papier','metal','pehd','autre','carton','mal_croppe','pet_clair','environnement','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25701129,25701130,25701131,25701132,25701133,25701134,25701135,25701136,25701137,25701138,25701139?tags=flou,background,papier,metal,pehd,autre,carton,mal_croppe,pet_clair,environnement,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1375341554, 1375341308, 1375341279, 1375341249, 1375341225, 1375341199, 1375341107, 1375341105, 1375341103, 1375341101, 1375341096, 1375340804, 1375340778, 1375340753, 1375340702, 1375340642, 1375340566, 1375340563, 1375340560, 1375340556, 1375340554, 1375340552, 1375340536, 1375340535] Looping around the photos to save general results len do output : 1 /25698117. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341554', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341308', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341279', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341249', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341225', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341199', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341107', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341105', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341103', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341101', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341096', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340804', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340778', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340753', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340702', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340642', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340566', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340563', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340560', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340556', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340554', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340552', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340536', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340535', None, None, None, None, None, '3452685') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 25 time used for this insertion : 0.01677560806274414 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6333696842193604 time spend to save output : 0.017132282257080078 total time spend for step 4 : 1.6505019664764404 step5:final Tue Aug 5 20:22:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1375341554: ('0.08384162808641976',), 1375341308: ('0.08384162808641976',), 1375341279: ('0.08384162808641976',), 1375341249: ('0.08384162808641976',), 1375341225: ('0.08384162808641976',), 1375341199: ('0.08384162808641976',), 1375341107: ('0.08384162808641976',), 1375341105: ('0.08384162808641976',), 1375341103: ('0.08384162808641976',), 1375341101: ('0.08384162808641976',), 1375341096: ('0.08384162808641976',), 1375340804: ('0.08384162808641976',), 1375340778: ('0.08384162808641976',), 1375340753: ('0.08384162808641976',), 1375340702: ('0.08384162808641976',), 1375340642: ('0.08384162808641976',), 1375340566: ('0.08384162808641976',), 1375340563: ('0.08384162808641976',), 1375340560: ('0.08384162808641976',), 1375340556: ('0.08384162808641976',), 1375340554: ('0.08384162808641976',), 1375340552: ('0.08384162808641976',), 1375340536: ('0.08384162808641976',), 1375340535: ('0.08384162808641976',)} new output for save of step final : {1375341554: ('0.08384162808641976',), 1375341308: ('0.08384162808641976',), 1375341279: ('0.08384162808641976',), 1375341249: ('0.08384162808641976',), 1375341225: ('0.08384162808641976',), 1375341199: ('0.08384162808641976',), 1375341107: ('0.08384162808641976',), 1375341105: ('0.08384162808641976',), 1375341103: ('0.08384162808641976',), 1375341101: ('0.08384162808641976',), 1375341096: ('0.08384162808641976',), 1375340804: ('0.08384162808641976',), 1375340778: ('0.08384162808641976',), 1375340753: ('0.08384162808641976',), 1375340702: ('0.08384162808641976',), 1375340642: ('0.08384162808641976',), 1375340566: ('0.08384162808641976',), 1375340563: ('0.08384162808641976',), 1375340560: ('0.08384162808641976',), 1375340556: ('0.08384162808641976',), 1375340554: ('0.08384162808641976',), 1375340552: ('0.08384162808641976',), 1375340536: ('0.08384162808641976',), 1375340535: ('0.08384162808641976',)} [1375341554, 1375341308, 1375341279, 1375341249, 1375341225, 1375341199, 1375341107, 1375341105, 1375341103, 1375341101, 1375341096, 1375340804, 1375340778, 1375340753, 1375340702, 1375340642, 1375340566, 1375340563, 1375340560, 1375340556, 1375340554, 1375340552, 1375340536, 1375340535] Looping around the photos to save general results len do output : 24 /1375341554.Didn't retrieve data . /1375341308.Didn't retrieve data . /1375341279.Didn't retrieve data . /1375341249.Didn't retrieve data . /1375341225.Didn't retrieve data . /1375341199.Didn't retrieve data . /1375341107.Didn't retrieve data . /1375341105.Didn't retrieve data . /1375341103.Didn't retrieve data . /1375341101.Didn't retrieve data . /1375341096.Didn't retrieve data . /1375340804.Didn't retrieve data . /1375340778.Didn't retrieve data . /1375340753.Didn't retrieve data . /1375340702.Didn't retrieve data . /1375340642.Didn't retrieve data . /1375340566.Didn't retrieve data . /1375340563.Didn't retrieve data . /1375340560.Didn't retrieve data . /1375340556.Didn't retrieve data . /1375340554.Didn't retrieve data . /1375340552.Didn't retrieve data . /1375340536.Didn't retrieve data . /1375340535.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341554', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341308', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341279', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341249', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341225', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341199', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341107', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341105', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341103', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341101', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341096', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340804', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340778', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340753', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340702', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340642', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340566', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340563', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340560', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340556', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340554', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340552', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340536', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340535', None, None, None, None, None, '3452685') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 72 time used for this insertion : 0.018391132354736328 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11907601356506348 time spend to save output : 0.019495248794555664 total time spend for step 5 : 0.13857126235961914 step6:blur_detection Tue Aug 5 20:22:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1754418027_3358006_1375341554_719ba94c4dd8b7a0252f8aec7e52b521.jpg resize: (1080, 1920) 1375341554 -0.03013194102584501 treat image : temp/1754418027_3358006_1375341308_e878468461507bebb089dc01f6b648e7.jpg resize: (1080, 1920) 1375341308 2.4006561879399975 treat image : temp/1754418027_3358006_1375341279_b63ddfd178e1e4cf29e952b6f75c5ff5.jpg resize: (1080, 1920) 1375341279 0.8629520404479947 treat image : temp/1754418027_3358006_1375341249_82b88f63a227f2283c01f09a84610095.jpg resize: (1080, 1920) 1375341249 1.2604152766380856 treat image : temp/1754418027_3358006_1375341225_2fef8c9dcadd7c180b7003fa4cf5d422.jpg resize: (1080, 1920) 1375341225 0.5561363396809328 treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984.jpg resize: (1080, 1920) 1375341199 -3.2329493041705915 treat image : temp/1754418027_3358006_1375341107_7f3c85dd6a806c5d086433611ae7f599.jpg resize: (1080, 1920) 1375341107 -1.5658759031891847 treat image : temp/1754418027_3358006_1375341105_d8b7556e0ebfcae8a3fd07ff2ec440b0.jpg resize: (1080, 1920) 1375341105 -0.2737316724473346 treat image : temp/1754418027_3358006_1375341103_123a38b6077e2a69b5f5d2d0fece1943.jpg resize: (1080, 1920) 1375341103 -1.49589562895054 treat image : temp/1754418027_3358006_1375341101_1230336a942cffdc7b8d24f3343149b5.jpg resize: (1080, 1920) 1375341101 1.4361109856801066 treat image : temp/1754418027_3358006_1375341096_6391dbfcd17c3da484d5ef5e96980023.jpg resize: (1080, 1920) 1375341096 0.09818616402024123 treat image : temp/1754418027_3358006_1375340804_95b1ce34aac564c3406b77ef97fbaa84.jpg resize: (1080, 1920) 1375340804 -0.8348916497393273 treat image : temp/1754418027_3358006_1375340778_77abc26e0ed208a37932b3dcdff5f268.jpg resize: (1080, 1920) 1375340778 0.7883390541508695 treat image : temp/1754418027_3358006_1375340753_440b21a64a18ef9a194692a565c7e628.jpg resize: (1080, 1920) 1375340753 0.089605632437321 treat image : temp/1754418027_3358006_1375340702_a30e56f5c2ca19e457cd5f2058e80c67.jpg resize: (1080, 1920) 1375340702 -0.1436452367804803 treat image : temp/1754418027_3358006_1375340642_a7993fbc0cf25e896469815487236bab.jpg resize: (1080, 1920) 1375340642 -4.999350173215285 treat image : temp/1754418027_3358006_1375340566_6f8043657a227dbffb0614aafaec2b3e.jpg resize: (1080, 1920) 1375340566 -0.8242952372417627 treat image : temp/1754418027_3358006_1375340563_01724b450acd46a2e29480b0bd8a3edb.jpg resize: (1080, 1920) 1375340563 0.8861435835481362 treat image : temp/1754418027_3358006_1375340560_367bad363a54fc4e49020f67f7fc4624.jpg resize: (1080, 1920) 1375340560 -2.787651929224969 treat image : temp/1754418027_3358006_1375340556_26d27c2d8730fe03357a4a8ef07a81b0.jpg resize: (1080, 1920) 1375340556 -5.044153652767635 treat image : temp/1754418027_3358006_1375340554_b07f6f1c665ff4d6dfbbcdc134a8db7e.jpg resize: (1080, 1920) 1375340554 -3.107632831750186 treat image : temp/1754418027_3358006_1375340552_1351dc79f3f72cfe94b4d2d547d57557.jpg resize: (1080, 1920) 1375340552 -4.303561581285255 treat image : temp/1754418027_3358006_1375340536_d1f8fdfdd247e283b19231a3d58b198b.jpg resize: (1080, 1920) 1375340536 1.329163817477925 treat image : temp/1754418027_3358006_1375340535_e7ddb13e09ae616b47633e55ea0f9277.jpg resize: (1080, 1920) 1375340535 1.1293177440464035 treat image : temp/1754418027_3358006_1375341308_e878468461507bebb089dc01f6b648e7_rle_crop_3904016763_0.png resize: (149, 124) 1375363816 0.1451653568315114 treat image : temp/1754418027_3358006_1375341308_e878468461507bebb089dc01f6b648e7_rle_crop_3904016765_0.png resize: (169, 76) 1375363818 -2.214485737834721 treat image : temp/1754418027_3358006_1375341308_e878468461507bebb089dc01f6b648e7_rle_crop_3904016766_0.png resize: (71, 96) 1375363819 0.5880644279947271 treat image : temp/1754418027_3358006_1375341279_b63ddfd178e1e4cf29e952b6f75c5ff5_rle_crop_3904016769_0.png resize: (185, 91) 1375363820 1.834363947214435 treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016777_0.png resize: (111, 105) 1375363822 -4.90947546847949 treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016779_0.png resize: (67, 74) 1375363823 -0.9188143875034801 treat image : temp/1754418027_3358006_1375341107_7f3c85dd6a806c5d086433611ae7f599_rle_crop_3904016784_0.png resize: (112, 78) 1375363825 -1.1352737660081689 treat image : temp/1754418027_3358006_1375341107_7f3c85dd6a806c5d086433611ae7f599_rle_crop_3904016785_0.png resize: (68, 79) 1375363826 -1.2357707985914264 treat image : temp/1754418027_3358006_1375341105_d8b7556e0ebfcae8a3fd07ff2ec440b0_rle_crop_3904016787_0.png resize: (138, 77) 1375363827 -1.8737336227056354 treat image : temp/1754418027_3358006_1375341103_123a38b6077e2a69b5f5d2d0fece1943_rle_crop_3904016791_0.png resize: (182, 114) 1375363829 -0.681948375354353 treat image : temp/1754418027_3358006_1375341096_6391dbfcd17c3da484d5ef5e96980023_rle_crop_3904016793_0.png resize: (107, 102) 1375363830 -0.7073109260838798 treat image : temp/1754418027_3358006_1375340642_a7993fbc0cf25e896469815487236bab_rle_crop_3904016801_0.png resize: (49, 53) 1375363831 4.663296555740831 treat image : temp/1754418027_3358006_1375340642_a7993fbc0cf25e896469815487236bab_rle_crop_3904016803_0.png resize: (173, 112) 1375363833 -2.5587763395925998 treat image : temp/1754418027_3358006_1375340642_a7993fbc0cf25e896469815487236bab_rle_crop_3904016804_0.png resize: (69, 217) 1375363834 -3.010612770223826 treat image : temp/1754418027_3358006_1375340563_01724b450acd46a2e29480b0bd8a3edb_rle_crop_3904016807_0.png resize: (235, 141) 1375363835 -2.186770818711452 treat image : temp/1754418027_3358006_1375340535_e7ddb13e09ae616b47633e55ea0f9277_rle_crop_3904016818_0.png resize: (115, 290) 1375363837 -0.10171483977672915 treat image : temp/1754418027_3358006_1375340535_e7ddb13e09ae616b47633e55ea0f9277_rle_crop_3904016819_0.png resize: (308, 273) 1375363838 -2.415476644096466 treat image : temp/1754418027_3358006_1375341554_719ba94c4dd8b7a0252f8aec7e52b521_rle_crop_3904016761_0.png resize: (111, 68) 1375363846 0.7573934221449075 treat image : temp/1754418027_3358006_1375341103_123a38b6077e2a69b5f5d2d0fece1943_rle_crop_3904016790_0.png resize: (139, 63) 1375363847 -1.1554959848719555 treat image : temp/1754418027_3358006_1375340556_26d27c2d8730fe03357a4a8ef07a81b0_rle_crop_3904016809_0.png resize: (191, 150) 1375363848 -0.8157085870203411 treat image : temp/1754418027_3358006_1375340536_d1f8fdfdd247e283b19231a3d58b198b_rle_crop_3904016815_0.png resize: (186, 84) 1375363849 -1.3042147596455085 treat image : temp/1754418027_3358006_1375340536_d1f8fdfdd247e283b19231a3d58b198b_rle_crop_3904016816_0.png resize: (108, 94) 1375363850 -1.8772473827490856 treat image : temp/1754418027_3358006_1375340536_d1f8fdfdd247e283b19231a3d58b198b_rle_crop_3904016817_0.png resize: (103, 90) 1375363851 -1.3744448637494036 treat image : temp/1754418027_3358006_1375341554_719ba94c4dd8b7a0252f8aec7e52b521_rle_crop_3904016758_0.png resize: (174, 145) 1375363934 -1.9480416397077376 treat image : temp/1754418027_3358006_1375341554_719ba94c4dd8b7a0252f8aec7e52b521_rle_crop_3904016759_0.png resize: (75, 123) 1375363935 -2.36394131108803 treat image : temp/1754418027_3358006_1375341554_719ba94c4dd8b7a0252f8aec7e52b521_rle_crop_3904016760_0.png resize: (992, 1333) 1375363936 -1.0282416311170877 treat image : temp/1754418027_3358006_1375341554_719ba94c4dd8b7a0252f8aec7e52b521_rle_crop_3904016762_0.png resize: (97, 122) 1375363937 -1.5523521360526795 treat image : temp/1754418027_3358006_1375341308_e878468461507bebb089dc01f6b648e7_rle_crop_3904016767_0.png resize: (254, 424) 1375363938 0.31272725494743675 treat image : temp/1754418027_3358006_1375341279_b63ddfd178e1e4cf29e952b6f75c5ff5_rle_crop_3904016768_0.png resize: (313, 346) 1375363939 -0.8845952191119099 treat image : temp/1754418027_3358006_1375341279_b63ddfd178e1e4cf29e952b6f75c5ff5_rle_crop_3904016770_0.png resize: (253, 430) 1375363940 -1.4422198276188327 treat image : temp/1754418027_3358006_1375341225_2fef8c9dcadd7c180b7003fa4cf5d422_rle_crop_3904016771_0.png resize: (150, 185) 1375363941 -0.7226780561126922 treat image : temp/1754418027_3358006_1375341225_2fef8c9dcadd7c180b7003fa4cf5d422_rle_crop_3904016772_0.png resize: (982, 1105) 1375363942 -0.16209103073763376 treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016773_0.png resize: (165, 90) 1375363943 -3.225331399432694 treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016774_0.png resize: (95, 188) 1375363944 -2.548823475198042 treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016775_0.png resize: (206, 251) 1375363945 -4.184244893061886 treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016776_0.png resize: (539, 338) 1375363946 0.2835072544037172 treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016778_0.png resize: (114, 117) 1375363947 -3.9730844710435007 treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016781_0.png resize: (249, 579) 1375363948 -1.6209239544220666 treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016782_0.png resize: (112, 163) 1375363949 -3.4961095456285234 treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016783_0.png resize: (137, 124) 1375363950 -3.512930999902233 treat image : temp/1754418027_3358006_1375341105_d8b7556e0ebfcae8a3fd07ff2ec440b0_rle_crop_3904016786_0.png resize: (97, 150) 1375363951 -0.9271646732016227 treat image : temp/1754418027_3358006_1375341105_d8b7556e0ebfcae8a3fd07ff2ec440b0_rle_crop_3904016788_0.png resize: (566, 355) 1375363953 -0.009606583260760498 treat image : temp/1754418027_3358006_1375341103_123a38b6077e2a69b5f5d2d0fece1943_rle_crop_3904016789_0.png resize: (104, 170) 1375363955 -2.2717453603090036 treat image : temp/1754418027_3358006_1375340804_95b1ce34aac564c3406b77ef97fbaa84_rle_crop_3904016794_0.png resize: (521, 322) 1375363957 0.5863080500077545 treat image : temp/1754418027_3358006_1375340778_77abc26e0ed208a37932b3dcdff5f268_rle_crop_3904016795_0.png resize: (167, 141) 1375363958 -1.3003885570645226 treat image : temp/1754418027_3358006_1375340753_440b21a64a18ef9a194692a565c7e628_rle_crop_3904016798_0.png resize: (151, 167) 1375363959 -0.8689879522548983 treat image : temp/1754418027_3358006_1375340702_a30e56f5c2ca19e457cd5f2058e80c67_rle_crop_3904016799_0.png resize: (494, 312) 1375363960 0.28231369514008514 treat image : temp/1754418027_3358006_1375340642_a7993fbc0cf25e896469815487236bab_rle_crop_3904016800_0.png resize: (540, 338) 1375363961 0.2669219481401258 treat image : temp/1754418027_3358006_1375340566_6f8043657a227dbffb0614aafaec2b3e_rle_crop_3904016805_0.png resize: (493, 316) 1375363962 0.43415555459886446 treat image : temp/1754418027_3358006_1375340566_6f8043657a227dbffb0614aafaec2b3e_rle_crop_3904016806_0.png resize: (917, 908) 1375363963 0.7569953924568744 treat image : temp/1754418027_3358006_1375340556_26d27c2d8730fe03357a4a8ef07a81b0_rle_crop_3904016808_0.png resize: (538, 355) 1375363964 0.062152469896074446 treat image : temp/1754418027_3358006_1375340554_b07f6f1c665ff4d6dfbbcdc134a8db7e_rle_crop_3904016811_0.png resize: (92, 153) 1375363965 -3.850891933448829 treat image : temp/1754418027_3358006_1375340554_b07f6f1c665ff4d6dfbbcdc134a8db7e_rle_crop_3904016812_0.png resize: (182, 310) 1375363966 -1.9025046008229451 treat image : temp/1754418027_3358006_1375340552_1351dc79f3f72cfe94b4d2d547d57557_rle_crop_3904016813_0.png resize: (138, 136) 1375363967 -2.9415275954992435 treat image : temp/1754418027_3358006_1375340552_1351dc79f3f72cfe94b4d2d547d57557_rle_crop_3904016814_0.png resize: (529, 349) 1375363968 0.3777138790267583 treat image : temp/1754418027_3358006_1375340535_e7ddb13e09ae616b47633e55ea0f9277_rle_crop_3904016820_0.png resize: (116, 299) 1375363969 -1.5033627114252588 treat image : temp/1754418027_3358006_1375341308_e878468461507bebb089dc01f6b648e7_rle_crop_3904016764_0.png resize: (464, 186) 1375363972 -0.8004597845906538 treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016780_0.png resize: (130, 127) 1375363973 -3.4742639807358584 treat image : temp/1754418027_3358006_1375341101_1230336a942cffdc7b8d24f3343149b5_rle_crop_3904016792_0.png resize: (120, 50) 1375363974 -2.060244087434154 treat image : temp/1754418027_3358006_1375340753_440b21a64a18ef9a194692a565c7e628_rle_crop_3904016796_0.png resize: (276, 321) 1375363975 -1.0071996252810682 treat image : temp/1754418027_3358006_1375340753_440b21a64a18ef9a194692a565c7e628_rle_crop_3904016797_0.png resize: (247, 138) 1375363976 -0.3639121219968959 treat image : temp/1754418027_3358006_1375340642_a7993fbc0cf25e896469815487236bab_rle_crop_3904016802_0.png resize: (133, 141) 1375363977 -3.7550291120975428 treat image : temp/1754418027_3358006_1375340556_26d27c2d8730fe03357a4a8ef07a81b0_rle_crop_3904016810_0.png resize: (96, 71) 1375363978 -2.38626566311465 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 87 time used for this insertion : 0.013716697692871094 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 87 time used for this insertion : 0.01721477508544922 save missing photos in datou_result : time spend for datou_step_exec : 20.553669929504395 time spend to save output : 0.035828590393066406 total time spend for step 6 : 20.58949851989746 step7:brightness Tue Aug 5 20:22:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1754418027_3358006_1375341554_719ba94c4dd8b7a0252f8aec7e52b521.jpg treat image : temp/1754418027_3358006_1375341308_e878468461507bebb089dc01f6b648e7.jpg treat image : temp/1754418027_3358006_1375341279_b63ddfd178e1e4cf29e952b6f75c5ff5.jpg treat image : temp/1754418027_3358006_1375341249_82b88f63a227f2283c01f09a84610095.jpg treat image : temp/1754418027_3358006_1375341225_2fef8c9dcadd7c180b7003fa4cf5d422.jpg treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984.jpg treat image : temp/1754418027_3358006_1375341107_7f3c85dd6a806c5d086433611ae7f599.jpg treat image : temp/1754418027_3358006_1375341105_d8b7556e0ebfcae8a3fd07ff2ec440b0.jpg treat image : temp/1754418027_3358006_1375341103_123a38b6077e2a69b5f5d2d0fece1943.jpg treat image : temp/1754418027_3358006_1375341101_1230336a942cffdc7b8d24f3343149b5.jpg treat image : temp/1754418027_3358006_1375341096_6391dbfcd17c3da484d5ef5e96980023.jpg treat image : temp/1754418027_3358006_1375340804_95b1ce34aac564c3406b77ef97fbaa84.jpg treat image : temp/1754418027_3358006_1375340778_77abc26e0ed208a37932b3dcdff5f268.jpg treat image : temp/1754418027_3358006_1375340753_440b21a64a18ef9a194692a565c7e628.jpg treat image : temp/1754418027_3358006_1375340702_a30e56f5c2ca19e457cd5f2058e80c67.jpg treat image : temp/1754418027_3358006_1375340642_a7993fbc0cf25e896469815487236bab.jpg treat image : temp/1754418027_3358006_1375340566_6f8043657a227dbffb0614aafaec2b3e.jpg treat image : temp/1754418027_3358006_1375340563_01724b450acd46a2e29480b0bd8a3edb.jpg treat image : temp/1754418027_3358006_1375340560_367bad363a54fc4e49020f67f7fc4624.jpg treat image : temp/1754418027_3358006_1375340556_26d27c2d8730fe03357a4a8ef07a81b0.jpg treat image : temp/1754418027_3358006_1375340554_b07f6f1c665ff4d6dfbbcdc134a8db7e.jpg treat image : temp/1754418027_3358006_1375340552_1351dc79f3f72cfe94b4d2d547d57557.jpg treat image : temp/1754418027_3358006_1375340536_d1f8fdfdd247e283b19231a3d58b198b.jpg treat image : temp/1754418027_3358006_1375340535_e7ddb13e09ae616b47633e55ea0f9277.jpg treat image : temp/1754418027_3358006_1375341308_e878468461507bebb089dc01f6b648e7_rle_crop_3904016763_0.png treat image : temp/1754418027_3358006_1375341308_e878468461507bebb089dc01f6b648e7_rle_crop_3904016765_0.png treat image : temp/1754418027_3358006_1375341308_e878468461507bebb089dc01f6b648e7_rle_crop_3904016766_0.png treat image : temp/1754418027_3358006_1375341279_b63ddfd178e1e4cf29e952b6f75c5ff5_rle_crop_3904016769_0.png treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016777_0.png treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016779_0.png treat image : temp/1754418027_3358006_1375341107_7f3c85dd6a806c5d086433611ae7f599_rle_crop_3904016784_0.png treat image : temp/1754418027_3358006_1375341107_7f3c85dd6a806c5d086433611ae7f599_rle_crop_3904016785_0.png treat image : temp/1754418027_3358006_1375341105_d8b7556e0ebfcae8a3fd07ff2ec440b0_rle_crop_3904016787_0.png treat image : temp/1754418027_3358006_1375341103_123a38b6077e2a69b5f5d2d0fece1943_rle_crop_3904016791_0.png treat image : temp/1754418027_3358006_1375341096_6391dbfcd17c3da484d5ef5e96980023_rle_crop_3904016793_0.png treat image : temp/1754418027_3358006_1375340642_a7993fbc0cf25e896469815487236bab_rle_crop_3904016801_0.png treat image : temp/1754418027_3358006_1375340642_a7993fbc0cf25e896469815487236bab_rle_crop_3904016803_0.png treat image : temp/1754418027_3358006_1375340642_a7993fbc0cf25e896469815487236bab_rle_crop_3904016804_0.png treat image : temp/1754418027_3358006_1375340563_01724b450acd46a2e29480b0bd8a3edb_rle_crop_3904016807_0.png treat image : temp/1754418027_3358006_1375340535_e7ddb13e09ae616b47633e55ea0f9277_rle_crop_3904016818_0.png treat image : temp/1754418027_3358006_1375340535_e7ddb13e09ae616b47633e55ea0f9277_rle_crop_3904016819_0.png treat image : temp/1754418027_3358006_1375341554_719ba94c4dd8b7a0252f8aec7e52b521_rle_crop_3904016761_0.png treat image : temp/1754418027_3358006_1375341103_123a38b6077e2a69b5f5d2d0fece1943_rle_crop_3904016790_0.png treat image : temp/1754418027_3358006_1375340556_26d27c2d8730fe03357a4a8ef07a81b0_rle_crop_3904016809_0.png treat image : temp/1754418027_3358006_1375340536_d1f8fdfdd247e283b19231a3d58b198b_rle_crop_3904016815_0.png treat image : temp/1754418027_3358006_1375340536_d1f8fdfdd247e283b19231a3d58b198b_rle_crop_3904016816_0.png treat image : temp/1754418027_3358006_1375340536_d1f8fdfdd247e283b19231a3d58b198b_rle_crop_3904016817_0.png treat image : temp/1754418027_3358006_1375341554_719ba94c4dd8b7a0252f8aec7e52b521_rle_crop_3904016758_0.png treat image : temp/1754418027_3358006_1375341554_719ba94c4dd8b7a0252f8aec7e52b521_rle_crop_3904016759_0.png treat image : temp/1754418027_3358006_1375341554_719ba94c4dd8b7a0252f8aec7e52b521_rle_crop_3904016760_0.png treat image : temp/1754418027_3358006_1375341554_719ba94c4dd8b7a0252f8aec7e52b521_rle_crop_3904016762_0.png treat image : temp/1754418027_3358006_1375341308_e878468461507bebb089dc01f6b648e7_rle_crop_3904016767_0.png treat image : temp/1754418027_3358006_1375341279_b63ddfd178e1e4cf29e952b6f75c5ff5_rle_crop_3904016768_0.png treat image : temp/1754418027_3358006_1375341279_b63ddfd178e1e4cf29e952b6f75c5ff5_rle_crop_3904016770_0.png treat image : temp/1754418027_3358006_1375341225_2fef8c9dcadd7c180b7003fa4cf5d422_rle_crop_3904016771_0.png treat image : temp/1754418027_3358006_1375341225_2fef8c9dcadd7c180b7003fa4cf5d422_rle_crop_3904016772_0.png treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016773_0.png treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016774_0.png treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016775_0.png treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016776_0.png treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016778_0.png treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016781_0.png treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016782_0.png treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016783_0.png treat image : temp/1754418027_3358006_1375341105_d8b7556e0ebfcae8a3fd07ff2ec440b0_rle_crop_3904016786_0.png treat image : temp/1754418027_3358006_1375341105_d8b7556e0ebfcae8a3fd07ff2ec440b0_rle_crop_3904016788_0.png treat image : temp/1754418027_3358006_1375341103_123a38b6077e2a69b5f5d2d0fece1943_rle_crop_3904016789_0.png treat image : temp/1754418027_3358006_1375340804_95b1ce34aac564c3406b77ef97fbaa84_rle_crop_3904016794_0.png treat image : temp/1754418027_3358006_1375340778_77abc26e0ed208a37932b3dcdff5f268_rle_crop_3904016795_0.png treat image : temp/1754418027_3358006_1375340753_440b21a64a18ef9a194692a565c7e628_rle_crop_3904016798_0.png treat image : temp/1754418027_3358006_1375340702_a30e56f5c2ca19e457cd5f2058e80c67_rle_crop_3904016799_0.png treat image : temp/1754418027_3358006_1375340642_a7993fbc0cf25e896469815487236bab_rle_crop_3904016800_0.png treat image : temp/1754418027_3358006_1375340566_6f8043657a227dbffb0614aafaec2b3e_rle_crop_3904016805_0.png treat image : temp/1754418027_3358006_1375340566_6f8043657a227dbffb0614aafaec2b3e_rle_crop_3904016806_0.png treat image : temp/1754418027_3358006_1375340556_26d27c2d8730fe03357a4a8ef07a81b0_rle_crop_3904016808_0.png treat image : temp/1754418027_3358006_1375340554_b07f6f1c665ff4d6dfbbcdc134a8db7e_rle_crop_3904016811_0.png treat image : temp/1754418027_3358006_1375340554_b07f6f1c665ff4d6dfbbcdc134a8db7e_rle_crop_3904016812_0.png treat image : temp/1754418027_3358006_1375340552_1351dc79f3f72cfe94b4d2d547d57557_rle_crop_3904016813_0.png treat image : temp/1754418027_3358006_1375340552_1351dc79f3f72cfe94b4d2d547d57557_rle_crop_3904016814_0.png treat image : temp/1754418027_3358006_1375340535_e7ddb13e09ae616b47633e55ea0f9277_rle_crop_3904016820_0.png treat image : temp/1754418027_3358006_1375341308_e878468461507bebb089dc01f6b648e7_rle_crop_3904016764_0.png treat image : temp/1754418027_3358006_1375341199_5b68eb957378c0ac464cfeaa19b09984_rle_crop_3904016780_0.png treat image : temp/1754418027_3358006_1375341101_1230336a942cffdc7b8d24f3343149b5_rle_crop_3904016792_0.png treat image : temp/1754418027_3358006_1375340753_440b21a64a18ef9a194692a565c7e628_rle_crop_3904016796_0.png treat image : temp/1754418027_3358006_1375340753_440b21a64a18ef9a194692a565c7e628_rle_crop_3904016797_0.png treat image : temp/1754418027_3358006_1375340642_a7993fbc0cf25e896469815487236bab_rle_crop_3904016802_0.png treat image : temp/1754418027_3358006_1375340556_26d27c2d8730fe03357a4a8ef07a81b0_rle_crop_3904016810_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 87 time used for this insertion : 0.020891904830932617 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 87 time used for this insertion : 0.01900315284729004 save missing photos in datou_result : time spend for datou_step_exec : 6.160154342651367 time spend to save output : 0.04469656944274902 total time spend for step 7 : 6.204850912094116 step8:velours_tree Tue Aug 5 20:22:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.10383439064025879 time spend to save output : 4.482269287109375e-05 total time spend for step 8 : 0.10387921333312988 step9:send_mail_cod Tue Aug 5 20:22:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25698117_05-08-2025_20_22_29.pdf 25701129 imagette257011291754418149 25701130 imagette257011301754418149 25701131 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette257011311754418149 25701132 imagette257011321754418150 25701133 imagette257011331754418150 25701134 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette257011341754418150 25701135 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette257011351754418150 25701136 imagette257011361754418150 25701137 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette257011371754418150 25701139 change filename to text .imagette257011391754418152 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25698117 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25701129,25701130,25701131,25701132,25701133,25701134,25701135,25701136,25701137,25701138,25701139?tags=flou,background,papier,metal,pehd,autre,carton,mal_croppe,pet_clair,environnement,pet_fonce args[1375341554] : ((1375341554, -0.03013194102584501, 492688767), (1375341554, 0.26851308838100374, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375341308] : ((1375341308, 2.4006561879399975, 492688767), (1375341308, 0.2040309395167712, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375341279] : ((1375341279, 0.8629520404479947, 492688767), (1375341279, 0.6872422996027617, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375341249] : ((1375341249, 1.2604152766380856, 492688767), (1375341249, 0.6421906878566355, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375341225] : ((1375341225, 0.5561363396809328, 492688767), (1375341225, 0.6634331364427573, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375341199] : ((1375341199, -3.2329493041705915, 492609224), (1375341199, 0.4315622660253886, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375341107] : ((1375341107, -1.5658759031891847, 492688767), (1375341107, 0.262739148028309, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375341105] : ((1375341105, -0.2737316724473346, 492688767), (1375341105, 0.5159071163866465, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375341103] : ((1375341103, -1.49589562895054, 492688767), (1375341103, 0.3570258394369761, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375341101] : ((1375341101, 1.4361109856801066, 492688767), (1375341101, 0.37582402440222024, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375341096] : ((1375341096, 0.09818616402024123, 492688767), (1375341096, 0.664341351252364, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375340804] : ((1375340804, -0.8348916497393273, 492688767), (1375340804, 0.7643594224412608, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375340778] : ((1375340778, 0.7883390541508695, 492688767), (1375340778, 0.6113395360631768, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375340753] : ((1375340753, 0.089605632437321, 492688767), (1375340753, 0.6719374454712425, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375340702] : ((1375340702, -0.1436452367804803, 492688767), (1375340702, 0.863033520154935, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375340642] : ((1375340642, -4.999350173215285, 492609224), (1375340642, 0.4749773845082605, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375340566] : ((1375340566, -0.8242952372417627, 492688767), (1375340566, 0.5458307871276078, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375340563] : ((1375340563, 0.8861435835481362, 492688767), (1375340563, 0.7030602708157745, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375340560] : ((1375340560, -2.787651929224969, 492609224), (1375340560, 1.1360318763127255, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375340556] : ((1375340556, -5.044153652767635, 492609224), (1375340556, 0.4676565481346019, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375340554] : ((1375340554, -3.107632831750186, 492609224), (1375340554, 0.8584757825603527, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375340552] : ((1375340552, -4.303561581285255, 492609224), (1375340552, 0.6412815079486979, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375340536] : ((1375340536, 1.329163817477925, 492688767), (1375340536, 0.35351253799219845, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com args[1375340535] : ((1375340535, 1.1293177440464035, 492688767), (1375340535, 0.33518073680466864, 2107752395), '0.08384162808641976') We are sending mail with results at report@fotonower.com refus_total : 0.08384162808641976 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25698117 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25698117_05-08-2025_20_22_29.pdf results_Auto_P25698117_05-08-2025_20_22_29.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25698117_05-08-2025_20_22_29.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25698117','results_Auto_P25698117_05-08-2025_20_22_29.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25698117_05-08-2025_20_22_29.pdf','pdf','','0.38','0.08384162808641976') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25698117

https://www.fotonower.com/image?json=false&list_photos_id=1375341554
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375341308
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.4006561879399975)
https://www.fotonower.com/image?json=false&list_photos_id=1375341279
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375341249
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.2604152766380856)
https://www.fotonower.com/image?json=false&list_photos_id=1375341225
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375341199
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375341107
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375341105
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375341103
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375341101
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.4361109856801066)
https://www.fotonower.com/image?json=false&list_photos_id=1375341096
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375340804
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375340778
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375340753
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375340702
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375340642
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375340566
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375340563
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375340560
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375340556
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375340554
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375340552
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375340536
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.329163817477925)
https://www.fotonower.com/image?json=false&list_photos_id=1375340535
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1293177440464035)

Dans ces conditions,le taux de refus est: 8.38%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/25701131?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/25701134?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/25701135?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25701137?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/25701139?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25698117_05-08-2025_20_22_29.pdf.

Lien vers velours :https://www.fotonower.com/velours/25701129,25701130,25701131,25701132,25701133,25701134,25701135,25701136,25701137,25701138,25701139?tags=flou,background,papier,metal,pehd,autre,carton,mal_croppe,pet_clair,environnement,pet_fonce.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 05 Aug 2025 18:22:34 GMT Content-Length: 0 Connection: close X-Message-Id: wnU58Ut8Rh64DO9DZ7MtlQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1375341554, 1375341308, 1375341279, 1375341249, 1375341225, 1375341199, 1375341107, 1375341105, 1375341103, 1375341101, 1375341096, 1375340804, 1375340778, 1375340753, 1375340702, 1375340642, 1375340566, 1375340563, 1375340560, 1375340556, 1375340554, 1375340552, 1375340536, 1375340535] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341554', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341308', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341279', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341249', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341225', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341199', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341107', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341105', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341103', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341101', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341096', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340804', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340778', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340753', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340702', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340642', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340566', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340563', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340560', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340556', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340554', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340552', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340536', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340535', None, None, None, None, None, '3452685') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.017826557159423828 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.369859933853149 time spend to save output : 0.018112659454345703 total time spend for step 9 : 5.387972593307495 step10:split_time_score Tue Aug 5 20:22:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 23), ('18', 1)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05082025 25698117 Nombre de photos uploadées : 24 / 23040 (0%) 05082025 25698117 Nombre de photos taguées (types de déchets): 0 / 24 (0%) 05082025 25698117 Nombre de photos taguées (volume) : 0 / 24 (0%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 6.9141387939453125e-06 ???????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0011866092681884766 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.21009373664855957 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.1738592983341247 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25689801_05-08-2025_16_03_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25689801 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25689801 AND mptpi.`type`=3594 To do Qualite : 0.2467869285300926 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25689807_05-08-2025_15_52_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25689807 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25689807 AND mptpi.`type`=3594 To do Qualite : 0.0375950440457819 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25683835_05-08-2025_14_51_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25683835 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25683835 AND mptpi.`type`=3594 To do Qualite : 0.1160300925925926 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25678966_05-08-2025_11_32_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25678966 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25678966 AND mptpi.`type`=3594 To do Qualite : 0.08013306166409463 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25678972_05-08-2025_11_21_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25678972 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25678972 AND mptpi.`type`=3594 To do Qualite : 0.0701640866126543 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25683843_05-08-2025_13_03_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25683843 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25683843 AND mptpi.`type`=3594 To do Qualite : 0.09828667534722223 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25683845_05-08-2025_12_51_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25683845 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25683845 AND mptpi.`type`=3594 To do Qualite : 0.04753419978137861 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25683849_05-08-2025_12_41_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25683849 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25683849 AND mptpi.`type`=3594 To do Qualite : 0.122842399691358 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25685870_05-08-2025_13_51_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25685870 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25685870 AND mptpi.`type`=3594 To do Qualite : 0.03421862309129305 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25685872_05-08-2025_13_42_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25685872 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25685872 AND mptpi.`type`=3594 To do Qualite : 0.34968209368908376 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25686587_05-08-2025_14_25_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25686587 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25686587 AND mptpi.`type`=3594 To do Qualite : 0.274069637345679 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25686588_05-08-2025_14_11_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25686588 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25686588 AND mptpi.`type`=3594 To do Qualite : 0.09983510963220164 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25689810_05-08-2025_16_52_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25689810 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25689810 AND mptpi.`type`=3594 To do Qualite : 0.16618097993827163 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25696627_05-08-2025_19_02_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25696627 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25696627 AND mptpi.`type`=3594 To do Qualite : 0.2670682351020892 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25696630_05-08-2025_20_02_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25696630 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25696630 AND mptpi.`type`=3594 To do Qualite : 0.08633233375420875 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25696632_05-08-2025_18_41_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25696632 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25696632 AND mptpi.`type`=3594 To do Qualite : 0.08384162808641976 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25698117_05-08-2025_20_22_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25698117 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25698117 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05082025': {'nb_upload': 24, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1375341554, 1375341308, 1375341279, 1375341249, 1375341225, 1375341199, 1375341107, 1375341105, 1375341103, 1375341101, 1375341096, 1375340804, 1375340778, 1375340753, 1375340702, 1375340642, 1375340566, 1375340563, 1375340560, 1375340556, 1375340554, 1375340552, 1375340536, 1375340535] Looping around the photos to save general results len do output : 1 /25698117Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341554', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341308', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341279', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341249', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341225', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341199', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341107', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341105', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341103', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341101', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375341096', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340804', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340778', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340753', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340702', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340642', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340566', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340563', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340560', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340556', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340554', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340552', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340536', None, None, None, None, None, '3452685') ('3318', None, None, None, None, None, None, None, '3452685') ('3318', '25698117', '1375340535', None, None, None, None, None, '3452685') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 25 time used for this insertion : 0.018215417861938477 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.3770830631256104 time spend to save output : 0.01850724220275879 total time spend for step 10 : 1.3955903053283691 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 24 set_done_treatment 73.58user 33.50system 2:11.19elapsed 81%CPU (0avgtext+0avgdata 3064328maxresident)k 505336inputs+34504outputs (189major+2306771minor)pagefaults 0swaps