python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3764676 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3685271'] with mtr_portfolio_ids : ['26690816'] and first list_photo_ids : [] new path : /proc/3764676/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 19 ; length of list_pids : 19 ; length of list_args : 19 time to download the photos : 3.0628437995910645 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Sep 10 20:30:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10594 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-10 20:30:33.990889: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-10 20:30:33.997828: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-10 20:30:33.999154: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f64d0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-10 20:30:33.999186: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-10 20:30:34.001272: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-10 20:30:34.109444: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x21f14a80 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-10 20:30:34.109480: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-10 20:30:34.110765: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-10 20:30:34.111101: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-10 20:30:34.113771: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-10 20:30:34.116186: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-10 20:30:34.116668: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-10 20:30:34.119078: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-10 20:30:34.120248: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-10 20:30:34.124749: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-10 20:30:34.126264: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-10 20:30:34.126315: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-10 20:30:34.127026: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-10 20:30:34.127040: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-10 20:30:34.127048: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-10 20:30:34.128311: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9669 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-10 20:30:34.403856: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-10 20:30:34.403950: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-10 20:30:34.403980: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-10 20:30:34.404006: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-10 20:30:34.404031: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-10 20:30:34.404057: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-10 20:30:34.404082: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-10 20:30:34.404107: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-10 20:30:34.405843: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-10 20:30:34.407106: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-10 20:30:34.407155: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-10 20:30:34.407171: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-10 20:30:34.407185: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-10 20:30:34.407199: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-10 20:30:34.407214: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-10 20:30:34.407227: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-10 20:30:34.407242: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-10 20:30:34.408533: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-10 20:30:34.408565: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-10 20:30:34.408574: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-10 20:30:34.408581: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-10 20:30:34.409911: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9669 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-10 20:30:42.060016: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-10 20:30:42.301217: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 19 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 Detection mask done ! Trying to reset tf kernel 3765130 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 726 tf kernel not reseted sub process len(results) : 19 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 19 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5621 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00030112266540527344 nb_pixel_total : 8719 time to create 1 rle with old method : 0.011499166488647461 length of segment : 91 time for calcul the mask position with numpy : 0.0007231235504150391 nb_pixel_total : 32521 time to create 1 rle with old method : 0.03647732734680176 length of segment : 215 time for calcul the mask position with numpy : 0.00013303756713867188 nb_pixel_total : 4196 time to create 1 rle with old method : 0.0050928592681884766 length of segment : 65 time for calcul the mask position with numpy : 0.000148773193359375 nb_pixel_total : 6387 time to create 1 rle with old method : 0.007560014724731445 length of segment : 94 time for calcul the mask position with numpy : 0.0002536773681640625 nb_pixel_total : 13212 time to create 1 rle with old method : 0.01529693603515625 length of segment : 150 time for calcul the mask position with numpy : 0.00028896331787109375 nb_pixel_total : 12870 time to create 1 rle with old method : 0.014627695083618164 length of segment : 157 time for calcul the mask position with numpy : 0.0002224445343017578 nb_pixel_total : 9386 time to create 1 rle with old method : 0.011288642883300781 length of segment : 145 time for calcul the mask position with numpy : 0.0002689361572265625 nb_pixel_total : 8980 time to create 1 rle with old method : 0.010220527648925781 length of segment : 142 time for calcul the mask position with numpy : 0.0007686614990234375 nb_pixel_total : 14377 time to create 1 rle with old method : 0.016262054443359375 length of segment : 225 time for calcul the mask position with numpy : 0.0022258758544921875 nb_pixel_total : 103032 time to create 1 rle with old method : 0.11370110511779785 length of segment : 468 time for calcul the mask position with numpy : 0.0002765655517578125 nb_pixel_total : 9787 time to create 1 rle with old method : 0.01143956184387207 length of segment : 86 time for calcul the mask position with numpy : 0.0011610984802246094 nb_pixel_total : 22117 time to create 1 rle with old method : 0.026041507720947266 length of segment : 358 time for calcul the mask position with numpy : 0.00014519691467285156 nb_pixel_total : 5003 time to create 1 rle with old method : 0.005884408950805664 length of segment : 58 time for calcul the mask position with numpy : 0.00010776519775390625 nb_pixel_total : 3312 time to create 1 rle with old method : 0.003966569900512695 length of segment : 79 time for calcul the mask position with numpy : 0.0004477500915527344 nb_pixel_total : 7108 time to create 1 rle with old method : 0.008312225341796875 length of segment : 139 time for calcul the mask position with numpy : 0.0007498264312744141 nb_pixel_total : 13957 time to create 1 rle with old method : 0.01612544059753418 length of segment : 152 time for calcul the mask position with numpy : 0.000423431396484375 nb_pixel_total : 8325 time to create 1 rle with old method : 0.010334014892578125 length of segment : 127 time for calcul the mask position with numpy : 0.00030517578125 nb_pixel_total : 5103 time to create 1 rle with old method : 0.0066754817962646484 length of segment : 96 time for calcul the mask position with numpy : 0.0003669261932373047 nb_pixel_total : 4925 time to create 1 rle with old method : 0.006249666213989258 length of segment : 81 time for calcul the mask position with numpy : 0.0006704330444335938 nb_pixel_total : 13420 time to create 1 rle with old method : 0.017281293869018555 length of segment : 155 time for calcul the mask position with numpy : 0.00046896934509277344 nb_pixel_total : 9444 time to create 1 rle with old method : 0.011957406997680664 length of segment : 111 time for calcul the mask position with numpy : 0.00045108795166015625 nb_pixel_total : 4362 time to create 1 rle with old method : 0.00949716567993164 length of segment : 96 time for calcul the mask position with numpy : 0.00035262107849121094 nb_pixel_total : 4629 time to create 1 rle with old method : 0.009247064590454102 length of segment : 61 time for calcul the mask position with numpy : 0.0006399154663085938 nb_pixel_total : 25364 time to create 1 rle with old method : 0.031937599182128906 length of segment : 167 time for calcul the mask position with numpy : 0.0004978179931640625 nb_pixel_total : 9946 time to create 1 rle with old method : 0.01197504997253418 length of segment : 173 time for calcul the mask position with numpy : 0.01694488525390625 nb_pixel_total : 651434 time to create 1 rle with new method : 0.030643224716186523 length of segment : 972 time for calcul the mask position with numpy : 0.0001614093780517578 nb_pixel_total : 2335 time to create 1 rle with old method : 0.0029692649841308594 length of segment : 52 time for calcul the mask position with numpy : 0.00038814544677734375 nb_pixel_total : 16377 time to create 1 rle with old method : 0.018598318099975586 length of segment : 188 time for calcul the mask position with numpy : 0.0005724430084228516 nb_pixel_total : 26094 time to create 1 rle with old method : 0.03125262260437012 length of segment : 268 time for calcul the mask position with numpy : 0.0032236576080322266 nb_pixel_total : 107682 time to create 1 rle with old method : 0.12288141250610352 length of segment : 499 time for calcul the mask position with numpy : 0.00041031837463378906 nb_pixel_total : 7978 time to create 1 rle with old method : 0.009166955947875977 length of segment : 111 time for calcul the mask position with numpy : 0.0008895397186279297 nb_pixel_total : 23998 time to create 1 rle with old method : 0.02794671058654785 length of segment : 294 time for calcul the mask position with numpy : 0.002251148223876953 nb_pixel_total : 56015 time to create 1 rle with old method : 0.06497001647949219 length of segment : 417 time for calcul the mask position with numpy : 0.0035169124603271484 nb_pixel_total : 104356 time to create 1 rle with old method : 0.1206214427947998 length of segment : 515 time for calcul the mask position with numpy : 0.0004062652587890625 nb_pixel_total : 12649 time to create 1 rle with old method : 0.016808748245239258 length of segment : 102 time for calcul the mask position with numpy : 0.01610255241394043 nb_pixel_total : 662637 time to create 1 rle with new method : 0.03485465049743652 length of segment : 993 time for calcul the mask position with numpy : 0.0005121231079101562 nb_pixel_total : 15808 time to create 1 rle with old method : 0.019219636917114258 length of segment : 102 time for calcul the mask position with numpy : 0.00018906593322753906 nb_pixel_total : 2461 time to create 1 rle with old method : 0.0031096935272216797 length of segment : 61 time for calcul the mask position with numpy : 0.0006532669067382812 nb_pixel_total : 14575 time to create 1 rle with old method : 0.017300128936767578 length of segment : 170 time for calcul the mask position with numpy : 0.0008654594421386719 nb_pixel_total : 12440 time to create 1 rle with old method : 0.016463518142700195 length of segment : 395 time for calcul the mask position with numpy : 0.0007271766662597656 nb_pixel_total : 19426 time to create 1 rle with old method : 0.023111343383789062 length of segment : 183 time for calcul the mask position with numpy : 0.003375530242919922 nb_pixel_total : 103085 time to create 1 rle with old method : 0.12048625946044922 length of segment : 536 time for calcul the mask position with numpy : 0.0005338191986083984 nb_pixel_total : 9810 time to create 1 rle with old method : 0.013835668563842773 length of segment : 170 time for calcul the mask position with numpy : 0.00030112266540527344 nb_pixel_total : 8536 time to create 1 rle with old method : 0.010229349136352539 length of segment : 109 time for calcul the mask position with numpy : 0.0003185272216796875 nb_pixel_total : 3491 time to create 1 rle with old method : 0.004228830337524414 length of segment : 66 time for calcul the mask position with numpy : 0.0002923011779785156 nb_pixel_total : 7337 time to create 1 rle with old method : 0.008626937866210938 length of segment : 95 time for calcul the mask position with numpy : 0.0004608631134033203 nb_pixel_total : 11642 time to create 1 rle with old method : 0.014884471893310547 length of segment : 170 time for calcul the mask position with numpy : 0.0005209445953369141 nb_pixel_total : 15903 time to create 1 rle with old method : 0.018024206161499023 length of segment : 198 time for calcul the mask position with numpy : 0.003804445266723633 nb_pixel_total : 106266 time to create 1 rle with old method : 0.12803959846496582 length of segment : 528 time for calcul the mask position with numpy : 0.0003724098205566406 nb_pixel_total : 3712 time to create 1 rle with old method : 0.005270242691040039 length of segment : 89 time for calcul the mask position with numpy : 0.00022268295288085938 nb_pixel_total : 3466 time to create 1 rle with old method : 0.004521608352661133 length of segment : 69 time for calcul the mask position with numpy : 0.0003600120544433594 nb_pixel_total : 6825 time to create 1 rle with old method : 0.008531570434570312 length of segment : 171 time for calcul the mask position with numpy : 0.00022721290588378906 nb_pixel_total : 5171 time to create 1 rle with old method : 0.006469249725341797 length of segment : 93 time for calcul the mask position with numpy : 0.00019741058349609375 nb_pixel_total : 4972 time to create 1 rle with old method : 0.0062673091888427734 length of segment : 76 time for calcul the mask position with numpy : 0.00010728836059570312 nb_pixel_total : 3125 time to create 1 rle with old method : 0.0041065216064453125 length of segment : 46 time for calcul the mask position with numpy : 0.0028450489044189453 nb_pixel_total : 104826 time to create 1 rle with old method : 0.12509584426879883 length of segment : 529 time for calcul the mask position with numpy : 0.0003216266632080078 nb_pixel_total : 7489 time to create 1 rle with old method : 0.009182453155517578 length of segment : 97 time for calcul the mask position with numpy : 0.00038743019104003906 nb_pixel_total : 9400 time to create 1 rle with old method : 0.011644363403320312 length of segment : 105 time for calcul the mask position with numpy : 0.0006608963012695312 nb_pixel_total : 13522 time to create 1 rle with old method : 0.01628875732421875 length of segment : 158 time for calcul the mask position with numpy : 0.00014972686767578125 nb_pixel_total : 2180 time to create 1 rle with old method : 0.002888917922973633 length of segment : 37 time for calcul the mask position with numpy : 0.0004875659942626953 nb_pixel_total : 11221 time to create 1 rle with old method : 0.013527154922485352 length of segment : 181 time for calcul the mask position with numpy : 0.0006537437438964844 nb_pixel_total : 28736 time to create 1 rle with old method : 0.03431248664855957 length of segment : 237 time for calcul the mask position with numpy : 0.0004634857177734375 nb_pixel_total : 12898 time to create 1 rle with old method : 0.015925884246826172 length of segment : 170 time for calcul the mask position with numpy : 0.0003921985626220703 nb_pixel_total : 9947 time to create 1 rle with old method : 0.012439489364624023 length of segment : 126 time for calcul the mask position with numpy : 0.0006194114685058594 nb_pixel_total : 14675 time to create 1 rle with old method : 0.017889738082885742 length of segment : 165 time for calcul the mask position with numpy : 0.00019097328186035156 nb_pixel_total : 8298 time to create 1 rle with old method : 0.010234355926513672 length of segment : 97 time for calcul the mask position with numpy : 0.00042891502380371094 nb_pixel_total : 12316 time to create 1 rle with old method : 0.015335321426391602 length of segment : 146 time for calcul the mask position with numpy : 0.0003235340118408203 nb_pixel_total : 6566 time to create 1 rle with old method : 0.009036779403686523 length of segment : 124 time for calcul the mask position with numpy : 0.00041604042053222656 nb_pixel_total : 17451 time to create 1 rle with old method : 0.02103567123413086 length of segment : 177 time for calcul the mask position with numpy : 0.00052642822265625 nb_pixel_total : 13521 time to create 1 rle with old method : 0.01663041114807129 length of segment : 201 time for calcul the mask position with numpy : 0.0005173683166503906 nb_pixel_total : 12844 time to create 1 rle with old method : 0.01570296287536621 length of segment : 214 time for calcul the mask position with numpy : 0.00018453598022460938 nb_pixel_total : 3347 time to create 1 rle with old method : 0.004202127456665039 length of segment : 73 time for calcul the mask position with numpy : 0.0002815723419189453 nb_pixel_total : 4715 time to create 1 rle with old method : 0.0058498382568359375 length of segment : 110 time for calcul the mask position with numpy : 0.0003724098205566406 nb_pixel_total : 9723 time to create 1 rle with old method : 0.011886835098266602 length of segment : 155 time for calcul the mask position with numpy : 0.009513139724731445 nb_pixel_total : 510727 time to create 1 rle with new method : 0.021481752395629883 length of segment : 1627 time for calcul the mask position with numpy : 0.00020837783813476562 nb_pixel_total : 5509 time to create 1 rle with old method : 0.006810903549194336 length of segment : 112 time for calcul the mask position with numpy : 0.0001220703125 nb_pixel_total : 1761 time to create 1 rle with old method : 0.0023610591888427734 length of segment : 38 time for calcul the mask position with numpy : 0.012409448623657227 nb_pixel_total : 681512 time to create 1 rle with new method : 0.020224809646606445 length of segment : 974 time for calcul the mask position with numpy : 0.000370025634765625 nb_pixel_total : 14864 time to create 1 rle with old method : 0.018239974975585938 length of segment : 83 time for calcul the mask position with numpy : 0.0026743412017822266 nb_pixel_total : 111712 time to create 1 rle with old method : 0.1302957534790039 length of segment : 533 time for calcul the mask position with numpy : 0.0004413127899169922 nb_pixel_total : 12741 time to create 1 rle with old method : 0.015453100204467773 length of segment : 119 time for calcul the mask position with numpy : 0.0008492469787597656 nb_pixel_total : 23809 time to create 1 rle with old method : 0.028728723526000977 length of segment : 281 time spent for convertir_results : 4.966274976730347 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 82 chid ids of type : 3594 Number RLEs to save : 18298 save missing photos in datou_result : time spend for datou_step_exec : 32.92552137374878 time spend to save output : 1.1058287620544434 total time spend for step 1 : 34.03135013580322 step2:crop_condition Wed Sep 10 20:31:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 19 ! batch 1 Loaded 82 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 33 About to insert : list_path_to_insert length 33 new photo from crops ! About to upload 33 photos upload in portfolio : 3736932 init cache_photo without model_param we have 33 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757529068_3764676 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 33 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.157874345779419 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757529087_3764676 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.3353464603424072 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757529091_3764676 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9794163703918457 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 3736932 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757529097_3764676 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 24 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.710031032562256 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757529104_3764676 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.3935370445251465 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757529107_3764676 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5347776412963867 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1382782734, 1382782726, 1382782697, 1382782696, 1382782695, 1382782693, 1382782691, 1382782689, 1382782673, 1382782666, 1382782664, 1382782661, 1382782658, 1382782656, 1382782644, 1382782642, 1382782639, 1382782636, 1382782634] Looping around the photos to save general results len do output : 82 /1383113334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383113429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782734', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782726', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782697', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782696', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782695', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782693', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782691', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782689', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782673', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782666', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782664', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782661', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782658', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782656', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782644', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782642', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782639', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782636', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782634', None, None, None, None, None, '3685271') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 265 time used for this insertion : 0.023435115814208984 save_final save missing photos in datou_result : time spend for datou_step_exec : 42.55911874771118 time spend to save output : 0.026812076568603516 total time spend for step 2 : 42.585930824279785 step3:rle_unique_nms_with_priority Wed Sep 10 20:31:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 82 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 0.5879969596862793 time for calcul the mask position with numpy : 0.06456184387207031 nb_pixel_total : 1986309 time to create 1 rle with new method : 0.1953568458557129 time for calcul the mask position with numpy : 0.006627798080444336 nb_pixel_total : 9386 time to create 1 rle with old method : 0.010890007019042969 time for calcul the mask position with numpy : 0.006728172302246094 nb_pixel_total : 12870 time to create 1 rle with old method : 0.014878988265991211 time for calcul the mask position with numpy : 0.006846427917480469 nb_pixel_total : 13212 time to create 1 rle with old method : 0.015507936477661133 time for calcul the mask position with numpy : 0.007142305374145508 nb_pixel_total : 6387 time to create 1 rle with old method : 0.007599830627441406 time for calcul the mask position with numpy : 0.007887125015258789 nb_pixel_total : 4196 time to create 1 rle with old method : 0.0051898956298828125 time for calcul the mask position with numpy : 0.008933544158935547 nb_pixel_total : 32521 time to create 1 rle with old method : 0.03936433792114258 time for calcul the mask position with numpy : 0.006902933120727539 nb_pixel_total : 8719 time to create 1 rle with old method : 0.010132312774658203 create new chi : 0.42505931854248047 time to delete rle : 0.01772141456604004 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++Number RLEs to save : 2914 TO DO : save crop sub photo not yet done ! save time : 0.1952214241027832 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 0.09179544448852539 time for calcul the mask position with numpy : 0.13971352577209473 nb_pixel_total : 1907052 time to create 1 rle with new method : 0.263843297958374 time for calcul the mask position with numpy : 0.007188320159912109 nb_pixel_total : 3312 time to create 1 rle with old method : 0.0035822391510009766 time for calcul the mask position with numpy : 0.006928682327270508 nb_pixel_total : 5003 time to create 1 rle with old method : 0.005877971649169922 time for calcul the mask position with numpy : 0.007656574249267578 nb_pixel_total : 22057 time to create 1 rle with old method : 0.024998188018798828 time for calcul the mask position with numpy : 0.007188558578491211 nb_pixel_total : 9787 time to create 1 rle with old method : 0.010663986206054688 time for calcul the mask position with numpy : 0.007910966873168945 nb_pixel_total : 103032 time to create 1 rle with old method : 0.11923384666442871 time for calcul the mask position with numpy : 0.007453203201293945 nb_pixel_total : 14377 time to create 1 rle with old method : 0.01598358154296875 time for calcul the mask position with numpy : 0.007235288619995117 nb_pixel_total : 8980 time to create 1 rle with old method : 0.00994563102722168 create new chi : 0.6564302444458008 time to delete rle : 0.0009870529174804688 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 3894 TO DO : save crop sub photo not yet done ! save time : 0.2606205940246582 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 0.10991907119750977 time for calcul the mask position with numpy : 0.08643364906311035 nb_pixel_total : 2020762 time to create 1 rle with new method : 0.17467999458312988 time for calcul the mask position with numpy : 0.007801532745361328 nb_pixel_total : 13420 time to create 1 rle with old method : 0.015700101852416992 time for calcul the mask position with numpy : 0.007719755172729492 nb_pixel_total : 4925 time to create 1 rle with old method : 0.005845069885253906 time for calcul the mask position with numpy : 0.0077571868896484375 nb_pixel_total : 5103 time to create 1 rle with old method : 0.006075382232666016 time for calcul the mask position with numpy : 0.007870197296142578 nb_pixel_total : 8325 time to create 1 rle with old method : 0.009839773178100586 time for calcul the mask position with numpy : 0.007987737655639648 nb_pixel_total : 13957 time to create 1 rle with old method : 0.016336441040039062 time for calcul the mask position with numpy : 0.007903575897216797 nb_pixel_total : 7108 time to create 1 rle with old method : 0.010486602783203125 create new chi : 0.38533544540405273 time to delete rle : 0.0007140636444091797 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 2580 TO DO : save crop sub photo not yet done ! save time : 0.19879817962646484 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.08649492263793945 time for calcul the mask position with numpy : 0.28191113471984863 nb_pixel_total : 2055165 time to create 1 rle with new method : 0.09977960586547852 time for calcul the mask position with numpy : 0.00782465934753418 nb_pixel_total : 4629 time to create 1 rle with old method : 0.005342721939086914 time for calcul the mask position with numpy : 0.007460594177246094 nb_pixel_total : 4362 time to create 1 rle with old method : 0.00733494758605957 time for calcul the mask position with numpy : 0.007770538330078125 nb_pixel_total : 9444 time to create 1 rle with old method : 0.016206741333007812 create new chi : 0.4446380138397217 time to delete rle : 0.0005109310150146484 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 1616 TO DO : save crop sub photo not yet done ! save time : 0.13708734512329102 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 0.35919666290283203 time for calcul the mask position with numpy : 0.09805107116699219 nb_pixel_total : 1234368 time to create 1 rle with new method : 0.08569669723510742 time for calcul the mask position with numpy : 0.006819486618041992 nb_pixel_total : 107682 time to create 1 rle with old method : 0.11842513084411621 time for calcul the mask position with numpy : 0.006395101547241211 nb_pixel_total : 26094 time to create 1 rle with old method : 0.029416799545288086 time for calcul the mask position with numpy : 0.00586700439453125 nb_pixel_total : 16377 time to create 1 rle with old method : 0.018522977828979492 time for calcul the mask position with numpy : 0.006229877471923828 nb_pixel_total : 2335 time to create 1 rle with old method : 0.0026400089263916016 time for calcul the mask position with numpy : 0.01039743423461914 nb_pixel_total : 651434 time to create 1 rle with new method : 0.14692091941833496 time for calcul the mask position with numpy : 0.0060918331146240234 nb_pixel_total : 9946 time to create 1 rle with old method : 0.010789632797241211 time for calcul the mask position with numpy : 0.0062177181243896484 nb_pixel_total : 25364 time to create 1 rle with old method : 0.03373360633850098 create new chi : 0.6013882160186768 time to delete rle : 0.0008928775787353516 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 5718 TO DO : save crop sub photo not yet done ! save time : 0.3449673652648926 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.05958437919616699 time for calcul the mask position with numpy : 0.019201993942260742 nb_pixel_total : 1881253 time to create 1 rle with new method : 0.033266305923461914 time for calcul the mask position with numpy : 0.007201194763183594 nb_pixel_total : 104356 time to create 1 rle with old method : 0.11992025375366211 time for calcul the mask position with numpy : 0.007150411605834961 nb_pixel_total : 56015 time to create 1 rle with old method : 0.06433320045471191 time for calcul the mask position with numpy : 0.006154060363769531 nb_pixel_total : 23998 time to create 1 rle with old method : 0.027649641036987305 time for calcul the mask position with numpy : 0.00626373291015625 nb_pixel_total : 7978 time to create 1 rle with old method : 0.008846521377563477 create new chi : 0.3074381351470947 time to delete rle : 0.0005788803100585938 batch 1 Loaded 9 chid ids of type : 3594 ++++++++Number RLEs to save : 3754 TO DO : save crop sub photo not yet done ! save time : 0.2539670467376709 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.10732221603393555 time for calcul the mask position with numpy : 0.02532792091369629 nb_pixel_total : 1380045 time to create 1 rle with new method : 0.09119677543640137 time for calcul the mask position with numpy : 0.0064694881439208984 nb_pixel_total : 2461 time to create 1 rle with old method : 0.002888917922973633 time for calcul the mask position with numpy : 0.006354808807373047 nb_pixel_total : 15808 time to create 1 rle with old method : 0.018430709838867188 time for calcul the mask position with numpy : 0.012061595916748047 nb_pixel_total : 662637 time to create 1 rle with new method : 0.2707245349884033 time for calcul the mask position with numpy : 0.007170200347900391 nb_pixel_total : 12649 time to create 1 rle with old method : 0.01466679573059082 create new chi : 0.46399855613708496 time to delete rle : 0.0005979537963867188 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3596 TO DO : save crop sub photo not yet done ! save time : 0.24763751029968262 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 0.4173283576965332 time for calcul the mask position with numpy : 0.06967616081237793 nb_pixel_total : 1902237 time to create 1 rle with new method : 0.17208242416381836 time for calcul the mask position with numpy : 0.006530046463012695 nb_pixel_total : 3491 time to create 1 rle with old method : 0.004023313522338867 time for calcul the mask position with numpy : 0.0063402652740478516 nb_pixel_total : 8536 time to create 1 rle with old method : 0.009888887405395508 time for calcul the mask position with numpy : 0.0063931941986083984 nb_pixel_total : 9810 time to create 1 rle with old method : 0.01143956184387207 time for calcul the mask position with numpy : 0.0076940059661865234 nb_pixel_total : 103085 time to create 1 rle with old method : 0.11872005462646484 time for calcul the mask position with numpy : 0.0067937374114990234 nb_pixel_total : 19426 time to create 1 rle with old method : 0.022528648376464844 time for calcul the mask position with numpy : 0.006561279296875 nb_pixel_total : 12440 time to create 1 rle with old method : 0.014740467071533203 time for calcul the mask position with numpy : 0.006672382354736328 nb_pixel_total : 14575 time to create 1 rle with old method : 0.01690983772277832 create new chi : 0.4974701404571533 time to delete rle : 0.0007264614105224609 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 4338 TO DO : save crop sub photo not yet done ! save time : 0.290020227432251 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.0637505054473877 time for calcul the mask position with numpy : 0.023443222045898438 nb_pixel_total : 1932452 time to create 1 rle with new method : 0.06411147117614746 time for calcul the mask position with numpy : 0.007529497146606445 nb_pixel_total : 106266 time to create 1 rle with old method : 0.12460827827453613 time for calcul the mask position with numpy : 0.0066721439361572266 nb_pixel_total : 15903 time to create 1 rle with old method : 0.0187227725982666 time for calcul the mask position with numpy : 0.006500720977783203 nb_pixel_total : 11642 time to create 1 rle with old method : 0.013571977615356445 time for calcul the mask position with numpy : 0.006788730621337891 nb_pixel_total : 7337 time to create 1 rle with old method : 0.008677482604980469 create new chi : 0.2812223434448242 time to delete rle : 0.0005550384521484375 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3062 TO DO : save crop sub photo not yet done ! save time : 0.21852350234985352 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.0624539852142334 time for calcul the mask position with numpy : 0.02120494842529297 nb_pixel_total : 2062045 time to create 1 rle with new method : 0.0787971019744873 time for calcul the mask position with numpy : 0.006324052810668945 nb_pixel_total : 4377 time to create 1 rle with old method : 0.0052144527435302734 time for calcul the mask position with numpy : 0.006289005279541016 nb_pixel_total : 3466 time to create 1 rle with old method : 0.004139900207519531 time for calcul the mask position with numpy : 0.007578372955322266 nb_pixel_total : 3712 time to create 1 rle with old method : 0.004419803619384766 create new chi : 0.13429665565490723 time to delete rle : 0.0003147125244140625 batch 1 Loaded 7 chid ids of type : 3594 +++++++Number RLEs to save : 1669 TO DO : save crop sub photo not yet done ! save time : 0.14094853401184082 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.06836152076721191 time for calcul the mask position with numpy : 0.025415658950805664 nb_pixel_total : 2060332 time to create 1 rle with new method : 0.12509584426879883 time for calcul the mask position with numpy : 0.0059931278228759766 nb_pixel_total : 3125 time to create 1 rle with old method : 0.0035042762756347656 time for calcul the mask position with numpy : 0.005899667739868164 nb_pixel_total : 4972 time to create 1 rle with old method : 0.005469083786010742 time for calcul the mask position with numpy : 0.005987644195556641 nb_pixel_total : 5171 time to create 1 rle with old method : 0.005791902542114258 create new chi : 0.18347930908203125 time to delete rle : 0.0002777576446533203 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1507 TO DO : save crop sub photo not yet done ! save time : 0.13010931015014648 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.15688061714172363 time for calcul the mask position with numpy : 0.06756758689880371 nb_pixel_total : 1936183 time to create 1 rle with new method : 0.10814142227172852 time for calcul the mask position with numpy : 0.0070743560791015625 nb_pixel_total : 2180 time to create 1 rle with old method : 0.0026171207427978516 time for calcul the mask position with numpy : 0.0065648555755615234 nb_pixel_total : 13522 time to create 1 rle with old method : 0.015939950942993164 time for calcul the mask position with numpy : 0.006426095962524414 nb_pixel_total : 9400 time to create 1 rle with old method : 0.011020660400390625 time for calcul the mask position with numpy : 0.006394386291503906 nb_pixel_total : 7489 time to create 1 rle with old method : 0.008792400360107422 time for calcul the mask position with numpy : 0.007185220718383789 nb_pixel_total : 104826 time to create 1 rle with old method : 0.12562131881713867 create new chi : 0.3837769031524658 time to delete rle : 0.000415802001953125 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 2932 TO DO : save crop sub photo not yet done ! save time : 0.20695090293884277 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.0436863899230957 time for calcul the mask position with numpy : 0.02098369598388672 nb_pixel_total : 2033643 time to create 1 rle with new method : 0.050991058349609375 time for calcul the mask position with numpy : 0.006570339202880859 nb_pixel_total : 28736 time to create 1 rle with old method : 0.03361678123474121 time for calcul the mask position with numpy : 0.006497621536254883 nb_pixel_total : 11221 time to create 1 rle with old method : 0.01310276985168457 create new chi : 0.1321249008178711 time to delete rle : 0.00039267539978027344 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1916 TO DO : save crop sub photo not yet done ! save time : 0.14663410186767578 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.10214543342590332 time for calcul the mask position with numpy : 0.31805992126464844 nb_pixel_total : 2027782 time to create 1 rle with new method : 0.0918724536895752 time for calcul the mask position with numpy : 0.006625175476074219 nb_pixel_total : 8298 time to create 1 rle with old method : 0.010453939437866211 time for calcul the mask position with numpy : 0.006905317306518555 nb_pixel_total : 14675 time to create 1 rle with old method : 0.01841139793395996 time for calcul the mask position with numpy : 0.00720977783203125 nb_pixel_total : 9947 time to create 1 rle with old method : 0.012485027313232422 time for calcul the mask position with numpy : 0.007386922836303711 nb_pixel_total : 12898 time to create 1 rle with old method : 0.016164779663085938 create new chi : 0.5060129165649414 time to delete rle : 0.0004780292510986328 batch 1 Loaded 9 chid ids of type : 3594 ++++++++Number RLEs to save : 2196 TO DO : save crop sub photo not yet done ! save time : 0.169111967086792 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.06435608863830566 time for calcul the mask position with numpy : 0.023224353790283203 nb_pixel_total : 2037267 time to create 1 rle with new method : 0.2615396976470947 time for calcul the mask position with numpy : 0.0074160099029541016 nb_pixel_total : 17451 time to create 1 rle with old method : 0.024134159088134766 time for calcul the mask position with numpy : 0.007615089416503906 nb_pixel_total : 6566 time to create 1 rle with old method : 0.01115870475769043 time for calcul the mask position with numpy : 0.007689714431762695 nb_pixel_total : 12316 time to create 1 rle with old method : 0.021954774856567383 create new chi : 0.3724508285522461 time to delete rle : 0.0006449222564697266 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1974 TO DO : save crop sub photo not yet done ! save time : 0.16827106475830078 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.22081732749938965 time for calcul the mask position with numpy : 0.13742518424987793 nb_pixel_total : 2043888 time to create 1 rle with new method : 0.5133967399597168 time for calcul the mask position with numpy : 0.006932258605957031 nb_pixel_total : 3347 time to create 1 rle with old method : 0.004038095474243164 time for calcul the mask position with numpy : 0.00741887092590332 nb_pixel_total : 12844 time to create 1 rle with old method : 0.015338420867919922 time for calcul the mask position with numpy : 0.006727933883666992 nb_pixel_total : 13521 time to create 1 rle with old method : 0.015848875045776367 create new chi : 0.719419002532959 time to delete rle : 0.0003795623779296875 batch 1 Loaded 7 chid ids of type : 3594 ++++++Number RLEs to save : 2056 TO DO : save crop sub photo not yet done ! save time : 0.16321682929992676 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.08044600486755371 time for calcul the mask position with numpy : 0.18812918663024902 nb_pixel_total : 1542926 time to create 1 rle with new method : 0.10021638870239258 time for calcul the mask position with numpy : 0.0066089630126953125 nb_pixel_total : 5509 time to create 1 rle with old method : 0.00656580924987793 time for calcul the mask position with numpy : 0.010875463485717773 nb_pixel_total : 510727 time to create 1 rle with new method : 0.14772653579711914 time for calcul the mask position with numpy : 0.006590843200683594 nb_pixel_total : 9723 time to create 1 rle with old method : 0.014738798141479492 time for calcul the mask position with numpy : 0.006659269332885742 nb_pixel_total : 4715 time to create 1 rle with old method : 0.005255460739135742 create new chi : 0.5124287605285645 time to delete rle : 0.0008652210235595703 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 5088 TO DO : save crop sub photo not yet done ! save time : 0.31979846954345703 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.05957508087158203 time for calcul the mask position with numpy : 0.050005435943603516 nb_pixel_total : 1375463 time to create 1 rle with new method : 0.2062394618988037 time for calcul the mask position with numpy : 0.006498813629150391 nb_pixel_total : 14864 time to create 1 rle with old method : 0.017124414443969727 time for calcul the mask position with numpy : 0.012722969055175781 nb_pixel_total : 681512 time to create 1 rle with new method : 0.7411842346191406 time for calcul the mask position with numpy : 0.007527351379394531 nb_pixel_total : 1761 time to create 1 rle with old method : 0.003525257110595703 create new chi : 1.0553812980651855 time to delete rle : 0.00113677978515625 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3270 TO DO : save crop sub photo not yet done ! save time : 0.2172842025756836 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.06490898132324219 time for calcul the mask position with numpy : 0.07372021675109863 nb_pixel_total : 1925338 time to create 1 rle with new method : 0.09510421752929688 time for calcul the mask position with numpy : 0.006520986557006836 nb_pixel_total : 23809 time to create 1 rle with old method : 0.027822017669677734 time for calcul the mask position with numpy : 0.0066089630126953125 nb_pixel_total : 12741 time to create 1 rle with old method : 0.01648092269897461 time for calcul the mask position with numpy : 0.007052183151245117 nb_pixel_total : 111712 time to create 1 rle with old method : 0.13152003288269043 create new chi : 0.3747537136077881 time to delete rle : 0.0005223751068115234 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2946 TO DO : save crop sub photo not yet done ! save time : 0.19859766960144043 map_output_result : {1382782734: (0.0, 'Should be the crop_list due to order', 0), 1382782726: (0.0, 'Should be the crop_list due to order', 0), 1382782697: (0.0, 'Should be the crop_list due to order', 0), 1382782696: (0.0, 'Should be the crop_list due to order', 0), 1382782695: (0.0, 'Should be the crop_list due to order', 0), 1382782693: (0.0, 'Should be the crop_list due to order', 0), 1382782691: (0.0, 'Should be the crop_list due to order', 0), 1382782689: (0.0, 'Should be the crop_list due to order', 0), 1382782673: (0.0, 'Should be the crop_list due to order', 0), 1382782666: (0.0, 'Should be the crop_list due to order', 0), 1382782664: (0.0, 'Should be the crop_list due to order', 0), 1382782661: (0.0, 'Should be the crop_list due to order', 0), 1382782658: (0.0, 'Should be the crop_list due to order', 0), 1382782656: (0.0, 'Should be the crop_list due to order', 0), 1382782644: (0.0, 'Should be the crop_list due to order', 0), 1382782642: (0.0, 'Should be the crop_list due to order', 0), 1382782639: (0.0, 'Should be the crop_list due to order', 0), 1382782636: (0.0, 'Should be the crop_list due to order', 0), 1382782634: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1382782734, 1382782726, 1382782697, 1382782696, 1382782695, 1382782693, 1382782691, 1382782689, 1382782673, 1382782666, 1382782664, 1382782661, 1382782658, 1382782656, 1382782644, 1382782642, 1382782639, 1382782636, 1382782634] Looping around the photos to save general results len do output : 19 /1382782734.Didn't retrieve data . /1382782726.Didn't retrieve data . /1382782697.Didn't retrieve data . /1382782696.Didn't retrieve data . /1382782695.Didn't retrieve data . /1382782693.Didn't retrieve data . /1382782691.Didn't retrieve data . /1382782689.Didn't retrieve data . /1382782673.Didn't retrieve data . /1382782666.Didn't retrieve data . /1382782664.Didn't retrieve data . /1382782661.Didn't retrieve data . /1382782658.Didn't retrieve data . /1382782656.Didn't retrieve data . /1382782644.Didn't retrieve data . /1382782642.Didn't retrieve data . /1382782639.Didn't retrieve data . /1382782636.Didn't retrieve data . /1382782634.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782734', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782726', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782697', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782696', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782695', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782693', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782691', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782689', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782673', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782666', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782664', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782661', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782658', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782656', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782644', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782642', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782639', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782636', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782634', None, None, None, None, None, '3685271') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 57 time used for this insertion : 0.015542984008789062 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.990616798400879 time spend to save output : 0.016565561294555664 total time spend for step 3 : 16.007182359695435 step4:ventilate_hashtags_in_portfolio Wed Sep 10 20:32:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26690816 get user id for portfolio 26690816 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26690816 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','environnement','papier','flou','pet_fonce','carton','metal','mal_croppe','background','autre','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26690816 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','environnement','papier','flou','pet_fonce','carton','metal','mal_croppe','background','autre','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26690816 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','environnement','papier','flou','pet_fonce','carton','metal','mal_croppe','background','autre','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26728776,26728777,26728778,26728779,26728780,26728781,26728782,26728783,26728784,26728785,26728786?tags=pehd,environnement,papier,flou,pet_fonce,carton,metal,mal_croppe,background,autre,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1382782734, 1382782726, 1382782697, 1382782696, 1382782695, 1382782693, 1382782691, 1382782689, 1382782673, 1382782666, 1382782664, 1382782661, 1382782658, 1382782656, 1382782644, 1382782642, 1382782639, 1382782636, 1382782634] Looping around the photos to save general results len do output : 1 /26690816. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782734', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782726', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782697', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782696', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782695', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782693', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782691', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782689', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782673', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782666', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782664', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782661', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782658', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782656', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782644', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782642', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782639', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782636', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782634', None, None, None, None, None, '3685271') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.015422582626342773 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6848468780517578 time spend to save output : 0.015803813934326172 total time spend for step 4 : 1.700650691986084 step5:final Wed Sep 10 20:32:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1382782734: ('0.10289478760558811',), 1382782726: ('0.10289478760558811',), 1382782697: ('0.10289478760558811',), 1382782696: ('0.10289478760558811',), 1382782695: ('0.10289478760558811',), 1382782693: ('0.10289478760558811',), 1382782691: ('0.10289478760558811',), 1382782689: ('0.10289478760558811',), 1382782673: ('0.10289478760558811',), 1382782666: ('0.10289478760558811',), 1382782664: ('0.10289478760558811',), 1382782661: ('0.10289478760558811',), 1382782658: ('0.10289478760558811',), 1382782656: ('0.10289478760558811',), 1382782644: ('0.10289478760558811',), 1382782642: ('0.10289478760558811',), 1382782639: ('0.10289478760558811',), 1382782636: ('0.10289478760558811',), 1382782634: ('0.10289478760558811',)} new output for save of step final : {1382782734: ('0.10289478760558811',), 1382782726: ('0.10289478760558811',), 1382782697: ('0.10289478760558811',), 1382782696: ('0.10289478760558811',), 1382782695: ('0.10289478760558811',), 1382782693: ('0.10289478760558811',), 1382782691: ('0.10289478760558811',), 1382782689: ('0.10289478760558811',), 1382782673: ('0.10289478760558811',), 1382782666: ('0.10289478760558811',), 1382782664: ('0.10289478760558811',), 1382782661: ('0.10289478760558811',), 1382782658: ('0.10289478760558811',), 1382782656: ('0.10289478760558811',), 1382782644: ('0.10289478760558811',), 1382782642: ('0.10289478760558811',), 1382782639: ('0.10289478760558811',), 1382782636: ('0.10289478760558811',), 1382782634: ('0.10289478760558811',)} [1382782734, 1382782726, 1382782697, 1382782696, 1382782695, 1382782693, 1382782691, 1382782689, 1382782673, 1382782666, 1382782664, 1382782661, 1382782658, 1382782656, 1382782644, 1382782642, 1382782639, 1382782636, 1382782634] Looping around the photos to save general results len do output : 19 /1382782734.Didn't retrieve data . /1382782726.Didn't retrieve data . /1382782697.Didn't retrieve data . /1382782696.Didn't retrieve data . /1382782695.Didn't retrieve data . /1382782693.Didn't retrieve data . /1382782691.Didn't retrieve data . /1382782689.Didn't retrieve data . /1382782673.Didn't retrieve data . /1382782666.Didn't retrieve data . /1382782664.Didn't retrieve data . /1382782661.Didn't retrieve data . /1382782658.Didn't retrieve data . /1382782656.Didn't retrieve data . /1382782644.Didn't retrieve data . /1382782642.Didn't retrieve data . /1382782639.Didn't retrieve data . /1382782636.Didn't retrieve data . /1382782634.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782734', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782726', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782697', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782696', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782695', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782693', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782691', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782689', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782673', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782666', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782664', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782661', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782658', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782656', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782644', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782642', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782639', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782636', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782634', None, None, None, None, None, '3685271') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 57 time used for this insertion : 0.01439976692199707 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1413564682006836 time spend to save output : 0.015083074569702148 total time spend for step 5 : 0.15643954277038574 step6:blur_detection Wed Sep 10 20:32:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1757529028_3764676_1382782734_323d11a1f3bde2e7859313fdfed76469.jpg resize: (1080, 1920) 1382782734 1.0615605106989916 treat image : temp/1757529028_3764676_1382782726_7d7bd5926ced552981c68778ae97dd84.jpg resize: (1080, 1920) 1382782726 -1.3561199333692435 treat image : temp/1757529028_3764676_1382782697_0e950250ce9c15cc6cd135dcd2a941f2.jpg resize: (1080, 1920) 1382782697 0.5950866876254932 treat image : temp/1757529028_3764676_1382782696_b588713972626bd61982fac1790b903f.jpg resize: (1080, 1920) 1382782696 3.0184261434391195 treat image : temp/1757529028_3764676_1382782695_34c5c535d3ec98748c1c07cd3fd31e95.jpg resize: (1080, 1920) 1382782695 1.665180425480542 treat image : temp/1757529028_3764676_1382782693_55c4e57e7d979d1f32d9ca9267d0b3da.jpg resize: (1080, 1920) 1382782693 0.5421038198369021 treat image : temp/1757529028_3764676_1382782691_86b2f31e24153fd5032b8dbfbdb89f7e.jpg resize: (1080, 1920) 1382782691 1.7727253675955936 treat image : temp/1757529028_3764676_1382782689_3ed1fd76781c3ecfb6ee7f73aeadb1ab.jpg resize: (1080, 1920) 1382782689 1.1327105571478915 treat image : temp/1757529028_3764676_1382782673_9e6977dd0b10e87306e0c30c8323a9ff.jpg resize: (1080, 1920) 1382782673 1.1994555421659356 treat image : temp/1757529028_3764676_1382782666_a6f32f80174894821f56e3c747c0dfe2.jpg resize: (1080, 1920) 1382782666 1.5844489896040401 treat image : temp/1757529028_3764676_1382782664_2d4f0b27909416280ed4f4afd7859f23.jpg resize: (1080, 1920) 1382782664 0.7767589531975003 treat image : temp/1757529028_3764676_1382782661_a3fdd4425258dc51941a13709e1d1771.jpg resize: (1080, 1920) 1382782661 0.7132104217952774 treat image : temp/1757529028_3764676_1382782658_b453c7258d982a6a61e268d0bb49360c.jpg resize: (1080, 1920) 1382782658 1.216035179245528 treat image : temp/1757529028_3764676_1382782656_3e4cb62cbaaeac4c1bbee8477c82dba7.jpg resize: (1080, 1920) 1382782656 0.5957775486878497 treat image : temp/1757529028_3764676_1382782644_4debe2c702b2040312e31a9218d5f7f7.jpg resize: (1080, 1920) 1382782644 1.3172833136494797 treat image : temp/1757529028_3764676_1382782642_96352eaec872910f487c699d67662e44.jpg resize: (1080, 1920) 1382782642 1.2923325222122304 treat image : temp/1757529028_3764676_1382782639_af35916588de1425b69156ba95635e41.jpg resize: (1080, 1920) 1382782639 1.088814956629611 treat image : temp/1757529028_3764676_1382782636_5b8bd4856409a841995595bcfbe8e723.jpg resize: (1080, 1920) 1382782636 1.1592358913679492 treat image : temp/1757529028_3764676_1382782634_419550d54469c3abdf2f8aa8b6035e42.jpg resize: (1080, 1920) 1382782634 1.041514797654286 treat image : temp/1757529028_3764676_1382782734_323d11a1f3bde2e7859313fdfed76469_rle_crop_3954451057_0.png resize: (151, 95) 1383113334 -1.2677668217644718 treat image : temp/1757529028_3764676_1382782726_7d7bd5926ced552981c68778ae97dd84_rle_crop_3954451058_0.png resize: (142, 90) 1383113335 -3.952097687541733 treat image : temp/1757529028_3764676_1382782726_7d7bd5926ced552981c68778ae97dd84_rle_crop_3954451060_0.png resize: (452, 391) 1383113336 -0.27280729230755396 treat image : temp/1757529028_3764676_1382782726_7d7bd5926ced552981c68778ae97dd84_rle_crop_3954451061_0.png resize: (85, 139) 1383113337 -0.5430405560257974 treat image : temp/1757529028_3764676_1382782726_7d7bd5926ced552981c68778ae97dd84_rle_crop_3954451062_0.png resize: (307, 398) 1383113338 -1.7604753840668308 treat image : temp/1757529028_3764676_1382782726_7d7bd5926ced552981c68778ae97dd84_rle_crop_3954451064_0.png resize: (79, 71) 1383113339 -3.174258539818076 treat image : temp/1757529028_3764676_1382782697_0e950250ce9c15cc6cd135dcd2a941f2_rle_crop_3954451065_0.png resize: (139, 111) 1383113340 -1.4633820953299477 treat image : temp/1757529028_3764676_1382782697_0e950250ce9c15cc6cd135dcd2a941f2_rle_crop_3954451067_0.png resize: (127, 89) 1383113341 -0.4314866900709022 treat image : temp/1757529028_3764676_1382782697_0e950250ce9c15cc6cd135dcd2a941f2_rle_crop_3954451068_0.png resize: (61, 146) 1383113342 -0.2309572723689026 treat image : temp/1757529028_3764676_1382782696_b588713972626bd61982fac1790b903f_rle_crop_3954451071_0.png resize: (110, 107) 1383113343 2.248909679250914 treat image : temp/1757529028_3764676_1382782696_b588713972626bd61982fac1790b903f_rle_crop_3954451073_0.png resize: (60, 113) 1383113344 -1.9865277912450283 treat image : temp/1757529028_3764676_1382782695_34c5c535d3ec98748c1c07cd3fd31e95_rle_crop_3954451075_0.png resize: (173, 107) 1383113345 -0.6158418345219253 treat image : temp/1757529028_3764676_1382782693_55c4e57e7d979d1f32d9ca9267d0b3da_rle_crop_3954451082_0.png resize: (218, 212) 1383113346 -0.21539563170870324 treat image : temp/1757529028_3764676_1382782693_55c4e57e7d979d1f32d9ca9267d0b3da_rle_crop_3954451083_0.png resize: (364, 368) 1383113347 -1.3359540683452231 treat image : temp/1757529028_3764676_1382782691_86b2f31e24153fd5032b8dbfbdb89f7e_rle_crop_3954451085_0.png resize: (102, 173) 1383113348 0.02544613686343413 treat image : temp/1757529028_3764676_1382782691_86b2f31e24153fd5032b8dbfbdb89f7e_rle_crop_3954451088_0.png resize: (60, 59) 1383113349 -0.8888047893720251 treat image : temp/1757529028_3764676_1382782689_3ed1fd76781c3ecfb6ee7f73aeadb1ab_rle_crop_3954451090_0.png resize: (200, 168) 1383113350 -3.0306410391373313 treat image : temp/1757529028_3764676_1382782689_3ed1fd76781c3ecfb6ee7f73aeadb1ab_rle_crop_3954451093_0.png resize: (170, 112) 1383113351 -0.5648374153681682 treat image : temp/1757529028_3764676_1382782689_3ed1fd76781c3ecfb6ee7f73aeadb1ab_rle_crop_3954451094_0.png resize: (109, 114) 1383113352 -1.3631851243551651 treat image : temp/1757529028_3764676_1382782673_9e6977dd0b10e87306e0c30c8323a9ff_rle_crop_3954451097_0.png resize: (170, 93) 1383113353 -0.9834437861273078 treat image : temp/1757529028_3764676_1382782664_2d4f0b27909416280ed4f4afd7859f23_rle_crop_3954451103_0.png resize: (93, 95) 1383113354 -0.12765895221754217 treat image : temp/1757529028_3764676_1382782664_2d4f0b27909416280ed4f4afd7859f23_rle_crop_3954451104_0.png resize: (65, 133) 1383113355 -1.2307612081630066 treat image : temp/1757529028_3764676_1382782664_2d4f0b27909416280ed4f4afd7859f23_rle_crop_3954451105_0.png resize: (46, 95) 1383113356 2.0087868766963837 treat image : temp/1757529028_3764676_1382782661_a3fdd4425258dc51941a13709e1d1771_rle_crop_3954451108_0.png resize: (99, 183) 1383113357 0.0004118967093901445 treat image : temp/1757529028_3764676_1382782658_b453c7258d982a6a61e268d0bb49360c_rle_crop_3954451111_0.png resize: (181, 114) 1383113358 -0.4244478445799585 treat image : temp/1757529028_3764676_1382782644_4debe2c702b2040312e31a9218d5f7f7_rle_crop_3954451117_0.png resize: (143, 152) 1383113359 -0.7684329486745168 treat image : temp/1757529028_3764676_1382782644_4debe2c702b2040312e31a9218d5f7f7_rle_crop_3954451118_0.png resize: (124, 86) 1383113360 -1.269113513817967 treat image : temp/1757529028_3764676_1382782644_4debe2c702b2040312e31a9218d5f7f7_rle_crop_3954451119_0.png resize: (176, 118) 1383113361 1.097732350718778 treat image : temp/1757529028_3764676_1382782642_96352eaec872910f487c699d67662e44_rle_crop_3954451122_0.png resize: (73, 55) 1383113362 3.093608300636333 treat image : temp/1757529028_3764676_1382782639_af35916588de1425b69156ba95635e41_rle_crop_3954451123_0.png resize: (110, 57) 1383113363 -0.5635786453488933 treat image : temp/1757529028_3764676_1382782639_af35916588de1425b69156ba95635e41_rle_crop_3954451124_0.png resize: (136, 106) 1383113364 -2.386493070348247 treat image : temp/1757529028_3764676_1382782639_af35916588de1425b69156ba95635e41_rle_crop_3954451126_0.png resize: (108, 83) 1383113365 -1.5884924562564449 treat image : temp/1757529028_3764676_1382782636_5b8bd4856409a841995595bcfbe8e723_rle_crop_3954451127_0.png resize: (38, 57) 1383113366 7.500560398186539 treat image : temp/1757529028_3764676_1382782734_323d11a1f3bde2e7859313fdfed76469_rle_crop_3954451051_0.png resize: (91, 154) 1383113375 -1.975441877391223 treat image : temp/1757529028_3764676_1382782726_7d7bd5926ced552981c68778ae97dd84_rle_crop_3954451059_0.png resize: (216, 105) 1383113376 -1.906759920676923 treat image : temp/1757529028_3764676_1382782697_0e950250ce9c15cc6cd135dcd2a941f2_rle_crop_3954451069_0.png resize: (81, 116) 1383113378 -2.2356801266335133 treat image : temp/1757529028_3764676_1382782696_b588713972626bd61982fac1790b903f_rle_crop_3954451072_0.png resize: (96, 56) 1383113379 2.234391970514567 treat image : temp/1757529028_3764676_1382782695_34c5c535d3ec98748c1c07cd3fd31e95_rle_crop_3954451076_0.png resize: (959, 915) 1383113380 1.122578678884919 treat image : temp/1757529028_3764676_1382782695_34c5c535d3ec98748c1c07cd3fd31e95_rle_crop_3954451078_0.png resize: (174, 150) 1383113381 -1.2847600174573282 treat image : temp/1757529028_3764676_1382782691_86b2f31e24153fd5032b8dbfbdb89f7e_rle_crop_3954451086_0.png resize: (971, 933) 1383113382 0.4493802778326308 treat image : temp/1757529028_3764676_1382782689_3ed1fd76781c3ecfb6ee7f73aeadb1ab_rle_crop_3954451091_0.png resize: (166, 181) 1383113383 -1.364645647856241 treat image : temp/1757529028_3764676_1382782666_a6f32f80174894821f56e3c747c0dfe2_rle_crop_3954451100_0.png resize: (83, 75) 1383113384 -1.0025265336437708 treat image : temp/1757529028_3764676_1382782666_a6f32f80174894821f56e3c747c0dfe2_rle_crop_3954451101_0.png resize: (69, 100) 1383113385 -1.8978890727255888 treat image : temp/1757529028_3764676_1382782666_a6f32f80174894821f56e3c747c0dfe2_rle_crop_3954451102_0.png resize: (143, 169) 1383113386 -2.31891709144489 treat image : temp/1757529028_3764676_1382782639_af35916588de1425b69156ba95635e41_rle_crop_3954451125_0.png resize: (990, 848) 1383113387 -0.2688285291903339 treat image : temp/1757529028_3764676_1382782636_5b8bd4856409a841995595bcfbe8e723_rle_crop_3954451128_0.png resize: (959, 940) 1383113388 1.1130148924698422 treat image : temp/1757529028_3764676_1382782634_419550d54469c3abdf2f8aa8b6035e42_rle_crop_3954451132_0.png resize: (276, 119) 1383113389 -1.117218903500046 treat image : temp/1757529028_3764676_1382782697_0e950250ce9c15cc6cd135dcd2a941f2_rle_crop_3954451070_0.png resize: (132, 172) 1383113390 -1.5431652048431443 treat image : temp/1757529028_3764676_1382782693_55c4e57e7d979d1f32d9ca9267d0b3da_rle_crop_3954451081_0.png resize: (111, 100) 1383113391 -0.4999779202438303 treat image : temp/1757529028_3764676_1382782661_a3fdd4425258dc51941a13709e1d1771_rle_crop_3954451107_0.png resize: (91, 106) 1383113393 -1.5502674755648567 treat image : temp/1757529028_3764676_1382782734_323d11a1f3bde2e7859313fdfed76469_rle_crop_3954451052_0.png resize: (175, 261) 1383113397 -0.6767053670282275 treat image : temp/1757529028_3764676_1382782734_323d11a1f3bde2e7859313fdfed76469_rle_crop_3954451056_0.png resize: (156, 134) 1383113398 -1.5958795388558205 treat image : temp/1757529028_3764676_1382782697_0e950250ce9c15cc6cd135dcd2a941f2_rle_crop_3954451066_0.png resize: (135, 163) 1383113399 -1.8325801943761415 treat image : temp/1757529028_3764676_1382782695_34c5c535d3ec98748c1c07cd3fd31e95_rle_crop_3954451074_0.png resize: (167, 168) 1383113400 1.6283584724680433 treat image : temp/1757529028_3764676_1382782695_34c5c535d3ec98748c1c07cd3fd31e95_rle_crop_3954451079_0.png resize: (268, 133) 1383113401 -0.8319406051180621 treat image : temp/1757529028_3764676_1382782695_34c5c535d3ec98748c1c07cd3fd31e95_rle_crop_3954451080_0.png resize: (493, 365) 1383113402 -0.45103700623174425 treat image : temp/1757529028_3764676_1382782693_55c4e57e7d979d1f32d9ca9267d0b3da_rle_crop_3954451084_0.png resize: (514, 362) 1383113403 0.41049956416159167 treat image : temp/1757529028_3764676_1382782691_86b2f31e24153fd5032b8dbfbdb89f7e_rle_crop_3954451087_0.png resize: (101, 204) 1383113404 1.2364401419365771 treat image : temp/1757529028_3764676_1382782689_3ed1fd76781c3ecfb6ee7f73aeadb1ab_rle_crop_3954451089_0.png resize: (170, 151) 1383113405 -1.3493085354696543 treat image : temp/1757529028_3764676_1382782689_3ed1fd76781c3ecfb6ee7f73aeadb1ab_rle_crop_3954451092_0.png resize: (530, 329) 1383113406 -0.023087423156879443 treat image : temp/1757529028_3764676_1382782673_9e6977dd0b10e87306e0c30c8323a9ff_rle_crop_3954451098_0.png resize: (198, 135) 1383113407 -1.4802189718769647 treat image : temp/1757529028_3764676_1382782673_9e6977dd0b10e87306e0c30c8323a9ff_rle_crop_3954451099_0.png resize: (520, 339) 1383113408 0.17624294086980458 treat image : temp/1757529028_3764676_1382782661_a3fdd4425258dc51941a13709e1d1771_rle_crop_3954451106_0.png resize: (528, 328) 1383113409 0.029409433644902224 treat image : temp/1757529028_3764676_1382782661_a3fdd4425258dc51941a13709e1d1771_rle_crop_3954451109_0.png resize: (156, 132) 1383113410 -0.7859281457154439 treat image : temp/1757529028_3764676_1382782661_a3fdd4425258dc51941a13709e1d1771_rle_crop_3954451110_0.png resize: (36, 78) 1383113411 -0.03481336855748885 treat image : temp/1757529028_3764676_1382782658_b453c7258d982a6a61e268d0bb49360c_rle_crop_3954451112_0.png resize: (212, 216) 1383113412 -1.2542460054006792 treat image : temp/1757529028_3764676_1382782656_3e4cb62cbaaeac4c1bbee8477c82dba7_rle_crop_3954451113_0.png resize: (131, 138) 1383113413 -1.3481130387647657 treat image : temp/1757529028_3764676_1382782656_3e4cb62cbaaeac4c1bbee8477c82dba7_rle_crop_3954451115_0.png resize: (173, 176) 1383113414 -1.062455292026221 treat image : temp/1757529028_3764676_1382782656_3e4cb62cbaaeac4c1bbee8477c82dba7_rle_crop_3954451116_0.png resize: (97, 100) 1383113415 -2.1995352023350203 treat image : temp/1757529028_3764676_1382782642_96352eaec872910f487c699d67662e44_rle_crop_3954451120_0.png resize: (159, 152) 1383113416 -1.7937546230112165 treat image : temp/1757529028_3764676_1382782642_96352eaec872910f487c699d67662e44_rle_crop_3954451121_0.png resize: (214, 110) 1383113417 -1.2430769843553306 treat image : temp/1757529028_3764676_1382782636_5b8bd4856409a841995595bcfbe8e723_rle_crop_3954451129_0.png resize: (78, 237) 1383113418 -0.20559254229048618 treat image : temp/1757529028_3764676_1382782634_419550d54469c3abdf2f8aa8b6035e42_rle_crop_3954451130_0.png resize: (525, 339) 1383113419 0.1995189917064545 treat image : temp/1757529028_3764676_1382782634_419550d54469c3abdf2f8aa8b6035e42_rle_crop_3954451131_0.png resize: (119, 150) 1383113420 -1.1953398589056643 treat image : temp/1757529028_3764676_1382782734_323d11a1f3bde2e7859313fdfed76469_rle_crop_3954451053_0.png resize: (65, 95) 1383113422 -0.11850650159643718 treat image : temp/1757529028_3764676_1382782734_323d11a1f3bde2e7859313fdfed76469_rle_crop_3954451054_0.png resize: (94, 82) 1383113423 0.09902545318340007 treat image : temp/1757529028_3764676_1382782734_323d11a1f3bde2e7859313fdfed76469_rle_crop_3954451055_0.png resize: (139, 129) 1383113424 -0.4172284217782688 treat image : temp/1757529028_3764676_1382782726_7d7bd5926ced552981c68778ae97dd84_rle_crop_3954451063_0.png resize: (57, 105) 1383113425 1.9930240190803559 treat image : temp/1757529028_3764676_1382782695_34c5c535d3ec98748c1c07cd3fd31e95_rle_crop_3954451077_0.png resize: (52, 54) 1383113426 20.0 treat image : temp/1757529028_3764676_1382782689_3ed1fd76781c3ecfb6ee7f73aeadb1ab_rle_crop_3954451095_0.png resize: (66, 63) 1383113427 5.002686277270404 treat image : temp/1757529028_3764676_1382782673_9e6977dd0b10e87306e0c30c8323a9ff_rle_crop_3954451096_0.png resize: (95, 113) 1383113428 -1.33318630960732 treat image : temp/1757529028_3764676_1382782656_3e4cb62cbaaeac4c1bbee8477c82dba7_rle_crop_3954451114_0.png resize: (110, 134) 1383113429 -0.2882250192563671 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 101 time used for this insertion : 0.01650381088256836 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 101 time used for this insertion : 0.02628040313720703 save missing photos in datou_result : time spend for datou_step_exec : 17.4794659614563 time spend to save output : 0.04853320121765137 total time spend for step 6 : 17.52799916267395 step7:brightness Wed Sep 10 20:32:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1757529028_3764676_1382782734_323d11a1f3bde2e7859313fdfed76469.jpg treat image : temp/1757529028_3764676_1382782726_7d7bd5926ced552981c68778ae97dd84.jpg treat image : temp/1757529028_3764676_1382782697_0e950250ce9c15cc6cd135dcd2a941f2.jpg treat image : temp/1757529028_3764676_1382782696_b588713972626bd61982fac1790b903f.jpg treat image : temp/1757529028_3764676_1382782695_34c5c535d3ec98748c1c07cd3fd31e95.jpg treat image : temp/1757529028_3764676_1382782693_55c4e57e7d979d1f32d9ca9267d0b3da.jpg treat image : temp/1757529028_3764676_1382782691_86b2f31e24153fd5032b8dbfbdb89f7e.jpg treat image : temp/1757529028_3764676_1382782689_3ed1fd76781c3ecfb6ee7f73aeadb1ab.jpg treat image : temp/1757529028_3764676_1382782673_9e6977dd0b10e87306e0c30c8323a9ff.jpg treat image : temp/1757529028_3764676_1382782666_a6f32f80174894821f56e3c747c0dfe2.jpg treat image : temp/1757529028_3764676_1382782664_2d4f0b27909416280ed4f4afd7859f23.jpg treat image : temp/1757529028_3764676_1382782661_a3fdd4425258dc51941a13709e1d1771.jpg treat image : temp/1757529028_3764676_1382782658_b453c7258d982a6a61e268d0bb49360c.jpg treat image : temp/1757529028_3764676_1382782656_3e4cb62cbaaeac4c1bbee8477c82dba7.jpg treat image : temp/1757529028_3764676_1382782644_4debe2c702b2040312e31a9218d5f7f7.jpg treat image : temp/1757529028_3764676_1382782642_96352eaec872910f487c699d67662e44.jpg treat image : temp/1757529028_3764676_1382782639_af35916588de1425b69156ba95635e41.jpg treat image : temp/1757529028_3764676_1382782636_5b8bd4856409a841995595bcfbe8e723.jpg treat image : temp/1757529028_3764676_1382782634_419550d54469c3abdf2f8aa8b6035e42.jpg treat image : temp/1757529028_3764676_1382782734_323d11a1f3bde2e7859313fdfed76469_rle_crop_3954451057_0.png treat image : temp/1757529028_3764676_1382782726_7d7bd5926ced552981c68778ae97dd84_rle_crop_3954451058_0.png treat image : temp/1757529028_3764676_1382782726_7d7bd5926ced552981c68778ae97dd84_rle_crop_3954451060_0.png treat image : temp/1757529028_3764676_1382782726_7d7bd5926ced552981c68778ae97dd84_rle_crop_3954451061_0.png treat image : temp/1757529028_3764676_1382782726_7d7bd5926ced552981c68778ae97dd84_rle_crop_3954451062_0.png treat image : temp/1757529028_3764676_1382782726_7d7bd5926ced552981c68778ae97dd84_rle_crop_3954451064_0.png treat image : temp/1757529028_3764676_1382782697_0e950250ce9c15cc6cd135dcd2a941f2_rle_crop_3954451065_0.png treat image : temp/1757529028_3764676_1382782697_0e950250ce9c15cc6cd135dcd2a941f2_rle_crop_3954451067_0.png treat image : temp/1757529028_3764676_1382782697_0e950250ce9c15cc6cd135dcd2a941f2_rle_crop_3954451068_0.png treat image : temp/1757529028_3764676_1382782696_b588713972626bd61982fac1790b903f_rle_crop_3954451071_0.png treat image : temp/1757529028_3764676_1382782696_b588713972626bd61982fac1790b903f_rle_crop_3954451073_0.png treat image : temp/1757529028_3764676_1382782695_34c5c535d3ec98748c1c07cd3fd31e95_rle_crop_3954451075_0.png treat image : temp/1757529028_3764676_1382782693_55c4e57e7d979d1f32d9ca9267d0b3da_rle_crop_3954451082_0.png treat image : temp/1757529028_3764676_1382782693_55c4e57e7d979d1f32d9ca9267d0b3da_rle_crop_3954451083_0.png treat image : temp/1757529028_3764676_1382782691_86b2f31e24153fd5032b8dbfbdb89f7e_rle_crop_3954451085_0.png treat image : temp/1757529028_3764676_1382782691_86b2f31e24153fd5032b8dbfbdb89f7e_rle_crop_3954451088_0.png treat image : temp/1757529028_3764676_1382782689_3ed1fd76781c3ecfb6ee7f73aeadb1ab_rle_crop_3954451090_0.png treat image : temp/1757529028_3764676_1382782689_3ed1fd76781c3ecfb6ee7f73aeadb1ab_rle_crop_3954451093_0.png treat image : temp/1757529028_3764676_1382782689_3ed1fd76781c3ecfb6ee7f73aeadb1ab_rle_crop_3954451094_0.png treat image : temp/1757529028_3764676_1382782673_9e6977dd0b10e87306e0c30c8323a9ff_rle_crop_3954451097_0.png treat image : temp/1757529028_3764676_1382782664_2d4f0b27909416280ed4f4afd7859f23_rle_crop_3954451103_0.png treat image : temp/1757529028_3764676_1382782664_2d4f0b27909416280ed4f4afd7859f23_rle_crop_3954451104_0.png treat image : temp/1757529028_3764676_1382782664_2d4f0b27909416280ed4f4afd7859f23_rle_crop_3954451105_0.png treat image : temp/1757529028_3764676_1382782661_a3fdd4425258dc51941a13709e1d1771_rle_crop_3954451108_0.png treat image : temp/1757529028_3764676_1382782658_b453c7258d982a6a61e268d0bb49360c_rle_crop_3954451111_0.png treat image : temp/1757529028_3764676_1382782644_4debe2c702b2040312e31a9218d5f7f7_rle_crop_3954451117_0.png treat image : temp/1757529028_3764676_1382782644_4debe2c702b2040312e31a9218d5f7f7_rle_crop_3954451118_0.png treat image : temp/1757529028_3764676_1382782644_4debe2c702b2040312e31a9218d5f7f7_rle_crop_3954451119_0.png treat image : temp/1757529028_3764676_1382782642_96352eaec872910f487c699d67662e44_rle_crop_3954451122_0.png treat image : temp/1757529028_3764676_1382782639_af35916588de1425b69156ba95635e41_rle_crop_3954451123_0.png treat image : temp/1757529028_3764676_1382782639_af35916588de1425b69156ba95635e41_rle_crop_3954451124_0.png treat image : temp/1757529028_3764676_1382782639_af35916588de1425b69156ba95635e41_rle_crop_3954451126_0.png treat image : temp/1757529028_3764676_1382782636_5b8bd4856409a841995595bcfbe8e723_rle_crop_3954451127_0.png treat image : temp/1757529028_3764676_1382782734_323d11a1f3bde2e7859313fdfed76469_rle_crop_3954451051_0.png treat image : temp/1757529028_3764676_1382782726_7d7bd5926ced552981c68778ae97dd84_rle_crop_3954451059_0.png treat image : temp/1757529028_3764676_1382782697_0e950250ce9c15cc6cd135dcd2a941f2_rle_crop_3954451069_0.png treat image : temp/1757529028_3764676_1382782696_b588713972626bd61982fac1790b903f_rle_crop_3954451072_0.png treat image : temp/1757529028_3764676_1382782695_34c5c535d3ec98748c1c07cd3fd31e95_rle_crop_3954451076_0.png treat image : temp/1757529028_3764676_1382782695_34c5c535d3ec98748c1c07cd3fd31e95_rle_crop_3954451078_0.png treat image : temp/1757529028_3764676_1382782691_86b2f31e24153fd5032b8dbfbdb89f7e_rle_crop_3954451086_0.png treat image : temp/1757529028_3764676_1382782689_3ed1fd76781c3ecfb6ee7f73aeadb1ab_rle_crop_3954451091_0.png treat image : temp/1757529028_3764676_1382782666_a6f32f80174894821f56e3c747c0dfe2_rle_crop_3954451100_0.png treat image : temp/1757529028_3764676_1382782666_a6f32f80174894821f56e3c747c0dfe2_rle_crop_3954451101_0.png treat image : temp/1757529028_3764676_1382782666_a6f32f80174894821f56e3c747c0dfe2_rle_crop_3954451102_0.png treat image : temp/1757529028_3764676_1382782639_af35916588de1425b69156ba95635e41_rle_crop_3954451125_0.png treat image : temp/1757529028_3764676_1382782636_5b8bd4856409a841995595bcfbe8e723_rle_crop_3954451128_0.png treat image : temp/1757529028_3764676_1382782634_419550d54469c3abdf2f8aa8b6035e42_rle_crop_3954451132_0.png treat image : temp/1757529028_3764676_1382782697_0e950250ce9c15cc6cd135dcd2a941f2_rle_crop_3954451070_0.png treat image : temp/1757529028_3764676_1382782693_55c4e57e7d979d1f32d9ca9267d0b3da_rle_crop_3954451081_0.png treat image : temp/1757529028_3764676_1382782661_a3fdd4425258dc51941a13709e1d1771_rle_crop_3954451107_0.png treat image : temp/1757529028_3764676_1382782734_323d11a1f3bde2e7859313fdfed76469_rle_crop_3954451052_0.png treat image : temp/1757529028_3764676_1382782734_323d11a1f3bde2e7859313fdfed76469_rle_crop_3954451056_0.png treat image : temp/1757529028_3764676_1382782697_0e950250ce9c15cc6cd135dcd2a941f2_rle_crop_3954451066_0.png treat image : temp/1757529028_3764676_1382782695_34c5c535d3ec98748c1c07cd3fd31e95_rle_crop_3954451074_0.png treat image : temp/1757529028_3764676_1382782695_34c5c535d3ec98748c1c07cd3fd31e95_rle_crop_3954451079_0.png treat image : temp/1757529028_3764676_1382782695_34c5c535d3ec98748c1c07cd3fd31e95_rle_crop_3954451080_0.png treat image : temp/1757529028_3764676_1382782693_55c4e57e7d979d1f32d9ca9267d0b3da_rle_crop_3954451084_0.png treat image : temp/1757529028_3764676_1382782691_86b2f31e24153fd5032b8dbfbdb89f7e_rle_crop_3954451087_0.png treat image : temp/1757529028_3764676_1382782689_3ed1fd76781c3ecfb6ee7f73aeadb1ab_rle_crop_3954451089_0.png treat image : temp/1757529028_3764676_1382782689_3ed1fd76781c3ecfb6ee7f73aeadb1ab_rle_crop_3954451092_0.png treat image : temp/1757529028_3764676_1382782673_9e6977dd0b10e87306e0c30c8323a9ff_rle_crop_3954451098_0.png treat image : temp/1757529028_3764676_1382782673_9e6977dd0b10e87306e0c30c8323a9ff_rle_crop_3954451099_0.png treat image : temp/1757529028_3764676_1382782661_a3fdd4425258dc51941a13709e1d1771_rle_crop_3954451106_0.png treat image : temp/1757529028_3764676_1382782661_a3fdd4425258dc51941a13709e1d1771_rle_crop_3954451109_0.png treat image : temp/1757529028_3764676_1382782661_a3fdd4425258dc51941a13709e1d1771_rle_crop_3954451110_0.png treat image : temp/1757529028_3764676_1382782658_b453c7258d982a6a61e268d0bb49360c_rle_crop_3954451112_0.png treat image : temp/1757529028_3764676_1382782656_3e4cb62cbaaeac4c1bbee8477c82dba7_rle_crop_3954451113_0.png treat image : temp/1757529028_3764676_1382782656_3e4cb62cbaaeac4c1bbee8477c82dba7_rle_crop_3954451115_0.png treat image : temp/1757529028_3764676_1382782656_3e4cb62cbaaeac4c1bbee8477c82dba7_rle_crop_3954451116_0.png treat image : temp/1757529028_3764676_1382782642_96352eaec872910f487c699d67662e44_rle_crop_3954451120_0.png treat image : temp/1757529028_3764676_1382782642_96352eaec872910f487c699d67662e44_rle_crop_3954451121_0.png treat image : temp/1757529028_3764676_1382782636_5b8bd4856409a841995595bcfbe8e723_rle_crop_3954451129_0.png treat image : temp/1757529028_3764676_1382782634_419550d54469c3abdf2f8aa8b6035e42_rle_crop_3954451130_0.png treat image : temp/1757529028_3764676_1382782634_419550d54469c3abdf2f8aa8b6035e42_rle_crop_3954451131_0.png treat image : temp/1757529028_3764676_1382782734_323d11a1f3bde2e7859313fdfed76469_rle_crop_3954451053_0.png treat image : temp/1757529028_3764676_1382782734_323d11a1f3bde2e7859313fdfed76469_rle_crop_3954451054_0.png treat image : temp/1757529028_3764676_1382782734_323d11a1f3bde2e7859313fdfed76469_rle_crop_3954451055_0.png treat image : temp/1757529028_3764676_1382782726_7d7bd5926ced552981c68778ae97dd84_rle_crop_3954451063_0.png treat image : temp/1757529028_3764676_1382782695_34c5c535d3ec98748c1c07cd3fd31e95_rle_crop_3954451077_0.png treat image : temp/1757529028_3764676_1382782689_3ed1fd76781c3ecfb6ee7f73aeadb1ab_rle_crop_3954451095_0.png treat image : temp/1757529028_3764676_1382782673_9e6977dd0b10e87306e0c30c8323a9ff_rle_crop_3954451096_0.png treat image : temp/1757529028_3764676_1382782656_3e4cb62cbaaeac4c1bbee8477c82dba7_rle_crop_3954451114_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 101 time used for this insertion : 0.015178203582763672 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 101 time used for this insertion : 0.06710171699523926 save missing photos in datou_result : time spend for datou_step_exec : 5.143908739089966 time spend to save output : 0.08764410018920898 total time spend for step 7 : 5.231552839279175 step8:velours_tree Wed Sep 10 20:32:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.2849109172821045 time spend to save output : 3.6716461181640625e-05 total time spend for step 8 : 0.28494763374328613 step9:send_mail_cod Wed Sep 10 20:32:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26690816_10-09-2025_20_32_28.pdf 26728776 change filename to text .imagette267287761757529148 26728778 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267287781757529148 26728779 imagette267287791757529150 26728780 imagette267287801757529150 26728781 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267287811757529150 26728782 change filename to text .change filename to text .change filename to text .imagette267287821757529151 26728783 imagette267287831757529151 26728784 imagette267287841757529151 26728785 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267287851757529151 26728786 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267287861757529151 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26690816 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26728776,26728777,26728778,26728779,26728780,26728781,26728782,26728783,26728784,26728785,26728786?tags=pehd,environnement,papier,flou,pet_fonce,carton,metal,mal_croppe,background,autre,pet_clair args[1382782734] : ((1382782734, 1.0615605106989916, 492688767), (1382782734, 0.7891245751346555, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com args[1382782726] : ((1382782726, -1.3561199333692435, 492688767), (1382782726, 0.15218181148389057, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com args[1382782697] : ((1382782697, 0.5950866876254932, 492688767), (1382782697, 0.5892698694270073, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com args[1382782696] : ((1382782696, 3.0184261434391195, 492688767), (1382782696, 0.5706018053740128, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com args[1382782695] : ((1382782695, 1.665180425480542, 492688767), (1382782695, 0.831961673028226, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com args[1382782693] : ((1382782693, 0.5421038198369021, 492688767), (1382782693, 0.37726029135633793, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com args[1382782691] : ((1382782691, 1.7727253675955936, 492688767), (1382782691, 0.39538354450761287, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com args[1382782689] : ((1382782689, 1.1327105571478915, 492688767), (1382782689, 0.38118169393351936, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com args[1382782673] : ((1382782673, 1.1994555421659356, 492688767), (1382782673, 0.5443479397909619, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com args[1382782666] : ((1382782666, 1.5844489896040401, 492688767), (1382782666, 0.5323872916162699, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com args[1382782664] : ((1382782664, 0.7767589531975003, 492688767), (1382782664, 0.5469297382449712, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com args[1382782661] : ((1382782661, 0.7132104217952774, 492688767), (1382782661, 0.7127490911440014, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com args[1382782658] : ((1382782658, 1.216035179245528, 492688767), (1382782658, 0.8310664983451486, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com args[1382782656] : ((1382782656, 0.5957775486878497, 492688767), (1382782656, 0.7576198707096434, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com args[1382782644] : ((1382782644, 1.3172833136494797, 492688767), (1382782644, 0.6133157622841621, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com args[1382782642] : ((1382782642, 1.2923325222122304, 492688767), (1382782642, 0.4805293767723599, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com args[1382782639] : ((1382782639, 1.088814956629611, 492688767), (1382782639, 0.4941121504549513, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com args[1382782636] : ((1382782636, 1.1592358913679492, 492688767), (1382782636, 0.5474711103309403, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com args[1382782634] : ((1382782634, 1.041514797654286, 492688767), (1382782634, 0.429251270755216, 2107752395), '0.10289478760558811') We are sending mail with results at report@fotonower.com refus_total : 0.10289478760558811 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26690816 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26690816_10-09-2025_20_32_28.pdf results_Auto_P26690816_10-09-2025_20_32_28.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26690816_10-09-2025_20_32_28.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26690816','results_Auto_P26690816_10-09-2025_20_32_28.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26690816_10-09-2025_20_32_28.pdf','pdf','','0.5','0.10289478760558811') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26690816

https://www.fotonower.com/image?json=false&list_photos_id=1382782734
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0615605106989916)
https://www.fotonower.com/image?json=false&list_photos_id=1382782726
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382782697
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382782696
La photo est trop floue, merci de reprendre une photo.(avec le score = 3.0184261434391195)
https://www.fotonower.com/image?json=false&list_photos_id=1382782695
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.665180425480542)
https://www.fotonower.com/image?json=false&list_photos_id=1382782693
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382782691
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.7727253675955936)
https://www.fotonower.com/image?json=false&list_photos_id=1382782689
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1327105571478915)
https://www.fotonower.com/image?json=false&list_photos_id=1382782673
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1994555421659356)
https://www.fotonower.com/image?json=false&list_photos_id=1382782666
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.5844489896040401)
https://www.fotonower.com/image?json=false&list_photos_id=1382782664
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382782661
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382782658
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.216035179245528)
https://www.fotonower.com/image?json=false&list_photos_id=1382782656
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382782644
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.3172833136494797)
https://www.fotonower.com/image?json=false&list_photos_id=1382782642
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.2923325222122304)
https://www.fotonower.com/image?json=false&list_photos_id=1382782639
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.088814956629611)
https://www.fotonower.com/image?json=false&list_photos_id=1382782636
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1592358913679492)
https://www.fotonower.com/image?json=false&list_photos_id=1382782634
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.041514797654286)

Dans ces conditions,le taux de refus est: 10.29%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pehd: https://www.fotonower.com/view/26728776?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26728778?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26728781?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26728782?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26728785?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26728786?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26690816_10-09-2025_20_32_28.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26728776,26728777,26728778,26728779,26728780,26728781,26728782,26728783,26728784,26728785,26728786?tags=pehd,environnement,papier,flou,pet_fonce,carton,metal,mal_croppe,background,autre,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 10 Sep 2025 18:32:36 GMT Content-Length: 0 Connection: close X-Message-Id: FRDSDt3iTiixgxkt2_o6Aw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1382782734, 1382782726, 1382782697, 1382782696, 1382782695, 1382782693, 1382782691, 1382782689, 1382782673, 1382782666, 1382782664, 1382782661, 1382782658, 1382782656, 1382782644, 1382782642, 1382782639, 1382782636, 1382782634] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782734', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782726', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782697', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782696', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782695', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782693', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782691', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782689', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782673', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782666', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782664', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782661', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782658', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782656', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782644', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782642', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782639', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782636', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782634', None, None, None, None, None, '3685271') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 19 time used for this insertion : 0.016705989837646484 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.798234701156616 time spend to save output : 0.017022371292114258 total time spend for step 9 : 7.8152570724487305 step10:split_time_score Wed Sep 10 20:32:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 19),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 09092025 26690816 Nombre de photos uploadées : 19 / 23040 (0%) 09092025 26690816 Nombre de photos taguées (types de déchets): 0 / 19 (0%) 09092025 26690816 Nombre de photos taguées (volume) : 0 / 19 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 4.76837158203125e-06 ??????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0009288787841796875 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.24924993515014648 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.06336376886145406 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26677451_09-09-2025_09_11_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26677451 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26677451 AND mptpi.`type`=3594 To do Qualite : 0.05401843412422839 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26677708_09-09-2025_10_56_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26677708 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26677708 AND mptpi.`type`=3594 To do Qualite : 0.20552528077846366 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26677710_09-09-2025_10_51_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26677710 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26677710 AND mptpi.`type`=3594 To do Qualite : 0.014393888245884773 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26680696_09-09-2025_11_21_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26680696 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26680696 AND mptpi.`type`=3594 To do Qualite : 0.07049739583333335 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26680700_09-09-2025_11_11_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26680700 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26680700 AND mptpi.`type`=3594 To do Qualite : 0.045615676440329225 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26684302_09-09-2025_13_01_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26684302 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26684302 AND mptpi.`type`=3594 To do Qualite : 0.09322024498456788 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26684306_09-09-2025_12_51_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26684306 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26684306 AND mptpi.`type`=3594 To do Qualite : 0.08782146990740743 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26685910_09-09-2025_14_22_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26685910 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26685910 AND mptpi.`type`=3594 To do Qualite : 0.049695987654320976 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26690808_10-09-2025_19_06_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26690808 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26690808 AND mptpi.`type`=3594 To do Qualite : 0.10289478760558811 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26690816_10-09-2025_20_32_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26690816 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26690816 AND mptpi.`type`=3594 To do Qualite : 0.17773912333808162 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26690817_10-09-2025_18_22_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26690817 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26690817 AND mptpi.`type`=3594 To do Qualite : 0.06087995113168725 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26691894_10-09-2025_20_11_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26691894 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26691894 AND mptpi.`type`=3594 To do Qualite : 0.09652469877730294 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26697945_10-09-2025_20_01_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26697945 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26697945 AND mptpi.`type`=3594 To do Qualite : 0.24890766460905353 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26697949_10-09-2025_19_52_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26697949 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26697949 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'09092025': {'nb_upload': 19, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1382782734, 1382782726, 1382782697, 1382782696, 1382782695, 1382782693, 1382782691, 1382782689, 1382782673, 1382782666, 1382782664, 1382782661, 1382782658, 1382782656, 1382782644, 1382782642, 1382782639, 1382782636, 1382782634] Looping around the photos to save general results len do output : 1 /26690816Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782734', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782726', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782697', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782696', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782695', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782693', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782691', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782689', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782673', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782666', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782664', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782661', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782658', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782656', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782644', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782642', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782639', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782636', None, None, None, None, None, '3685271') ('3318', None, None, None, None, None, None, None, '3685271') ('3318', '26690816', '1382782634', None, None, None, None, None, '3685271') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.013720512390136719 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.232684850692749 time spend to save output : 0.013919591903686523 total time spend for step 10 : 1.2466044425964355 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 19 set_done_treatment 72.17user 30.07system 2:12.15elapsed 77%CPU (0avgtext+0avgdata 3237424maxresident)k 653568inputs+34392outputs (7312major+2516208minor)pagefaults 0swaps