python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2049433 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3618812'] with mtr_portfolio_ids : ['26278769'] and first list_photo_ids : [] new path : /proc/2049433/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 15 ; length of list_pids : 15 ; length of list_args : 15 time to download the photos : 2.0494022369384766 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Aug 28 02:20:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6607 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-28 02:20:34.281992: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-28 02:20:34.308714: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-28 02:20:34.310257: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f09ac000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-28 02:20:34.310303: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-28 02:20:34.313043: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-28 02:20:34.456773: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x277f3f70 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-28 02:20:34.456834: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-28 02:20:34.457706: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 02:20:34.458046: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 02:20:34.460127: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 02:20:34.462299: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 02:20:34.462611: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 02:20:34.464919: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 02:20:34.466034: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 02:20:34.470615: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 02:20:34.471850: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 02:20:34.471928: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 02:20:34.472574: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-28 02:20:34.472592: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-28 02:20:34.472601: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-28 02:20:34.487839: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6068 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-28 02:20:34.864280: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 02:20:34.864405: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 02:20:34.864434: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 02:20:34.864460: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 02:20:34.864502: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 02:20:34.864529: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 02:20:34.864553: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 02:20:34.864577: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 02:20:34.866019: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 02:20:34.867478: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-28 02:20:34.867519: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-28 02:20:34.867543: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 02:20:34.867564: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-28 02:20:34.867586: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-28 02:20:34.867607: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-28 02:20:34.867629: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-28 02:20:34.867651: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-28 02:20:34.869022: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-28 02:20:34.869064: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-28 02:20:34.869077: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-28 02:20:34.869089: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-28 02:20:34.870542: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6068 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-28 02:20:43.628202: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-28 02:20:43.813391: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 Detection mask done ! Trying to reset tf kernel 2050693 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4296 tf kernel not reseted sub process len(results) : 15 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 15 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9585 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00029587745666503906 nb_pixel_total : 3209 time to create 1 rle with old method : 0.005187034606933594 length of segment : 46 time for calcul the mask position with numpy : 0.0002040863037109375 nb_pixel_total : 8053 time to create 1 rle with old method : 0.010646820068359375 length of segment : 100 time for calcul the mask position with numpy : 0.0003781318664550781 nb_pixel_total : 12157 time to create 1 rle with old method : 0.01757502555847168 length of segment : 194 time for calcul the mask position with numpy : 0.0002155303955078125 nb_pixel_total : 4752 time to create 1 rle with old method : 0.005563020706176758 length of segment : 122 time for calcul the mask position with numpy : 0.0002429485321044922 nb_pixel_total : 7024 time to create 1 rle with old method : 0.009015083312988281 length of segment : 143 time for calcul the mask position with numpy : 0.0004782676696777344 nb_pixel_total : 16227 time to create 1 rle with old method : 0.019555330276489258 length of segment : 287 time for calcul the mask position with numpy : 0.0007424354553222656 nb_pixel_total : 32610 time to create 1 rle with old method : 0.037467002868652344 length of segment : 205 time for calcul the mask position with numpy : 0.00019598007202148438 nb_pixel_total : 8360 time to create 1 rle with old method : 0.01006007194519043 length of segment : 130 time for calcul the mask position with numpy : 0.00024628639221191406 nb_pixel_total : 14620 time to create 1 rle with old method : 0.01685166358947754 length of segment : 125 time for calcul the mask position with numpy : 0.00021076202392578125 nb_pixel_total : 8919 time to create 1 rle with old method : 0.010344505310058594 length of segment : 128 time for calcul the mask position with numpy : 0.00022029876708984375 nb_pixel_total : 10992 time to create 1 rle with old method : 0.012441396713256836 length of segment : 133 time for calcul the mask position with numpy : 0.0002703666687011719 nb_pixel_total : 10597 time to create 1 rle with old method : 0.011694192886352539 length of segment : 177 time for calcul the mask position with numpy : 0.0001919269561767578 nb_pixel_total : 8971 time to create 1 rle with old method : 0.010394573211669922 length of segment : 120 time for calcul the mask position with numpy : 0.00020694732666015625 nb_pixel_total : 8447 time to create 1 rle with old method : 0.00977945327758789 length of segment : 130 time for calcul the mask position with numpy : 0.00033926963806152344 nb_pixel_total : 20254 time to create 1 rle with old method : 0.023380756378173828 length of segment : 182 time for calcul the mask position with numpy : 0.00024437904357910156 nb_pixel_total : 12568 time to create 1 rle with old method : 0.014690876007080078 length of segment : 147 time for calcul the mask position with numpy : 0.00017070770263671875 nb_pixel_total : 6479 time to create 1 rle with old method : 0.007890701293945312 length of segment : 123 time for calcul the mask position with numpy : 0.00021123886108398438 nb_pixel_total : 14490 time to create 1 rle with old method : 0.016820192337036133 length of segment : 127 time for calcul the mask position with numpy : 0.00011968612670898438 nb_pixel_total : 6054 time to create 1 rle with old method : 0.0072057247161865234 length of segment : 77 time for calcul the mask position with numpy : 0.00022530555725097656 nb_pixel_total : 13073 time to create 1 rle with old method : 0.015461444854736328 length of segment : 124 time for calcul the mask position with numpy : 0.00015115737915039062 nb_pixel_total : 5760 time to create 1 rle with old method : 0.0070002079010009766 length of segment : 82 time for calcul the mask position with numpy : 0.0007302761077880859 nb_pixel_total : 47555 time to create 1 rle with old method : 0.05585432052612305 length of segment : 218 time for calcul the mask position with numpy : 0.00013947486877441406 nb_pixel_total : 5038 time to create 1 rle with old method : 0.006120443344116211 length of segment : 76 time for calcul the mask position with numpy : 0.00011610984802246094 nb_pixel_total : 4010 time to create 1 rle with old method : 0.0047075748443603516 length of segment : 142 time for calcul the mask position with numpy : 0.0002951622009277344 nb_pixel_total : 16602 time to create 1 rle with old method : 0.019455671310424805 length of segment : 168 time for calcul the mask position with numpy : 0.00045752525329589844 nb_pixel_total : 23724 time to create 1 rle with old method : 0.028499603271484375 length of segment : 136 time for calcul the mask position with numpy : 0.0002875328063964844 nb_pixel_total : 10484 time to create 1 rle with old method : 0.01209878921508789 length of segment : 182 time for calcul the mask position with numpy : 0.00016117095947265625 nb_pixel_total : 4806 time to create 1 rle with old method : 0.006024837493896484 length of segment : 68 time for calcul the mask position with numpy : 0.00015306472778320312 nb_pixel_total : 6131 time to create 1 rle with old method : 0.007374763488769531 length of segment : 112 time for calcul the mask position with numpy : 0.00016164779663085938 nb_pixel_total : 6526 time to create 1 rle with old method : 0.007941484451293945 length of segment : 99 time for calcul the mask position with numpy : 0.0003349781036376953 nb_pixel_total : 20829 time to create 1 rle with old method : 0.024486780166625977 length of segment : 176 time for calcul the mask position with numpy : 0.0003745555877685547 nb_pixel_total : 20504 time to create 1 rle with old method : 0.027155160903930664 length of segment : 146 time for calcul the mask position with numpy : 0.00023412704467773438 nb_pixel_total : 14380 time to create 1 rle with old method : 0.016844511032104492 length of segment : 105 time for calcul the mask position with numpy : 0.0002701282501220703 nb_pixel_total : 13957 time to create 1 rle with old method : 0.017091989517211914 length of segment : 112 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 1520 time to create 1 rle with old method : 0.0018720626831054688 length of segment : 45 time for calcul the mask position with numpy : 0.0002665519714355469 nb_pixel_total : 9604 time to create 1 rle with old method : 0.011008977890014648 length of segment : 173 time for calcul the mask position with numpy : 0.00019669532775878906 nb_pixel_total : 7031 time to create 1 rle with old method : 0.008550643920898438 length of segment : 95 time for calcul the mask position with numpy : 0.00021719932556152344 nb_pixel_total : 9320 time to create 1 rle with old method : 0.011301279067993164 length of segment : 129 time for calcul the mask position with numpy : 0.0003459453582763672 nb_pixel_total : 22865 time to create 1 rle with old method : 0.026163816452026367 length of segment : 183 time for calcul the mask position with numpy : 0.00037360191345214844 nb_pixel_total : 19650 time to create 1 rle with old method : 0.023752927780151367 length of segment : 151 time for calcul the mask position with numpy : 0.00045490264892578125 nb_pixel_total : 20427 time to create 1 rle with old method : 0.024033546447753906 length of segment : 259 time for calcul the mask position with numpy : 0.00015544891357421875 nb_pixel_total : 6502 time to create 1 rle with old method : 0.007669925689697266 length of segment : 93 time for calcul the mask position with numpy : 0.0004177093505859375 nb_pixel_total : 14164 time to create 1 rle with old method : 0.016986370086669922 length of segment : 139 time for calcul the mask position with numpy : 0.0002422332763671875 nb_pixel_total : 10964 time to create 1 rle with old method : 0.012756586074829102 length of segment : 208 time for calcul the mask position with numpy : 0.01796698570251465 nb_pixel_total : 689394 time to create 1 rle with new method : 0.050887107849121094 length of segment : 968 time for calcul the mask position with numpy : 0.0002205371856689453 nb_pixel_total : 3931 time to create 1 rle with old method : 0.0047533512115478516 length of segment : 58 time for calcul the mask position with numpy : 0.00034308433532714844 nb_pixel_total : 9496 time to create 1 rle with old method : 0.011071920394897461 length of segment : 113 time for calcul the mask position with numpy : 0.0004076957702636719 nb_pixel_total : 9894 time to create 1 rle with old method : 0.01598834991455078 length of segment : 195 time for calcul the mask position with numpy : 0.00021648406982421875 nb_pixel_total : 4663 time to create 1 rle with old method : 0.005662679672241211 length of segment : 61 time for calcul the mask position with numpy : 0.00034356117248535156 nb_pixel_total : 9692 time to create 1 rle with old method : 0.011320114135742188 length of segment : 123 time for calcul the mask position with numpy : 0.0006146430969238281 nb_pixel_total : 18349 time to create 1 rle with old method : 0.02141284942626953 length of segment : 148 time for calcul the mask position with numpy : 0.0003314018249511719 nb_pixel_total : 3022 time to create 1 rle with old method : 0.003631591796875 length of segment : 124 time for calcul the mask position with numpy : 0.0003376007080078125 nb_pixel_total : 12933 time to create 1 rle with old method : 0.014936447143554688 length of segment : 99 time for calcul the mask position with numpy : 0.0002923011779785156 nb_pixel_total : 6209 time to create 1 rle with old method : 0.007169008255004883 length of segment : 102 time for calcul the mask position with numpy : 0.00046253204345703125 nb_pixel_total : 9651 time to create 1 rle with old method : 0.010569572448730469 length of segment : 172 time for calcul the mask position with numpy : 0.000118255615234375 nb_pixel_total : 2389 time to create 1 rle with old method : 0.0028829574584960938 length of segment : 50 time for calcul the mask position with numpy : 0.00015544891357421875 nb_pixel_total : 6400 time to create 1 rle with old method : 0.007261753082275391 length of segment : 80 time for calcul the mask position with numpy : 0.0001220703125 nb_pixel_total : 5591 time to create 1 rle with old method : 0.006270885467529297 length of segment : 119 time for calcul the mask position with numpy : 0.0001823902130126953 nb_pixel_total : 6978 time to create 1 rle with old method : 0.007730960845947266 length of segment : 128 time for calcul the mask position with numpy : 0.0002415180206298828 nb_pixel_total : 10464 time to create 1 rle with old method : 0.011672735214233398 length of segment : 172 time for calcul the mask position with numpy : 0.0017232894897460938 nb_pixel_total : 89014 time to create 1 rle with old method : 0.09980344772338867 length of segment : 531 time for calcul the mask position with numpy : 0.0002543926239013672 nb_pixel_total : 11235 time to create 1 rle with old method : 0.017678022384643555 length of segment : 69 time for calcul the mask position with numpy : 0.00016427040100097656 nb_pixel_total : 6693 time to create 1 rle with old method : 0.00782155990600586 length of segment : 126 time for calcul the mask position with numpy : 0.00010251998901367188 nb_pixel_total : 3126 time to create 1 rle with old method : 0.0037658214569091797 length of segment : 102 time spent for convertir_results : 2.6037356853485107 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 64 chid ids of type : 3594 Number RLEs to save : 9657 save missing photos in datou_result : time spend for datou_step_exec : 32.65349078178406 time spend to save output : 0.6845519542694092 total time spend for step 1 : 33.33804273605347 step2:crop_condition Thu Aug 28 02:21:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 15 ! batch 1 Loaded 64 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 34 About to insert : list_path_to_insert length 34 new photo from crops ! About to upload 34 photos upload in portfolio : 3736932 init cache_photo without model_param we have 34 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756340467_2049433 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 34 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.120133876800537 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756340478_2049433 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.232178449630737 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756340487_2049433 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.015977621078491 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1379677421, 1379677417, 1379677403, 1379677242, 1379677215, 1379677189, 1379677156, 1379677130, 1379677115, 1379677081, 1379677055, 1379677029, 1379677000, 1379676998, 1379676997] Looping around the photos to save general results len do output : 64 /1379789089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379789191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677421', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677417', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677403', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677242', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677215', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677189', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677156', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677130', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677115', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677081', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677055', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677029', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677000', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379676998', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379676997', None, None, None, None, None, '3618812') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 207 time used for this insertion : 0.028286457061767578 save_final save missing photos in datou_result : time spend for datou_step_exec : 26.534879446029663 time spend to save output : 0.031035423278808594 total time spend for step 2 : 26.56591486930847 step3:rle_unique_nms_with_priority Thu Aug 28 02:21:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 64 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 1.2414569854736328 time for calcul the mask position with numpy : 0.08441734313964844 nb_pixel_total : 1989568 time to create 1 rle with new method : 0.09257149696350098 time for calcul the mask position with numpy : 0.006735563278198242 nb_pixel_total : 32610 time to create 1 rle with old method : 0.036211252212524414 time for calcul the mask position with numpy : 0.00627446174621582 nb_pixel_total : 16227 time to create 1 rle with old method : 0.018355607986450195 time for calcul the mask position with numpy : 0.006596565246582031 nb_pixel_total : 7024 time to create 1 rle with old method : 0.008157014846801758 time for calcul the mask position with numpy : 0.006337165832519531 nb_pixel_total : 4752 time to create 1 rle with old method : 0.005366325378417969 time for calcul the mask position with numpy : 0.006530046463012695 nb_pixel_total : 12157 time to create 1 rle with old method : 0.013757944107055664 time for calcul the mask position with numpy : 0.006351947784423828 nb_pixel_total : 8053 time to create 1 rle with old method : 0.009061813354492188 time for calcul the mask position with numpy : 0.0062274932861328125 nb_pixel_total : 3209 time to create 1 rle with old method : 0.0036530494689941406 create new chi : 0.32801198959350586 time to delete rle : 0.029790878295898438 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 3274 TO DO : save crop sub photo not yet done ! save time : 0.24778318405151367 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 0.2956225872039795 time for calcul the mask position with numpy : 0.19963288307189941 nb_pixel_total : 1982440 time to create 1 rle with new method : 0.08547234535217285 time for calcul the mask position with numpy : 0.0068988800048828125 nb_pixel_total : 20254 time to create 1 rle with old method : 0.02326226234436035 time for calcul the mask position with numpy : 0.006444692611694336 nb_pixel_total : 8447 time to create 1 rle with old method : 0.009568214416503906 time for calcul the mask position with numpy : 0.006478071212768555 nb_pixel_total : 8971 time to create 1 rle with old method : 0.010246515274047852 time for calcul the mask position with numpy : 0.006841897964477539 nb_pixel_total : 10597 time to create 1 rle with old method : 0.012299299240112305 time for calcul the mask position with numpy : 0.0065190792083740234 nb_pixel_total : 10992 time to create 1 rle with old method : 0.012330055236816406 time for calcul the mask position with numpy : 0.006546974182128906 nb_pixel_total : 8919 time to create 1 rle with old method : 0.010167121887207031 time for calcul the mask position with numpy : 0.007432699203491211 nb_pixel_total : 14620 time to create 1 rle with old method : 0.01651144027709961 time for calcul the mask position with numpy : 0.006556034088134766 nb_pixel_total : 8360 time to create 1 rle with old method : 0.009356260299682617 create new chi : 0.4534745216369629 time to delete rle : 0.0004849433898925781 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 3330 TO DO : save crop sub photo not yet done ! save time : 0.24463772773742676 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05997729301452637 time for calcul the mask position with numpy : 0.021484375 nb_pixel_total : 2040063 time to create 1 rle with new method : 0.032681941986083984 time for calcul the mask position with numpy : 0.007051944732666016 nb_pixel_total : 14490 time to create 1 rle with old method : 0.01645374298095703 time for calcul the mask position with numpy : 0.0067632198333740234 nb_pixel_total : 6479 time to create 1 rle with old method : 0.007432699203491211 time for calcul the mask position with numpy : 0.0068781375885009766 nb_pixel_total : 12568 time to create 1 rle with old method : 0.014203310012817383 create new chi : 0.11337137222290039 time to delete rle : 0.0004162788391113281 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1874 TO DO : save crop sub photo not yet done ! save time : 0.15311956405639648 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.056876182556152344 time for calcul the mask position with numpy : 0.021174192428588867 nb_pixel_total : 2054473 time to create 1 rle with new method : 0.03147578239440918 time for calcul the mask position with numpy : 0.006677150726318359 nb_pixel_total : 13073 time to create 1 rle with old method : 0.014745712280273438 time for calcul the mask position with numpy : 0.0064907073974609375 nb_pixel_total : 6054 time to create 1 rle with old method : 0.00685429573059082 create new chi : 0.08775162696838379 time to delete rle : 0.0002980232238769531 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1482 TO DO : save crop sub photo not yet done ! save time : 0.13154935836791992 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.1934218406677246 time for calcul the mask position with numpy : 0.24365949630737305 nb_pixel_total : 2011237 time to create 1 rle with new method : 0.10635137557983398 time for calcul the mask position with numpy : 0.006500244140625 nb_pixel_total : 4010 time to create 1 rle with old method : 0.004528522491455078 time for calcul the mask position with numpy : 0.007187604904174805 nb_pixel_total : 5038 time to create 1 rle with old method : 0.005767345428466797 time for calcul the mask position with numpy : 0.007553815841674805 nb_pixel_total : 47555 time to create 1 rle with old method : 0.05277824401855469 time for calcul the mask position with numpy : 0.006444215774536133 nb_pixel_total : 5760 time to create 1 rle with old method : 0.006531238555908203 create new chi : 0.4590489864349365 time to delete rle : 0.00037932395935058594 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 2116 TO DO : save crop sub photo not yet done ! save time : 0.19574260711669922 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05385565757751465 time for calcul the mask position with numpy : 0.04696297645568848 nb_pixel_total : 2022790 time to create 1 rle with new method : 0.08623862266540527 time for calcul the mask position with numpy : 0.006619453430175781 nb_pixel_total : 10484 time to create 1 rle with old method : 0.011655569076538086 time for calcul the mask position with numpy : 0.006562232971191406 nb_pixel_total : 23724 time to create 1 rle with old method : 0.0267026424407959 time for calcul the mask position with numpy : 0.006804466247558594 nb_pixel_total : 16602 time to create 1 rle with old method : 0.018629074096679688 create new chi : 0.21985197067260742 time to delete rle : 0.00036406517028808594 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2052 TO DO : save crop sub photo not yet done ! save time : 0.1658923625946045 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.4069337844848633 time for calcul the mask position with numpy : 0.1212456226348877 nb_pixel_total : 2014365 time to create 1 rle with new method : 0.25394725799560547 time for calcul the mask position with numpy : 0.0074443817138671875 nb_pixel_total : 439 time to create 1 rle with old method : 0.0006313323974609375 time for calcul the mask position with numpy : 0.006546974182128906 nb_pixel_total : 20504 time to create 1 rle with old method : 0.023179292678833008 time for calcul the mask position with numpy : 0.006527900695800781 nb_pixel_total : 20829 time to create 1 rle with old method : 0.023546457290649414 time for calcul the mask position with numpy : 0.00667881965637207 nb_pixel_total : 6526 time to create 1 rle with old method : 0.007410526275634766 time for calcul the mask position with numpy : 0.006628513336181641 nb_pixel_total : 6131 time to create 1 rle with old method : 0.006922245025634766 time for calcul the mask position with numpy : 0.00659489631652832 nb_pixel_total : 4806 time to create 1 rle with old method : 0.005448579788208008 create new chi : 0.4941999912261963 time to delete rle : 0.0004305839538574219 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 2396 TO DO : save crop sub photo not yet done ! save time : 0.19312047958374023 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.11296701431274414 time for calcul the mask position with numpy : 0.022972583770751953 nb_pixel_total : 2032168 time to create 1 rle with new method : 0.0854806900024414 time for calcul the mask position with numpy : 0.006757020950317383 nb_pixel_total : 9320 time to create 1 rle with old method : 0.010366678237915039 time for calcul the mask position with numpy : 0.006788969039916992 nb_pixel_total : 7031 time to create 1 rle with old method : 0.008661985397338867 time for calcul the mask position with numpy : 0.0065937042236328125 nb_pixel_total : 9604 time to create 1 rle with old method : 0.011299848556518555 time for calcul the mask position with numpy : 0.006615161895751953 nb_pixel_total : 1520 time to create 1 rle with old method : 0.0017528533935546875 time for calcul the mask position with numpy : 0.0066792964935302734 nb_pixel_total : 13957 time to create 1 rle with old method : 0.015496015548706055 create new chi : 0.196458101272583 time to delete rle : 0.0004603862762451172 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 2188 TO DO : save crop sub photo not yet done ! save time : 0.19230890274047852 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.0822141170501709 time for calcul the mask position with numpy : 0.020251035690307617 nb_pixel_total : 2004156 time to create 1 rle with new method : 0.33877062797546387 time for calcul the mask position with numpy : 0.00638127326965332 nb_pixel_total : 6502 time to create 1 rle with old method : 0.008059978485107422 time for calcul the mask position with numpy : 0.007079124450683594 nb_pixel_total : 20427 time to create 1 rle with old method : 0.022864341735839844 time for calcul the mask position with numpy : 0.006823062896728516 nb_pixel_total : 19650 time to create 1 rle with old method : 0.021941423416137695 time for calcul the mask position with numpy : 0.006478786468505859 nb_pixel_total : 22865 time to create 1 rle with old method : 0.025530338287353516 create new chi : 0.47505640983581543 time to delete rle : 0.00044608116149902344 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 2452 TO DO : save crop sub photo not yet done ! save time : 0.26789212226867676 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05833935737609863 time for calcul the mask position with numpy : 0.02228569984436035 nb_pixel_total : 1359078 time to create 1 rle with new method : 0.09072303771972656 time for calcul the mask position with numpy : 0.011711359024047852 nb_pixel_total : 689394 time to create 1 rle with new method : 0.0776970386505127 time for calcul the mask position with numpy : 0.007368803024291992 nb_pixel_total : 10964 time to create 1 rle with old method : 0.012755870819091797 time for calcul the mask position with numpy : 0.00673675537109375 nb_pixel_total : 14164 time to create 1 rle with old method : 0.016722917556762695 create new chi : 0.25629496574401855 time to delete rle : 0.000667572021484375 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3710 TO DO : save crop sub photo not yet done ! save time : 0.2883317470550537 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.038652896881103516 time for calcul the mask position with numpy : 0.025456905364990234 nb_pixel_total : 2069669 time to create 1 rle with new method : 0.03988361358642578 time for calcul the mask position with numpy : 0.0066869258880615234 nb_pixel_total : 3931 time to create 1 rle with old method : 0.004486799240112305 create new chi : 0.08408451080322266 time to delete rle : 0.00024700164794921875 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1196 TO DO : save crop sub photo not yet done ! save time : 0.14271926879882812 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.15370607376098633 time for calcul the mask position with numpy : 0.0820765495300293 nb_pixel_total : 2054210 time to create 1 rle with new method : 0.09783029556274414 time for calcul the mask position with numpy : 0.00693821907043457 nb_pixel_total : 9894 time to create 1 rle with old method : 0.011115312576293945 time for calcul the mask position with numpy : 0.00666046142578125 nb_pixel_total : 9496 time to create 1 rle with old method : 0.010822772979736328 create new chi : 0.22714924812316895 time to delete rle : 0.00040078163146972656 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1696 TO DO : save crop sub photo not yet done ! save time : 0.1495361328125 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.21892523765563965 time for calcul the mask position with numpy : 0.07429170608520508 nb_pixel_total : 2024941 time to create 1 rle with new method : 0.09355902671813965 time for calcul the mask position with numpy : 0.0067675113677978516 nb_pixel_total : 12933 time to create 1 rle with old method : 0.01867961883544922 time for calcul the mask position with numpy : 0.007891178131103516 nb_pixel_total : 3022 time to create 1 rle with old method : 0.003615856170654297 time for calcul the mask position with numpy : 0.0069026947021484375 nb_pixel_total : 18349 time to create 1 rle with old method : 0.0228579044342041 time for calcul the mask position with numpy : 0.008370161056518555 nb_pixel_total : 9692 time to create 1 rle with old method : 0.013963699340820312 time for calcul the mask position with numpy : 0.00699925422668457 nb_pixel_total : 4663 time to create 1 rle with old method : 0.005286693572998047 create new chi : 0.28089308738708496 time to delete rle : 0.0004184246063232422 batch 1 Loaded 11 chid ids of type : 3594 ++++++++Number RLEs to save : 2190 TO DO : save crop sub photo not yet done ! save time : 0.1956331729888916 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06320762634277344 time for calcul the mask position with numpy : 0.02363276481628418 nb_pixel_total : 2048964 time to create 1 rle with new method : 0.10465693473815918 time for calcul the mask position with numpy : 0.007143974304199219 nb_pixel_total : 6400 time to create 1 rle with old method : 0.0071642398834228516 time for calcul the mask position with numpy : 0.006825923919677734 nb_pixel_total : 2376 time to create 1 rle with old method : 0.0027298927307128906 time for calcul the mask position with numpy : 0.0068738460540771484 nb_pixel_total : 9651 time to create 1 rle with old method : 0.010868549346923828 time for calcul the mask position with numpy : 0.007460117340087891 nb_pixel_total : 6209 time to create 1 rle with old method : 0.007431507110595703 create new chi : 0.1931002140045166 time to delete rle : 0.0005221366882324219 batch 1 Loaded 9 chid ids of type : 3594 +++++++++Number RLEs to save : 1881 TO DO : save crop sub photo not yet done ! save time : 0.16228032112121582 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 0.1914539337158203 time for calcul the mask position with numpy : 0.09510469436645508 nb_pixel_total : 1940499 time to create 1 rle with new method : 0.1376197338104248 time for calcul the mask position with numpy : 0.0065190792083740234 nb_pixel_total : 3126 time to create 1 rle with old method : 0.0035216808319091797 time for calcul the mask position with numpy : 0.007202863693237305 nb_pixel_total : 6693 time to create 1 rle with old method : 0.0075533390045166016 time for calcul the mask position with numpy : 0.006623268127441406 nb_pixel_total : 11235 time to create 1 rle with old method : 0.012692689895629883 time for calcul the mask position with numpy : 0.007071018218994141 nb_pixel_total : 89014 time to create 1 rle with old method : 0.09919571876525879 time for calcul the mask position with numpy : 0.006945610046386719 nb_pixel_total : 10464 time to create 1 rle with old method : 0.01174783706665039 time for calcul the mask position with numpy : 0.006913185119628906 nb_pixel_total : 6978 time to create 1 rle with old method : 0.007921934127807617 time for calcul the mask position with numpy : 0.007020473480224609 nb_pixel_total : 5591 time to create 1 rle with old method : 0.006272315979003906 create new chi : 0.4406406879425049 time to delete rle : 0.0006566047668457031 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 3574 TO DO : save crop sub photo not yet done ! save time : 0.2736549377441406 map_output_result : {1379677421: (0.0, 'Should be the crop_list due to order', 0), 1379677417: (0.0, 'Should be the crop_list due to order', 0), 1379677403: (0.0, 'Should be the crop_list due to order', 0), 1379677242: (0.0, 'Should be the crop_list due to order', 0), 1379677215: (0.0, 'Should be the crop_list due to order', 0), 1379677189: (0.0, 'Should be the crop_list due to order', 0), 1379677156: (0.0, 'Should be the crop_list due to order', 0), 1379677130: (0.0, 'Should be the crop_list due to order', 0), 1379677115: (0.0, 'Should be the crop_list due to order', 0), 1379677081: (0.0, 'Should be the crop_list due to order', 0), 1379677055: (0.0, 'Should be the crop_list due to order', 0), 1379677029: (0.0, 'Should be the crop_list due to order', 0), 1379677000: (0.0, 'Should be the crop_list due to order', 0), 1379676998: (0.0, 'Should be the crop_list due to order', 0), 1379676997: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1379677421, 1379677417, 1379677403, 1379677242, 1379677215, 1379677189, 1379677156, 1379677130, 1379677115, 1379677081, 1379677055, 1379677029, 1379677000, 1379676998, 1379676997] Looping around the photos to save general results len do output : 15 /1379677421.Didn't retrieve data . /1379677417.Didn't retrieve data . /1379677403.Didn't retrieve data . /1379677242.Didn't retrieve data . /1379677215.Didn't retrieve data . /1379677189.Didn't retrieve data . /1379677156.Didn't retrieve data . /1379677130.Didn't retrieve data . /1379677115.Didn't retrieve data . /1379677081.Didn't retrieve data . /1379677055.Didn't retrieve data . /1379677029.Didn't retrieve data . /1379677000.Didn't retrieve data . /1379676998.Didn't retrieve data . /1379676997.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677421', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677417', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677403', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677242', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677215', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677189', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677156', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677130', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677115', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677081', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677055', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677029', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677000', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379676998', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379676997', None, None, None, None, None, '3618812') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 45 time used for this insertion : 0.017295122146606445 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.108388423919678 time spend to save output : 0.017934322357177734 total time spend for step 3 : 11.126322746276855 step4:ventilate_hashtags_in_portfolio Thu Aug 28 02:21:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26278769 get user id for portfolio 26278769 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26278769 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','background','pet_clair','flou','papier','environnement','carton','mal_croppe','pet_fonce','autre','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26278769 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','background','pet_clair','flou','papier','environnement','carton','mal_croppe','pet_fonce','autre','metal')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26278769 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','background','pet_clair','flou','papier','environnement','carton','mal_croppe','pet_fonce','autre','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/26281142,26281143,26281144,26281145,26281146,26281147,26281148,26281149,26281150,26281151,26281152?tags=pehd,background,pet_clair,flou,papier,environnement,carton,mal_croppe,pet_fonce,autre,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1379677421, 1379677417, 1379677403, 1379677242, 1379677215, 1379677189, 1379677156, 1379677130, 1379677115, 1379677081, 1379677055, 1379677029, 1379677000, 1379676998, 1379676997] Looping around the photos to save general results len do output : 1 /26278769. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677421', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677417', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677403', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677242', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677215', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677189', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677156', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677130', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677115', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677081', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677055', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677029', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677000', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379676998', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379676997', None, None, None, None, None, '3618812') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.024413347244262695 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7603957653045654 time spend to save output : 0.0247347354888916 total time spend for step 4 : 0.785130500793457 step5:final Thu Aug 28 02:21:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1379677421: ('0.04679073431069958',), 1379677417: ('0.04679073431069958',), 1379677403: ('0.04679073431069958',), 1379677242: ('0.04679073431069958',), 1379677215: ('0.04679073431069958',), 1379677189: ('0.04679073431069958',), 1379677156: ('0.04679073431069958',), 1379677130: ('0.04679073431069958',), 1379677115: ('0.04679073431069958',), 1379677081: ('0.04679073431069958',), 1379677055: ('0.04679073431069958',), 1379677029: ('0.04679073431069958',), 1379677000: ('0.04679073431069958',), 1379676998: ('0.04679073431069958',), 1379676997: ('0.04679073431069958',)} new output for save of step final : {1379677421: ('0.04679073431069958',), 1379677417: ('0.04679073431069958',), 1379677403: ('0.04679073431069958',), 1379677242: ('0.04679073431069958',), 1379677215: ('0.04679073431069958',), 1379677189: ('0.04679073431069958',), 1379677156: ('0.04679073431069958',), 1379677130: ('0.04679073431069958',), 1379677115: ('0.04679073431069958',), 1379677081: ('0.04679073431069958',), 1379677055: ('0.04679073431069958',), 1379677029: ('0.04679073431069958',), 1379677000: ('0.04679073431069958',), 1379676998: ('0.04679073431069958',), 1379676997: ('0.04679073431069958',)} [1379677421, 1379677417, 1379677403, 1379677242, 1379677215, 1379677189, 1379677156, 1379677130, 1379677115, 1379677081, 1379677055, 1379677029, 1379677000, 1379676998, 1379676997] Looping around the photos to save general results len do output : 15 /1379677421.Didn't retrieve data . /1379677417.Didn't retrieve data . /1379677403.Didn't retrieve data . /1379677242.Didn't retrieve data . /1379677215.Didn't retrieve data . /1379677189.Didn't retrieve data . /1379677156.Didn't retrieve data . /1379677130.Didn't retrieve data . /1379677115.Didn't retrieve data . /1379677081.Didn't retrieve data . /1379677055.Didn't retrieve data . /1379677029.Didn't retrieve data . /1379677000.Didn't retrieve data . /1379676998.Didn't retrieve data . /1379676997.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677421', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677417', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677403', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677242', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677215', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677189', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677156', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677130', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677115', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677081', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677055', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677029', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677000', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379676998', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379676997', None, None, None, None, None, '3618812') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 45 time used for this insertion : 0.02066659927368164 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13070154190063477 time spend to save output : 0.021369457244873047 total time spend for step 5 : 0.1520709991455078 step6:blur_detection Thu Aug 28 02:21:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1756340429_2049433_1379677421_d935bc141f85f1e415d32e269a367480.jpg resize: (1080, 1920) 1379677421 0.019515400035257008 treat image : temp/1756340429_2049433_1379677417_1fb1ac53407279bcb901e4a8cd09c7a2.jpg resize: (1080, 1920) 1379677417 1.3543624965974386 treat image : temp/1756340429_2049433_1379677403_bc95933d2db6261cfa947188c475f4a2.jpg resize: (1080, 1920) 1379677403 0.8335706426692007 treat image : temp/1756340429_2049433_1379677242_4a78aa7b048bd467fb256c03fd9fcbc2.jpg resize: (1080, 1920) 1379677242 -0.11596824350779078 treat image : temp/1756340429_2049433_1379677215_bf8a8af03e5130874c12d702acad8f8e.jpg resize: (1080, 1920) 1379677215 0.24618078146895397 treat image : temp/1756340429_2049433_1379677189_7e82723f9e6e926b403c13e0edeb9462.jpg resize: (1080, 1920) 1379677189 -0.9301894095806088 treat image : temp/1756340429_2049433_1379677156_c30c97cae6ee27a1091524f7938e9009.jpg resize: (1080, 1920) 1379677156 0.8171231038665707 treat image : temp/1756340429_2049433_1379677130_e25cfc9f74d3e43337593af3a81b94d3.jpg resize: (1080, 1920) 1379677130 -1.0146583640998916 treat image : temp/1756340429_2049433_1379677115_037c394598197163202e80b5a27e6ce1.jpg resize: (1080, 1920) 1379677115 -4.14667274425354 treat image : temp/1756340429_2049433_1379677081_3413eef8e37fd8bdec1953e26e4fef20.jpg resize: (1080, 1920) 1379677081 -1.0061600317643786 treat image : temp/1756340429_2049433_1379677055_975d6854656062201df7a24b39860fb0.jpg resize: (1080, 1920) 1379677055 -0.5363666883194979 treat image : temp/1756340429_2049433_1379677029_6bac0b37c67bccd313340c69f7b85bc0.jpg resize: (1080, 1920) 1379677029 -0.7388283524934596 treat image : temp/1756340429_2049433_1379677000_6ea242f1a4c68b3654375ea3264749bc.jpg resize: (1080, 1920) 1379677000 0.02492987965016805 treat image : temp/1756340429_2049433_1379676998_fdac4486272a39bc1f4c56cd8bc4c87d.jpg resize: (1080, 1920) 1379676998 -0.42371055220195264 treat image : temp/1756340429_2049433_1379676997_08c8222d4b158a1f1a4e8133aa059e05.jpg resize: (1080, 1920) 1379676997 -0.7915109090521262 treat image : temp/1756340429_2049433_1379677421_d935bc141f85f1e415d32e269a367480_rle_crop_3933439377_0.png resize: (99, 96) 1379789089 0.40882587150159544 treat image : temp/1756340429_2049433_1379677421_d935bc141f85f1e415d32e269a367480_rle_crop_3933439379_0.png resize: (110, 57) 1379789090 -1.046416486258911 treat image : temp/1756340429_2049433_1379677421_d935bc141f85f1e415d32e269a367480_rle_crop_3933439380_0.png resize: (142, 69) 1379789091 -1.0380331918014571 treat image : temp/1756340429_2049433_1379677421_d935bc141f85f1e415d32e269a367480_rle_crop_3933439381_0.png resize: (207, 128) 1379789093 -2.7762131079257526 treat image : temp/1756340429_2049433_1379677417_1fb1ac53407279bcb901e4a8cd09c7a2_rle_crop_3933439383_0.png resize: (130, 125) 1379789094 -1.7775495915881643 treat image : temp/1756340429_2049433_1379677417_1fb1ac53407279bcb901e4a8cd09c7a2_rle_crop_3933439385_0.png resize: (119, 126) 1379789095 -2.0074829190759984 treat image : temp/1756340429_2049433_1379677417_1fb1ac53407279bcb901e4a8cd09c7a2_rle_crop_3933439387_0.png resize: (177, 114) 1379789096 -0.9766035053113747 treat image : temp/1756340429_2049433_1379677417_1fb1ac53407279bcb901e4a8cd09c7a2_rle_crop_3933439389_0.png resize: (128, 101) 1379789098 -1.3829036353094557 treat image : temp/1756340429_2049433_1379677403_bc95933d2db6261cfa947188c475f4a2_rle_crop_3933439392_0.png resize: (112, 116) 1379789099 -4.314807479252549 treat image : temp/1756340429_2049433_1379677242_4a78aa7b048bd467fb256c03fd9fcbc2_rle_crop_3933439395_0.png resize: (124, 157) 1379789100 0.46629978789944077 treat image : temp/1756340429_2049433_1379677215_bf8a8af03e5130874c12d702acad8f8e_rle_crop_3933439397_0.png resize: (207, 321) 1379789102 -0.8456858813938346 treat image : temp/1756340429_2049433_1379677215_bf8a8af03e5130874c12d702acad8f8e_rle_crop_3933439398_0.png resize: (76, 134) 1379789103 -1.3791226438836897 treat image : temp/1756340429_2049433_1379677215_bf8a8af03e5130874c12d702acad8f8e_rle_crop_3933439399_0.png resize: (119, 58) 1379789104 -1.0818561733811038 treat image : temp/1756340429_2049433_1379677189_7e82723f9e6e926b403c13e0edeb9462_rle_crop_3933439402_0.png resize: (182, 120) 1379789106 -1.4924292894968896 treat image : temp/1756340429_2049433_1379677156_c30c97cae6ee27a1091524f7938e9009_rle_crop_3933439403_0.png resize: (67, 137) 1379789107 -0.34268245025209654 treat image : temp/1756340429_2049433_1379677156_c30c97cae6ee27a1091524f7938e9009_rle_crop_3933439404_0.png resize: (107, 92) 1379789108 -0.05735971191795329 treat image : temp/1756340429_2049433_1379677156_c30c97cae6ee27a1091524f7938e9009_rle_crop_3933439408_0.png resize: (105, 178) 1379789110 -1.088697352623472 treat image : temp/1756340429_2049433_1379677130_e25cfc9f74d3e43337593af3a81b94d3_rle_crop_3933439409_0.png resize: (86, 238) 1379789111 0.017128199000213853 treat image : temp/1756340429_2049433_1379677130_e25cfc9f74d3e43337593af3a81b94d3_rle_crop_3933439410_0.png resize: (44, 55) 1379789112 -2.9712476531789536 treat image : temp/1756340429_2049433_1379677130_e25cfc9f74d3e43337593af3a81b94d3_rle_crop_3933439411_0.png resize: (173, 103) 1379789114 -0.8194077881622694 treat image : temp/1756340429_2049433_1379677130_e25cfc9f74d3e43337593af3a81b94d3_rle_crop_3933439413_0.png resize: (113, 133) 1379789115 -3.165147102774216 treat image : temp/1756340429_2049433_1379677115_037c394598197163202e80b5a27e6ce1_rle_crop_3933439415_0.png resize: (144, 193) 1379789116 -0.9359651835929091 treat image : temp/1756340429_2049433_1379677115_037c394598197163202e80b5a27e6ce1_rle_crop_3933439416_0.png resize: (217, 168) 1379789118 -2.3461872771024463 treat image : temp/1756340429_2049433_1379677081_3413eef8e37fd8bdec1953e26e4fef20_rle_crop_3933439418_0.png resize: (138, 148) 1379789119 0.5512177710099299 treat image : temp/1756340429_2049433_1379677081_3413eef8e37fd8bdec1953e26e4fef20_rle_crop_3933439419_0.png resize: (207, 71) 1379789120 -0.6305963378941931 treat image : temp/1756340429_2049433_1379677055_975d6854656062201df7a24b39860fb0_rle_crop_3933439421_0.png resize: (55, 94) 1379789122 -0.4955625668967738 treat image : temp/1756340429_2049433_1379677029_6bac0b37c67bccd313340c69f7b85bc0_rle_crop_3933439422_0.png resize: (113, 116) 1379789123 0.37350436126867514 treat image : temp/1756340429_2049433_1379677029_6bac0b37c67bccd313340c69f7b85bc0_rle_crop_3933439423_0.png resize: (179, 85) 1379789124 -1.907037733973889 treat image : temp/1756340429_2049433_1379677000_6ea242f1a4c68b3654375ea3264749bc_rle_crop_3933439424_0.png resize: (61, 124) 1379789125 -0.007853942004806849 treat image : temp/1756340429_2049433_1379677000_6ea242f1a4c68b3654375ea3264749bc_rle_crop_3933439427_0.png resize: (161, 69) 1379789127 0.7120201851668321 treat image : temp/1756340429_2049433_1379676998_fdac4486272a39bc1f4c56cd8bc4c87d_rle_crop_3933439430_0.png resize: (172, 104) 1379789128 -0.5464340579424617 treat image : temp/1756340429_2049433_1379676998_fdac4486272a39bc1f4c56cd8bc4c87d_rle_crop_3933439431_0.png resize: (36, 90) 1379789129 1.1742509473709226 treat image : temp/1756340429_2049433_1379676997_08c8222d4b158a1f1a4e8133aa059e05_rle_crop_3933439435_0.png resize: (172, 108) 1379789131 -0.5666821954086637 treat image : temp/1756340429_2049433_1379676997_08c8222d4b158a1f1a4e8133aa059e05_rle_crop_3933439439_0.png resize: (96, 46) 1379789132 1.0137412196245563 treat image : temp/1756340429_2049433_1379677421_d935bc141f85f1e415d32e269a367480_rle_crop_3933439378_0.png resize: (194, 77) 1379789148 0.20463228829688615 treat image : temp/1756340429_2049433_1379677417_1fb1ac53407279bcb901e4a8cd09c7a2_rle_crop_3933439384_0.png resize: (124, 140) 1379789149 0.29373824808904114 treat image : temp/1756340429_2049433_1379677417_1fb1ac53407279bcb901e4a8cd09c7a2_rle_crop_3933439386_0.png resize: (127, 115) 1379789150 -0.4944710114268565 treat image : temp/1756340429_2049433_1379677403_bc95933d2db6261cfa947188c475f4a2_rle_crop_3933439391_0.png resize: (137, 132) 1379789151 -1.5317290230521252 treat image : temp/1756340429_2049433_1379677403_bc95933d2db6261cfa947188c475f4a2_rle_crop_3933439393_0.png resize: (126, 139) 1379789152 0.5089603154668304 treat image : temp/1756340429_2049433_1379677215_bf8a8af03e5130874c12d702acad8f8e_rle_crop_3933439396_0.png resize: (65, 140) 1379789153 -2.123661262694077 treat image : temp/1756340429_2049433_1379677156_c30c97cae6ee27a1091524f7938e9009_rle_crop_3933439405_0.png resize: (72, 125) 1379789154 -1.276184832791739 treat image : temp/1756340429_2049433_1379677156_c30c97cae6ee27a1091524f7938e9009_rle_crop_3933439407_0.png resize: (143, 222) 1379789155 -1.444556437951079 treat image : temp/1756340429_2049433_1379677130_e25cfc9f74d3e43337593af3a81b94d3_rle_crop_3933439412_0.png resize: (95, 145) 1379789156 -0.9339243658385409 treat image : temp/1756340429_2049433_1379677000_6ea242f1a4c68b3654375ea3264749bc_rle_crop_3933439425_0.png resize: (120, 101) 1379789158 1.3505232689204565 treat image : temp/1756340429_2049433_1379676998_fdac4486272a39bc1f4c56cd8bc4c87d_rle_crop_3933439429_0.png resize: (101, 97) 1379789160 -1.65637223335994 treat image : temp/1756340429_2049433_1379676998_fdac4486272a39bc1f4c56cd8bc4c87d_rle_crop_3933439432_0.png resize: (80, 109) 1379789162 0.30559743831115316 treat image : temp/1756340429_2049433_1379676997_08c8222d4b158a1f1a4e8133aa059e05_rle_crop_3933439433_0.png resize: (119, 70) 1379789164 -1.4752587647029576 treat image : temp/1756340429_2049433_1379676997_08c8222d4b158a1f1a4e8133aa059e05_rle_crop_3933439438_0.png resize: (125, 85) 1379789166 -1.5628947134328286 treat image : temp/1756340429_2049433_1379677421_d935bc141f85f1e415d32e269a367480_rle_crop_3933439376_0.png resize: (43, 85) 1379789176 5.668269037965276 treat image : temp/1756340429_2049433_1379677421_d935bc141f85f1e415d32e269a367480_rle_crop_3933439382_0.png resize: (205, 293) 1379789177 -1.3743796293002613 treat image : temp/1756340429_2049433_1379677417_1fb1ac53407279bcb901e4a8cd09c7a2_rle_crop_3933439388_0.png resize: (120, 116) 1379789178 -2.0962276949771117 treat image : temp/1756340429_2049433_1379677417_1fb1ac53407279bcb901e4a8cd09c7a2_rle_crop_3933439390_0.png resize: (181, 162) 1379789179 -2.284547927401218 treat image : temp/1756340429_2049433_1379677242_4a78aa7b048bd467fb256c03fd9fcbc2_rle_crop_3933439394_0.png resize: (77, 107) 1379789180 -0.967626864981468 treat image : temp/1756340429_2049433_1379677189_7e82723f9e6e926b403c13e0edeb9462_rle_crop_3933439400_0.png resize: (168, 149) 1379789181 -2.8567676204276964 treat image : temp/1756340429_2049433_1379677189_7e82723f9e6e926b403c13e0edeb9462_rle_crop_3933439401_0.png resize: (127, 271) 1379789182 -2.9160007038948352 treat image : temp/1756340429_2049433_1379677156_c30c97cae6ee27a1091524f7938e9009_rle_crop_3933439406_0.png resize: (174, 146) 1379789183 -0.31908124497136325 treat image : temp/1756340429_2049433_1379677115_037c394598197163202e80b5a27e6ce1_rle_crop_3933439414_0.png resize: (164, 161) 1379789184 -2.5065348721902305 treat image : temp/1756340429_2049433_1379677115_037c394598197163202e80b5a27e6ce1_rle_crop_3933439417_0.png resize: (93, 85) 1379789185 -3.187516805566497 treat image : temp/1756340429_2049433_1379677081_3413eef8e37fd8bdec1953e26e4fef20_rle_crop_3933439420_0.png resize: (956, 987) 1379789186 0.13409316712022562 treat image : temp/1756340429_2049433_1379677000_6ea242f1a4c68b3654375ea3264749bc_rle_crop_3933439426_0.png resize: (143, 189) 1379789187 -0.890209298324735 treat image : temp/1756340429_2049433_1379677000_6ea242f1a4c68b3654375ea3264749bc_rle_crop_3933439428_0.png resize: (92, 199) 1379789188 -0.18845179270281748 treat image : temp/1756340429_2049433_1379676997_08c8222d4b158a1f1a4e8133aa059e05_rle_crop_3933439434_0.png resize: (127, 103) 1379789189 -2.238978671549356 treat image : temp/1756340429_2049433_1379676997_08c8222d4b158a1f1a4e8133aa059e05_rle_crop_3933439436_0.png resize: (520, 317) 1379789190 -0.505317006106512 treat image : temp/1756340429_2049433_1379676997_08c8222d4b158a1f1a4e8133aa059e05_rle_crop_3933439437_0.png resize: (69, 185) 1379789191 2.4801426146298065 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 79 time used for this insertion : 0.014494180679321289 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 79 time used for this insertion : 0.015099763870239258 save missing photos in datou_result : time spend for datou_step_exec : 12.405384540557861 time spend to save output : 0.03598499298095703 total time spend for step 6 : 12.441369533538818 step7:brightness Thu Aug 28 02:21:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756340429_2049433_1379677421_d935bc141f85f1e415d32e269a367480.jpg treat image : temp/1756340429_2049433_1379677417_1fb1ac53407279bcb901e4a8cd09c7a2.jpg treat image : temp/1756340429_2049433_1379677403_bc95933d2db6261cfa947188c475f4a2.jpg treat image : temp/1756340429_2049433_1379677242_4a78aa7b048bd467fb256c03fd9fcbc2.jpg treat image : temp/1756340429_2049433_1379677215_bf8a8af03e5130874c12d702acad8f8e.jpg treat image : temp/1756340429_2049433_1379677189_7e82723f9e6e926b403c13e0edeb9462.jpg treat image : temp/1756340429_2049433_1379677156_c30c97cae6ee27a1091524f7938e9009.jpg treat image : temp/1756340429_2049433_1379677130_e25cfc9f74d3e43337593af3a81b94d3.jpg treat image : temp/1756340429_2049433_1379677115_037c394598197163202e80b5a27e6ce1.jpg treat image : temp/1756340429_2049433_1379677081_3413eef8e37fd8bdec1953e26e4fef20.jpg treat image : temp/1756340429_2049433_1379677055_975d6854656062201df7a24b39860fb0.jpg treat image : temp/1756340429_2049433_1379677029_6bac0b37c67bccd313340c69f7b85bc0.jpg treat image : temp/1756340429_2049433_1379677000_6ea242f1a4c68b3654375ea3264749bc.jpg treat image : temp/1756340429_2049433_1379676998_fdac4486272a39bc1f4c56cd8bc4c87d.jpg treat image : temp/1756340429_2049433_1379676997_08c8222d4b158a1f1a4e8133aa059e05.jpg treat image : temp/1756340429_2049433_1379677421_d935bc141f85f1e415d32e269a367480_rle_crop_3933439377_0.png treat image : temp/1756340429_2049433_1379677421_d935bc141f85f1e415d32e269a367480_rle_crop_3933439379_0.png treat image : temp/1756340429_2049433_1379677421_d935bc141f85f1e415d32e269a367480_rle_crop_3933439380_0.png treat image : temp/1756340429_2049433_1379677421_d935bc141f85f1e415d32e269a367480_rle_crop_3933439381_0.png treat image : temp/1756340429_2049433_1379677417_1fb1ac53407279bcb901e4a8cd09c7a2_rle_crop_3933439383_0.png treat image : temp/1756340429_2049433_1379677417_1fb1ac53407279bcb901e4a8cd09c7a2_rle_crop_3933439385_0.png treat image : temp/1756340429_2049433_1379677417_1fb1ac53407279bcb901e4a8cd09c7a2_rle_crop_3933439387_0.png treat image : temp/1756340429_2049433_1379677417_1fb1ac53407279bcb901e4a8cd09c7a2_rle_crop_3933439389_0.png treat image : temp/1756340429_2049433_1379677403_bc95933d2db6261cfa947188c475f4a2_rle_crop_3933439392_0.png treat image : temp/1756340429_2049433_1379677242_4a78aa7b048bd467fb256c03fd9fcbc2_rle_crop_3933439395_0.png treat image : temp/1756340429_2049433_1379677215_bf8a8af03e5130874c12d702acad8f8e_rle_crop_3933439397_0.png treat image : temp/1756340429_2049433_1379677215_bf8a8af03e5130874c12d702acad8f8e_rle_crop_3933439398_0.png treat image : temp/1756340429_2049433_1379677215_bf8a8af03e5130874c12d702acad8f8e_rle_crop_3933439399_0.png treat image : temp/1756340429_2049433_1379677189_7e82723f9e6e926b403c13e0edeb9462_rle_crop_3933439402_0.png treat image : temp/1756340429_2049433_1379677156_c30c97cae6ee27a1091524f7938e9009_rle_crop_3933439403_0.png treat image : temp/1756340429_2049433_1379677156_c30c97cae6ee27a1091524f7938e9009_rle_crop_3933439404_0.png treat image : temp/1756340429_2049433_1379677156_c30c97cae6ee27a1091524f7938e9009_rle_crop_3933439408_0.png treat image : temp/1756340429_2049433_1379677130_e25cfc9f74d3e43337593af3a81b94d3_rle_crop_3933439409_0.png treat image : temp/1756340429_2049433_1379677130_e25cfc9f74d3e43337593af3a81b94d3_rle_crop_3933439410_0.png treat image : temp/1756340429_2049433_1379677130_e25cfc9f74d3e43337593af3a81b94d3_rle_crop_3933439411_0.png treat image : temp/1756340429_2049433_1379677130_e25cfc9f74d3e43337593af3a81b94d3_rle_crop_3933439413_0.png treat image : temp/1756340429_2049433_1379677115_037c394598197163202e80b5a27e6ce1_rle_crop_3933439415_0.png treat image : temp/1756340429_2049433_1379677115_037c394598197163202e80b5a27e6ce1_rle_crop_3933439416_0.png treat image : temp/1756340429_2049433_1379677081_3413eef8e37fd8bdec1953e26e4fef20_rle_crop_3933439418_0.png treat image : temp/1756340429_2049433_1379677081_3413eef8e37fd8bdec1953e26e4fef20_rle_crop_3933439419_0.png treat image : temp/1756340429_2049433_1379677055_975d6854656062201df7a24b39860fb0_rle_crop_3933439421_0.png treat image : temp/1756340429_2049433_1379677029_6bac0b37c67bccd313340c69f7b85bc0_rle_crop_3933439422_0.png treat image : temp/1756340429_2049433_1379677029_6bac0b37c67bccd313340c69f7b85bc0_rle_crop_3933439423_0.png treat image : temp/1756340429_2049433_1379677000_6ea242f1a4c68b3654375ea3264749bc_rle_crop_3933439424_0.png treat image : temp/1756340429_2049433_1379677000_6ea242f1a4c68b3654375ea3264749bc_rle_crop_3933439427_0.png treat image : temp/1756340429_2049433_1379676998_fdac4486272a39bc1f4c56cd8bc4c87d_rle_crop_3933439430_0.png treat image : temp/1756340429_2049433_1379676998_fdac4486272a39bc1f4c56cd8bc4c87d_rle_crop_3933439431_0.png treat image : temp/1756340429_2049433_1379676997_08c8222d4b158a1f1a4e8133aa059e05_rle_crop_3933439435_0.png treat image : temp/1756340429_2049433_1379676997_08c8222d4b158a1f1a4e8133aa059e05_rle_crop_3933439439_0.png treat image : temp/1756340429_2049433_1379677421_d935bc141f85f1e415d32e269a367480_rle_crop_3933439378_0.png treat image : temp/1756340429_2049433_1379677417_1fb1ac53407279bcb901e4a8cd09c7a2_rle_crop_3933439384_0.png treat image : temp/1756340429_2049433_1379677417_1fb1ac53407279bcb901e4a8cd09c7a2_rle_crop_3933439386_0.png treat image : temp/1756340429_2049433_1379677403_bc95933d2db6261cfa947188c475f4a2_rle_crop_3933439391_0.png treat image : temp/1756340429_2049433_1379677403_bc95933d2db6261cfa947188c475f4a2_rle_crop_3933439393_0.png treat image : temp/1756340429_2049433_1379677215_bf8a8af03e5130874c12d702acad8f8e_rle_crop_3933439396_0.png treat image : temp/1756340429_2049433_1379677156_c30c97cae6ee27a1091524f7938e9009_rle_crop_3933439405_0.png treat image : temp/1756340429_2049433_1379677156_c30c97cae6ee27a1091524f7938e9009_rle_crop_3933439407_0.png treat image : temp/1756340429_2049433_1379677130_e25cfc9f74d3e43337593af3a81b94d3_rle_crop_3933439412_0.png treat image : temp/1756340429_2049433_1379677000_6ea242f1a4c68b3654375ea3264749bc_rle_crop_3933439425_0.png treat image : temp/1756340429_2049433_1379676998_fdac4486272a39bc1f4c56cd8bc4c87d_rle_crop_3933439429_0.png treat image : temp/1756340429_2049433_1379676998_fdac4486272a39bc1f4c56cd8bc4c87d_rle_crop_3933439432_0.png treat image : temp/1756340429_2049433_1379676997_08c8222d4b158a1f1a4e8133aa059e05_rle_crop_3933439433_0.png treat image : temp/1756340429_2049433_1379676997_08c8222d4b158a1f1a4e8133aa059e05_rle_crop_3933439438_0.png treat image : temp/1756340429_2049433_1379677421_d935bc141f85f1e415d32e269a367480_rle_crop_3933439376_0.png treat image : temp/1756340429_2049433_1379677421_d935bc141f85f1e415d32e269a367480_rle_crop_3933439382_0.png treat image : temp/1756340429_2049433_1379677417_1fb1ac53407279bcb901e4a8cd09c7a2_rle_crop_3933439388_0.png treat image : temp/1756340429_2049433_1379677417_1fb1ac53407279bcb901e4a8cd09c7a2_rle_crop_3933439390_0.png treat image : temp/1756340429_2049433_1379677242_4a78aa7b048bd467fb256c03fd9fcbc2_rle_crop_3933439394_0.png treat image : temp/1756340429_2049433_1379677189_7e82723f9e6e926b403c13e0edeb9462_rle_crop_3933439400_0.png treat image : temp/1756340429_2049433_1379677189_7e82723f9e6e926b403c13e0edeb9462_rle_crop_3933439401_0.png treat image : temp/1756340429_2049433_1379677156_c30c97cae6ee27a1091524f7938e9009_rle_crop_3933439406_0.png treat image : temp/1756340429_2049433_1379677115_037c394598197163202e80b5a27e6ce1_rle_crop_3933439414_0.png treat image : temp/1756340429_2049433_1379677115_037c394598197163202e80b5a27e6ce1_rle_crop_3933439417_0.png treat image : temp/1756340429_2049433_1379677081_3413eef8e37fd8bdec1953e26e4fef20_rle_crop_3933439420_0.png treat image : temp/1756340429_2049433_1379677000_6ea242f1a4c68b3654375ea3264749bc_rle_crop_3933439426_0.png treat image : temp/1756340429_2049433_1379677000_6ea242f1a4c68b3654375ea3264749bc_rle_crop_3933439428_0.png treat image : temp/1756340429_2049433_1379676997_08c8222d4b158a1f1a4e8133aa059e05_rle_crop_3933439434_0.png treat image : temp/1756340429_2049433_1379676997_08c8222d4b158a1f1a4e8133aa059e05_rle_crop_3933439436_0.png treat image : temp/1756340429_2049433_1379676997_08c8222d4b158a1f1a4e8133aa059e05_rle_crop_3933439437_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 79 time used for this insertion : 0.014444828033447266 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 79 time used for this insertion : 0.01446533203125 save missing photos in datou_result : time spend for datou_step_exec : 3.652947425842285 time spend to save output : 0.03348565101623535 total time spend for step 7 : 3.6864330768585205 step8:velours_tree Thu Aug 28 02:21:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.25510692596435547 time spend to save output : 4.315376281738281e-05 total time spend for step 8 : 0.25515007972717285 step9:send_mail_cod Thu Aug 28 02:21:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26278769_28-08-2025_02_21_59.pdf 26281142 imagette262811421756340519 26281143 imagette262811431756340519 26281144 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262811441756340519 26281145 imagette262811451756340520 26281146 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262811461756340520 26281148 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262811481756340521 26281149 imagette262811491756340522 26281150 imagette262811501756340522 26281151 imagette262811511756340522 26281152 imagette262811521756340522 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26278769 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26281142,26281143,26281144,26281145,26281146,26281147,26281148,26281149,26281150,26281151,26281152?tags=pehd,background,pet_clair,flou,papier,environnement,carton,mal_croppe,pet_fonce,autre,metal args[1379677421] : ((1379677421, 0.019515400035257008, 492688767), (1379677421, 0.42875638511533143, 2107752395), '0.04679073431069958') We are sending mail with results at report@fotonower.com args[1379677417] : ((1379677417, 1.3543624965974386, 492688767), (1379677417, 0.2871412456404437, 2107752395), '0.04679073431069958') We are sending mail with results at report@fotonower.com args[1379677403] : ((1379677403, 0.8335706426692007, 492688767), (1379677403, 0.31884479517327585, 2107752395), '0.04679073431069958') We are sending mail with results at report@fotonower.com args[1379677242] : ((1379677242, -0.11596824350779078, 492688767), (1379677242, 0.6208835919522943, 2107752395), '0.04679073431069958') We are sending mail with results at report@fotonower.com args[1379677215] : ((1379677215, 0.24618078146895397, 492688767), (1379677215, 0.8759985357789059, 2107752395), '0.04679073431069958') We are sending mail with results at report@fotonower.com args[1379677189] : ((1379677189, -0.9301894095806088, 492688767), (1379677189, 0.6655471124179533, 2107752395), '0.04679073431069958') We are sending mail with results at report@fotonower.com args[1379677156] : ((1379677156, 0.8171231038665707, 492688767), (1379677156, 0.20897191180688499, 2107752395), '0.04679073431069958') We are sending mail with results at report@fotonower.com args[1379677130] : ((1379677130, -1.0146583640998916, 492688767), (1379677130, 0.5069862302687714, 2107752395), '0.04679073431069958') We are sending mail with results at report@fotonower.com args[1379677115] : ((1379677115, -4.14667274425354, 492609224), (1379677115, 0.2641769208889552, 2107752395), '0.04679073431069958') We are sending mail with results at report@fotonower.com args[1379677081] : ((1379677081, -1.0061600317643786, 492688767), (1379677081, 0.8043115820570456, 2107752395), '0.04679073431069958') We are sending mail with results at report@fotonower.com args[1379677055] : ((1379677055, -0.5363666883194979, 492688767), (1379677055, 0.91514141241116, 2107752395), '0.04679073431069958') We are sending mail with results at report@fotonower.com args[1379677029] : ((1379677029, -0.7388283524934596, 492688767), (1379677029, 0.6144607338108274, 2107752395), '0.04679073431069958') We are sending mail with results at report@fotonower.com args[1379677000] : ((1379677000, 0.02492987965016805, 492688767), (1379677000, 0.43413854454774303, 2107752395), '0.04679073431069958') We are sending mail with results at report@fotonower.com args[1379676998] : ((1379676998, -0.42371055220195264, 492688767), (1379676998, 0.937513945466319, 2107752395), '0.04679073431069958') We are sending mail with results at report@fotonower.com args[1379676997] : ((1379676997, -0.7915109090521262, 492688767), (1379676997, 0.6948902752461088, 2107752395), '0.04679073431069958') We are sending mail with results at report@fotonower.com refus_total : 0.04679073431069958 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26278769 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26278769_28-08-2025_02_21_59.pdf results_Auto_P26278769_28-08-2025_02_21_59.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26278769_28-08-2025_02_21_59.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26278769','results_Auto_P26278769_28-08-2025_02_21_59.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26278769_28-08-2025_02_21_59.pdf','pdf','','0.28','0.04679073431069958') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26278769

https://www.fotonower.com/image?json=false&list_photos_id=1379677421
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379677417
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.3543624965974386)
https://www.fotonower.com/image?json=false&list_photos_id=1379677403
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379677242
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379677215
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379677189
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379677156
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379677130
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379677115
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379677081
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379677055
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379677029
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379677000
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379676998
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379676997
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 4.68%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/26281144?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26281146?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26281148?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26278769_28-08-2025_02_21_59.pdf.

Lien vers velours :https://www.fotonower.com/velours/26281142,26281143,26281144,26281145,26281146,26281147,26281148,26281149,26281150,26281151,26281152?tags=pehd,background,pet_clair,flou,papier,environnement,carton,mal_croppe,pet_fonce,autre,metal.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 28 Aug 2025 00:22:04 GMT Content-Length: 0 Connection: close X-Message-Id: VW-XRINyRpygcd9igAP7Yg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1379677421, 1379677417, 1379677403, 1379677242, 1379677215, 1379677189, 1379677156, 1379677130, 1379677115, 1379677081, 1379677055, 1379677029, 1379677000, 1379676998, 1379676997] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677421', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677417', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677403', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677242', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677215', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677189', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677156', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677130', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677115', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677081', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677055', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677029', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677000', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379676998', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379676997', None, None, None, None, None, '3618812') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.013315677642822266 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.856416940689087 time spend to save output : 0.013603925704956055 total time spend for step 9 : 4.870020866394043 step10:split_time_score Thu Aug 28 02:22:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 15),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 27082025 26278769 Nombre de photos uploadées : 15 / 23040 (0%) 27082025 26278769 Nombre de photos taguées (types de déchets): 0 / 15 (0%) 27082025 26278769 Nombre de photos taguées (volume) : 0 / 15 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ??????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007767677307128906 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20962285995483398 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.062204378858024684 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26256001_27-08-2025_09_32_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26256001 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26256001 AND mptpi.`type`=3594 To do Qualite : 0.07180745918615984 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26258328_27-08-2025_10_02_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26258328 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26258328 AND mptpi.`type`=3594 To do Qualite : 0.12330058834876545 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26258329_27-08-2025_10_12_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26258329 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26258329 AND mptpi.`type`=3594 To do Qualite : 0.07669382122507122 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26258331_27-08-2025_09_54_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26258331 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26258331 AND mptpi.`type`=3594 To do Qualite : 0.025566285686728387 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26260990_27-08-2025_13_01_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26260990 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26260990 AND mptpi.`type`=3594 To do Qualite : 0.05087973192573884 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26260994_27-08-2025_11_43_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26260994 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26260994 AND mptpi.`type`=3594 To do Qualite : 0.1781512104552469 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26262423_27-08-2025_12_53_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26262423 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26262423 AND mptpi.`type`=3594 To do Qualite : 0.163993932379349 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26262424_27-08-2025_12_41_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26262424 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26262424 AND mptpi.`type`=3594 To do Qualite : 0.07257282021604938 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26278765_28-08-2025_01_31_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26278765 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26278765 AND mptpi.`type`=3594 To do Qualite : 0.12441585372574952 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26278767_28-08-2025_01_22_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26278767 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26278767 AND mptpi.`type`=3594 To do Qualite : 0.04679073431069958 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26278769_28-08-2025_02_21_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26278769 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26278769 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26278771 order by id desc limit 1 Qualite : 0.14064266799943884 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26278772_28-08-2025_00_51_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26278772 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26278772 AND mptpi.`type`=3594 To do Qualite : 0.1320327312059083 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26278776_28-08-2025_00_41_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26278776 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26278776 AND mptpi.`type`=3594 To do Qualite : 0.044528999485596715 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26278779_28-08-2025_00_31_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26278779 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26278779 AND mptpi.`type`=3594 To do Qualite : 0.07768288108710562 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26278790_28-08-2025_00_21_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26278790 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26278790 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'27082025': {'nb_upload': 15, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1379677421, 1379677417, 1379677403, 1379677242, 1379677215, 1379677189, 1379677156, 1379677130, 1379677115, 1379677081, 1379677055, 1379677029, 1379677000, 1379676998, 1379676997] Looping around the photos to save general results len do output : 1 /26278769Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677421', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677417', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677403', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677242', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677215', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677189', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677156', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677130', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677115', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677081', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677055', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677029', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379677000', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379676998', None, None, None, None, None, '3618812') ('3318', None, None, None, None, None, None, None, '3618812') ('3318', '26278769', '1379676997', None, None, None, None, None, '3618812') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.061209917068481445 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.3106517791748047 time spend to save output : 0.06149435043334961 total time spend for step 10 : 2.3721461296081543 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 15 set_done_treatment 47.37user 27.47system 1:42.74elapsed 72%CPU (0avgtext+0avgdata 2991236maxresident)k 580784inputs+20432outputs (1109major+1933663minor)pagefaults 0swaps