python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1016553 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3615124'] with mtr_portfolio_ids : ['26269189'] and first list_photo_ids : [] new path : /proc/1016553/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 19 ; length of list_pids : 19 ; length of list_args : 19 time to download the photos : 3.094125509262085 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Aug 27 19:00:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10607 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-27 19:00:33.152873: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-27 19:00:33.184511: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-27 19:00:33.186479: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f52a0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-27 19:00:33.186511: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-27 19:00:33.190867: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-27 19:00:33.331872: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x545c940 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-27 19:00:33.331927: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-27 19:00:33.333357: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-27 19:00:33.333782: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-27 19:00:33.336849: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-27 19:00:33.339828: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-27 19:00:33.340315: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-27 19:00:33.342793: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-27 19:00:33.343863: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-27 19:00:33.348281: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-27 19:00:33.349814: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-27 19:00:33.349888: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-27 19:00:33.350683: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-27 19:00:33.350700: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-27 19:00:33.350709: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-27 19:00:33.352089: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9681 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-27 19:00:33.641946: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-27 19:00:33.642047: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-27 19:00:33.642067: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-27 19:00:33.642085: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-27 19:00:33.642102: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-27 19:00:33.642119: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-27 19:00:33.642136: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-27 19:00:33.642153: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-27 19:00:33.643442: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-27 19:00:33.644745: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-27 19:00:33.644791: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-27 19:00:33.644809: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-27 19:00:33.644825: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-27 19:00:33.644841: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-27 19:00:33.644857: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-27 19:00:33.644872: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-27 19:00:33.644888: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-27 19:00:33.646159: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-27 19:00:33.646191: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-27 19:00:33.646200: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-27 19:00:33.646208: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-27 19:00:33.647532: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9681 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-27 19:00:43.590765: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-27 19:00:43.837072: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 19 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 43.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 74.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 49.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 57.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 48.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 43.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 Detection mask done ! Trying to reset tf kernel 1019837 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 739 tf kernel not reseted sub process len(results) : 19 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 19 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1538 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00035691261291503906 nb_pixel_total : 12657 time to create 1 rle with old method : 0.015237569808959961 length of segment : 188 time for calcul the mask position with numpy : 9.703636169433594e-05 nb_pixel_total : 3444 time to create 1 rle with old method : 0.00431513786315918 length of segment : 138 time for calcul the mask position with numpy : 0.012531757354736328 nb_pixel_total : 709347 time to create 1 rle with new method : 0.12797999382019043 length of segment : 965 time for calcul the mask position with numpy : 0.0003135204315185547 nb_pixel_total : 18600 time to create 1 rle with old method : 0.022670507431030273 length of segment : 160 time for calcul the mask position with numpy : 0.008946418762207031 nb_pixel_total : 559759 time to create 1 rle with new method : 0.02009296417236328 length of segment : 1070 time for calcul the mask position with numpy : 0.0003037452697753906 nb_pixel_total : 18108 time to create 1 rle with old method : 0.021143198013305664 length of segment : 161 time for calcul the mask position with numpy : 0.0009136199951171875 nb_pixel_total : 50502 time to create 1 rle with old method : 0.05750298500061035 length of segment : 415 time for calcul the mask position with numpy : 0.00012612342834472656 nb_pixel_total : 4145 time to create 1 rle with old method : 0.005238533020019531 length of segment : 83 time for calcul the mask position with numpy : 0.00021314620971679688 nb_pixel_total : 8203 time to create 1 rle with old method : 0.00958871841430664 length of segment : 165 time for calcul the mask position with numpy : 0.00046515464782714844 nb_pixel_total : 35397 time to create 1 rle with old method : 0.04089021682739258 length of segment : 162 time for calcul the mask position with numpy : 0.0001480579376220703 nb_pixel_total : 5509 time to create 1 rle with old method : 0.006603240966796875 length of segment : 110 time for calcul the mask position with numpy : 0.00016307830810546875 nb_pixel_total : 7708 time to create 1 rle with old method : 0.00973963737487793 length of segment : 70 time for calcul the mask position with numpy : 0.00015473365783691406 nb_pixel_total : 5834 time to create 1 rle with old method : 0.007422447204589844 length of segment : 86 time for calcul the mask position with numpy : 0.0001800060272216797 nb_pixel_total : 5976 time to create 1 rle with old method : 0.007796049118041992 length of segment : 102 time for calcul the mask position with numpy : 0.0007319450378417969 nb_pixel_total : 41620 time to create 1 rle with old method : 0.04698443412780762 length of segment : 248 time for calcul the mask position with numpy : 0.0002789497375488281 nb_pixel_total : 14699 time to create 1 rle with old method : 0.016759157180786133 length of segment : 151 time for calcul the mask position with numpy : 0.0001068115234375 nb_pixel_total : 2292 time to create 1 rle with old method : 0.00290679931640625 length of segment : 50 time for calcul the mask position with numpy : 0.0018610954284667969 nb_pixel_total : 101092 time to create 1 rle with old method : 0.11318063735961914 length of segment : 572 time for calcul the mask position with numpy : 0.0017893314361572266 nb_pixel_total : 120682 time to create 1 rle with old method : 0.13808250427246094 length of segment : 576 time for calcul the mask position with numpy : 0.0007355213165283203 nb_pixel_total : 44917 time to create 1 rle with old method : 0.05149722099304199 length of segment : 259 time for calcul the mask position with numpy : 0.0002315044403076172 nb_pixel_total : 6269 time to create 1 rle with old method : 0.01013040542602539 length of segment : 79 time for calcul the mask position with numpy : 0.0003714561462402344 nb_pixel_total : 15619 time to create 1 rle with old method : 0.025119781494140625 length of segment : 141 time for calcul the mask position with numpy : 0.0006918907165527344 nb_pixel_total : 33674 time to create 1 rle with old method : 0.045491933822631836 length of segment : 174 time for calcul the mask position with numpy : 0.0017733573913574219 nb_pixel_total : 122024 time to create 1 rle with old method : 0.18415522575378418 length of segment : 577 time for calcul the mask position with numpy : 0.0012748241424560547 nb_pixel_total : 70069 time to create 1 rle with old method : 0.08065295219421387 length of segment : 474 time for calcul the mask position with numpy : 0.0006654262542724609 nb_pixel_total : 38047 time to create 1 rle with old method : 0.043962717056274414 length of segment : 280 time for calcul the mask position with numpy : 0.0021076202392578125 nb_pixel_total : 184547 time to create 1 rle with new method : 0.004190921783447266 length of segment : 341 time for calcul the mask position with numpy : 0.0016579627990722656 nb_pixel_total : 107316 time to create 1 rle with old method : 0.12663626670837402 length of segment : 559 time for calcul the mask position with numpy : 0.010716676712036133 nb_pixel_total : 642653 time to create 1 rle with new method : 0.019237518310546875 length of segment : 894 time for calcul the mask position with numpy : 0.0003218650817871094 nb_pixel_total : 4133 time to create 1 rle with old method : 0.004962921142578125 length of segment : 120 time for calcul the mask position with numpy : 0.00029397010803222656 nb_pixel_total : 9554 time to create 1 rle with old method : 0.011266231536865234 length of segment : 154 time for calcul the mask position with numpy : 0.00028967857360839844 nb_pixel_total : 9664 time to create 1 rle with old method : 0.01189112663269043 length of segment : 129 time for calcul the mask position with numpy : 0.002223968505859375 nb_pixel_total : 123213 time to create 1 rle with old method : 0.13981080055236816 length of segment : 572 time for calcul the mask position with numpy : 0.0018305778503417969 nb_pixel_total : 102448 time to create 1 rle with old method : 0.11517071723937988 length of segment : 519 time for calcul the mask position with numpy : 0.00028395652770996094 nb_pixel_total : 8653 time to create 1 rle with old method : 0.010863304138183594 length of segment : 125 time for calcul the mask position with numpy : 0.00011205673217773438 nb_pixel_total : 2782 time to create 1 rle with old method : 0.003365755081176758 length of segment : 74 time for calcul the mask position with numpy : 0.0021855831146240234 nb_pixel_total : 124974 time to create 1 rle with old method : 0.13962936401367188 length of segment : 554 time for calcul the mask position with numpy : 0.014250993728637695 nb_pixel_total : 1090323 time to create 1 rle with new method : 0.20112395286560059 length of segment : 1150 time for calcul the mask position with numpy : 0.0001404285430908203 nb_pixel_total : 1304 time to create 1 rle with old method : 0.001588582992553711 length of segment : 47 time for calcul the mask position with numpy : 0.013719797134399414 nb_pixel_total : 675304 time to create 1 rle with new method : 0.07070469856262207 length of segment : 1619 time for calcul the mask position with numpy : 0.0014522075653076172 nb_pixel_total : 86407 time to create 1 rle with old method : 0.0987389087677002 length of segment : 516 time for calcul the mask position with numpy : 0.0004260540008544922 nb_pixel_total : 16196 time to create 1 rle with old method : 0.018548965454101562 length of segment : 136 time for calcul the mask position with numpy : 0.0026276111602783203 nb_pixel_total : 118977 time to create 1 rle with old method : 0.13718962669372559 length of segment : 562 time for calcul the mask position with numpy : 0.00035262107849121094 nb_pixel_total : 8243 time to create 1 rle with old method : 0.009480714797973633 length of segment : 152 time for calcul the mask position with numpy : 0.0002601146697998047 nb_pixel_total : 8419 time to create 1 rle with old method : 0.009819507598876953 length of segment : 168 time for calcul the mask position with numpy : 0.0004978179931640625 nb_pixel_total : 12320 time to create 1 rle with old method : 0.014069318771362305 length of segment : 146 time for calcul the mask position with numpy : 0.0006422996520996094 nb_pixel_total : 26378 time to create 1 rle with old method : 0.030225038528442383 length of segment : 224 time for calcul the mask position with numpy : 0.010829448699951172 nb_pixel_total : 569454 time to create 1 rle with new method : 0.017660140991210938 length of segment : 1076 time for calcul the mask position with numpy : 0.00032711029052734375 nb_pixel_total : 9302 time to create 1 rle with old method : 0.010848283767700195 length of segment : 172 time for calcul the mask position with numpy : 0.00040602684020996094 nb_pixel_total : 17811 time to create 1 rle with old method : 0.022330760955810547 length of segment : 124 time for calcul the mask position with numpy : 0.002172231674194336 nb_pixel_total : 108845 time to create 1 rle with old method : 0.12457132339477539 length of segment : 553 time for calcul the mask position with numpy : 0.0004334449768066406 nb_pixel_total : 12307 time to create 1 rle with old method : 0.02014017105102539 length of segment : 145 time spent for convertir_results : 5.457348585128784 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 52 chid ids of type : 3594 Number RLEs to save : 18287 save missing photos in datou_result : time spend for datou_step_exec : 32.943588733673096 time spend to save output : 1.0931756496429443 total time spend for step 1 : 34.03676438331604 step2:crop_condition Wed Aug 27 19:01:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 19 ! batch 1 Loaded 52 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756314065_1016553 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.312714099884033 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756314071_1016553 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.0747087001800537 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756314073_1016553 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.693861722946167 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 3736932 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756314098_1016553 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 28 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.20150899887085 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756314106_1016553 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2257437705993652 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1378771927, 1378771918, 1378771915, 1378771914, 1378771836, 1378771835, 1378771833, 1378771831, 1378771828, 1378771826, 1378771761, 1378771760, 1378771750, 1378771665, 1378771663, 1378771660, 1378771657, 1378771656, 1378771654] Looping around the photos to save general results len do output : 52 /1379717520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379717824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771927', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771918', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771915', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771914', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771836', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771835', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771833', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771831', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771828', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771826', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771761', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771760', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771750', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771665', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771663', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771660', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771657', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771656', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771654', None, None, None, None, None, '3615124') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 175 time used for this insertion : 0.02471137046813965 save_final save missing photos in datou_result : time spend for datou_step_exec : 43.083924293518066 time spend to save output : 0.027637958526611328 total time spend for step 2 : 43.11156225204468 step3:rle_unique_nms_with_priority Wed Aug 27 19:01:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 52 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.5055835247039795 time for calcul the mask position with numpy : 0.16076087951660156 nb_pixel_total : 1351404 time to create 1 rle with new method : 0.09498739242553711 time for calcul the mask position with numpy : 0.011691808700561523 nb_pixel_total : 706095 time to create 1 rle with new method : 0.14219403266906738 time for calcul the mask position with numpy : 0.006460428237915039 nb_pixel_total : 3444 time to create 1 rle with old method : 0.003963470458984375 time for calcul the mask position with numpy : 0.006606101989746094 nb_pixel_total : 12657 time to create 1 rle with old method : 0.014340400695800781 create new chi : 0.45833587646484375 time to delete rle : 0.02199411392211914 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3501 TO DO : save crop sub photo not yet done ! save time : 0.26340365409851074 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.40372562408447266 time for calcul the mask position with numpy : 0.04679226875305176 nb_pixel_total : 1414295 time to create 1 rle with new method : 0.22697019577026367 time for calcul the mask position with numpy : 0.007635354995727539 nb_pixel_total : 8191 time to create 1 rle with old method : 0.014620065689086914 time for calcul the mask position with numpy : 0.006360292434692383 nb_pixel_total : 4145 time to create 1 rle with old method : 0.004671812057495117 time for calcul the mask position with numpy : 0.007006645202636719 nb_pixel_total : 50502 time to create 1 rle with old method : 0.05971503257751465 time for calcul the mask position with numpy : 0.006603240966796875 nb_pixel_total : 18108 time to create 1 rle with old method : 0.02050185203552246 time for calcul the mask position with numpy : 0.010447978973388672 nb_pixel_total : 559759 time to create 1 rle with new method : 0.07817506790161133 time for calcul the mask position with numpy : 0.006547689437866211 nb_pixel_total : 18600 time to create 1 rle with old method : 0.02070450782775879 create new chi : 0.5308098793029785 time to delete rle : 0.0007641315460205078 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 5175 TO DO : save crop sub photo not yet done ! save time : 0.34891200065612793 No data in photo_id : 1378771915 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.08506631851196289 time for calcul the mask position with numpy : 0.03122878074645996 nb_pixel_total : 2032694 time to create 1 rle with new method : 0.041878461837768555 time for calcul the mask position with numpy : 0.006623744964599609 nb_pixel_total : 5509 time to create 1 rle with old method : 0.006169795989990234 time for calcul the mask position with numpy : 0.006505250930786133 nb_pixel_total : 35397 time to create 1 rle with old method : 0.03928518295288086 create new chi : 0.139174222946167 time to delete rle : 0.0002601146697998047 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1624 TO DO : save crop sub photo not yet done ! save time : 0.14221715927124023 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 0.24576616287231445 time for calcul the mask position with numpy : 0.17107725143432617 nb_pixel_total : 1894379 time to create 1 rle with new method : 0.1141214370727539 time for calcul the mask position with numpy : 0.01175069808959961 nb_pixel_total : 101092 time to create 1 rle with old method : 0.11966991424560547 time for calcul the mask position with numpy : 0.0069506168365478516 nb_pixel_total : 2292 time to create 1 rle with old method : 0.0027551651000976562 time for calcul the mask position with numpy : 0.006845951080322266 nb_pixel_total : 14699 time to create 1 rle with old method : 0.016928434371948242 time for calcul the mask position with numpy : 0.011368036270141602 nb_pixel_total : 41620 time to create 1 rle with old method : 0.05106472969055176 time for calcul the mask position with numpy : 0.007741689682006836 nb_pixel_total : 5976 time to create 1 rle with old method : 0.006968259811401367 time for calcul the mask position with numpy : 0.011385202407836914 nb_pixel_total : 5834 time to create 1 rle with old method : 0.006865262985229492 time for calcul the mask position with numpy : 0.00776362419128418 nb_pixel_total : 7708 time to create 1 rle with old method : 0.008472204208374023 create new chi : 0.5749812126159668 time to delete rle : 0.0007050037384033203 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 3638 TO DO : save crop sub photo not yet done ! save time : 0.2908189296722412 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.06459212303161621 time for calcul the mask position with numpy : 0.021428585052490234 nb_pixel_total : 1901732 time to create 1 rle with new method : 0.0494997501373291 time for calcul the mask position with numpy : 0.00617671012878418 nb_pixel_total : 6269 time to create 1 rle with old method : 0.007077932357788086 time for calcul the mask position with numpy : 0.00640559196472168 nb_pixel_total : 44917 time to create 1 rle with old method : 0.04935884475708008 time for calcul the mask position with numpy : 0.006827116012573242 nb_pixel_total : 120682 time to create 1 rle with old method : 0.1284313201904297 create new chi : 0.27576756477355957 time to delete rle : 0.0003573894500732422 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2908 TO DO : save crop sub photo not yet done ! save time : 0.22556018829345703 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.05310702323913574 time for calcul the mask position with numpy : 0.018452882766723633 nb_pixel_total : 1902283 time to create 1 rle with new method : 0.031169414520263672 time for calcul the mask position with numpy : 0.006692647933959961 nb_pixel_total : 122024 time to create 1 rle with old method : 0.13226604461669922 time for calcul the mask position with numpy : 0.0059926509857177734 nb_pixel_total : 33674 time to create 1 rle with old method : 0.0354158878326416 time for calcul the mask position with numpy : 0.005991458892822266 nb_pixel_total : 15619 time to create 1 rle with old method : 0.016176223754882812 create new chi : 0.2597219944000244 time to delete rle : 0.00049591064453125 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2864 TO DO : save crop sub photo not yet done ! save time : 0.21201634407043457 No data in photo_id : 1378771831 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05760502815246582 time for calcul the mask position with numpy : 0.021770477294921875 nb_pixel_total : 1808267 time to create 1 rle with new method : 0.10323667526245117 time for calcul the mask position with numpy : 0.012592315673828125 nb_pixel_total : 157217 time to create 1 rle with new method : 0.07899975776672363 time for calcul the mask position with numpy : 0.010208845138549805 nb_pixel_total : 38047 time to create 1 rle with old method : 0.04226994514465332 time for calcul the mask position with numpy : 0.006557941436767578 nb_pixel_total : 70069 time to create 1 rle with old method : 0.08082127571105957 create new chi : 0.36801743507385254 time to delete rle : 0.0004930496215820312 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 3001 TO DO : save crop sub photo not yet done ! save time : 0.2401578426361084 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.2284259796142578 time for calcul the mask position with numpy : 0.0952458381652832 nb_pixel_total : 1319524 time to create 1 rle with new method : 0.07651734352111816 time for calcul the mask position with numpy : 0.005957126617431641 nb_pixel_total : 4107 time to create 1 rle with old method : 0.004614830017089844 time for calcul the mask position with numpy : 0.011435985565185547 nb_pixel_total : 642653 time to create 1 rle with new method : 0.1380770206451416 time for calcul the mask position with numpy : 0.006712913513183594 nb_pixel_total : 107316 time to create 1 rle with old method : 0.12312769889831543 create new chi : 0.4715142250061035 time to delete rle : 0.0012726783752441406 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4208 TO DO : save crop sub photo not yet done ! save time : 0.2919611930847168 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.07050323486328125 time for calcul the mask position with numpy : 0.026676177978515625 nb_pixel_total : 1931169 time to create 1 rle with new method : 0.07558083534240723 time for calcul the mask position with numpy : 0.006651163101196289 nb_pixel_total : 123213 time to create 1 rle with old method : 0.14346718788146973 time for calcul the mask position with numpy : 0.006917476654052734 nb_pixel_total : 9664 time to create 1 rle with old method : 0.010491132736206055 time for calcul the mask position with numpy : 0.0059282779693603516 nb_pixel_total : 9554 time to create 1 rle with old method : 0.010560035705566406 create new chi : 0.29690122604370117 time to delete rle : 0.0003414154052734375 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 2790 TO DO : save crop sub photo not yet done ! save time : 0.18865418434143066 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.05466294288635254 time for calcul the mask position with numpy : 0.12373661994934082 nb_pixel_total : 1959717 time to create 1 rle with new method : 0.08045101165771484 time for calcul the mask position with numpy : 0.006918907165527344 nb_pixel_total : 2782 time to create 1 rle with old method : 0.0034227371215820312 time for calcul the mask position with numpy : 0.006117582321166992 nb_pixel_total : 8653 time to create 1 rle with old method : 0.010050535202026367 time for calcul the mask position with numpy : 0.006738185882568359 nb_pixel_total : 102448 time to create 1 rle with old method : 0.1127631664276123 create new chi : 0.36386823654174805 time to delete rle : 0.0003750324249267578 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 2516 TO DO : save crop sub photo not yet done ! save time : 0.18042492866516113 No data in photo_id : 1378771750 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03243088722229004 time for calcul the mask position with numpy : 0.018283605575561523 nb_pixel_total : 1948626 time to create 1 rle with new method : 0.10606503486633301 time for calcul the mask position with numpy : 0.006886959075927734 nb_pixel_total : 124974 time to create 1 rle with old method : 0.14208054542541504 create new chi : 0.2822859287261963 time to delete rle : 0.0003509521484375 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2188 TO DO : save crop sub photo not yet done ! save time : 0.15681958198547363 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.08029341697692871 time for calcul the mask position with numpy : 0.029462575912475586 nb_pixel_total : 983277 time to create 1 rle with new method : 0.13217902183532715 time for calcul the mask position with numpy : 0.03230428695678711 nb_pixel_total : 1090323 time to create 1 rle with new method : 0.11817216873168945 create new chi : 0.32860898971557617 time to delete rle : 0.00042629241943359375 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 3380 TO DO : save crop sub photo not yet done ! save time : 0.22714781761169434 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.19143152236938477 time for calcul the mask position with numpy : 0.04017043113708496 nb_pixel_total : 1311577 time to create 1 rle with new method : 0.15516281127929688 time for calcul the mask position with numpy : 0.0069048404693603516 nb_pixel_total : 85415 time to create 1 rle with old method : 0.09234333038330078 time for calcul the mask position with numpy : 0.013249635696411133 nb_pixel_total : 675304 time to create 1 rle with new method : 0.08486723899841309 time for calcul the mask position with numpy : 0.005988597869873047 nb_pixel_total : 1304 time to create 1 rle with old method : 0.0014140605926513672 create new chi : 0.4105691909790039 time to delete rle : 0.0009224414825439453 batch 1 Loaded 7 chid ids of type : 3594 +++++++++Number RLEs to save : 5401 TO DO : save crop sub photo not yet done ! save time : 0.3450312614440918 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.19178199768066406 time for calcul the mask position with numpy : 0.07946944236755371 nb_pixel_total : 1921765 time to create 1 rle with new method : 0.15787005424499512 time for calcul the mask position with numpy : 0.006181478500366211 nb_pixel_total : 8419 time to create 1 rle with old method : 0.009477615356445312 time for calcul the mask position with numpy : 0.006396293640136719 nb_pixel_total : 8243 time to create 1 rle with old method : 0.010074377059936523 time for calcul the mask position with numpy : 0.007729291915893555 nb_pixel_total : 118977 time to create 1 rle with old method : 0.12947869300842285 time for calcul the mask position with numpy : 0.006584882736206055 nb_pixel_total : 16196 time to create 1 rle with old method : 0.01834845542907715 create new chi : 0.44225096702575684 time to delete rle : 0.0004875659942626953 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3116 TO DO : save crop sub photo not yet done ! save time : 0.22045660018920898 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.10445523262023926 time for calcul the mask position with numpy : 0.108001708984375 nb_pixel_total : 1438761 time to create 1 rle with new method : 0.07557272911071777 time for calcul the mask position with numpy : 0.006060123443603516 nb_pixel_total : 17811 time to create 1 rle with old method : 0.01904439926147461 time for calcul the mask position with numpy : 0.005827188491821289 nb_pixel_total : 8876 time to create 1 rle with old method : 0.009927988052368164 time for calcul the mask position with numpy : 0.010158538818359375 nb_pixel_total : 569454 time to create 1 rle with new method : 0.12018036842346191 time for calcul the mask position with numpy : 0.006072044372558594 nb_pixel_total : 26378 time to create 1 rle with old method : 0.02882242202758789 time for calcul the mask position with numpy : 0.0062406063079833984 nb_pixel_total : 12320 time to create 1 rle with old method : 0.013693809509277344 create new chi : 0.4197225570678711 time to delete rle : 0.0007379055023193359 batch 1 Loaded 11 chid ids of type : 3594 +++++++++Number RLEs to save : 4502 TO DO : save crop sub photo not yet done ! save time : 0.2888760566711426 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04673600196838379 time for calcul the mask position with numpy : 0.018525123596191406 nb_pixel_total : 1952448 time to create 1 rle with new method : 0.14950346946716309 time for calcul the mask position with numpy : 0.006490468978881836 nb_pixel_total : 12307 time to create 1 rle with old method : 0.013686418533325195 time for calcul the mask position with numpy : 0.007600545883178711 nb_pixel_total : 108845 time to create 1 rle with old method : 0.1202855110168457 create new chi : 0.32332468032836914 time to delete rle : 0.0007402896881103516 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2476 TO DO : save crop sub photo not yet done ! save time : 0.172837495803833 map_output_result : {1378771927: (0.0, 'Should be the crop_list due to order', 0), 1378771918: (0.0, 'Should be the crop_list due to order', 0), 1378771915: (0.0, 'Should be the crop_list due to order', 0.0), 1378771914: (0.0, 'Should be the crop_list due to order', 0), 1378771836: (0.0, 'Should be the crop_list due to order', 0), 1378771835: (0.0, 'Should be the crop_list due to order', 0), 1378771833: (0.0, 'Should be the crop_list due to order', 0), 1378771831: (0.0, 'Should be the crop_list due to order', 0.0), 1378771828: (0.0, 'Should be the crop_list due to order', 0), 1378771826: (0.0, 'Should be the crop_list due to order', 0), 1378771761: (0.0, 'Should be the crop_list due to order', 0), 1378771760: (0.0, 'Should be the crop_list due to order', 0), 1378771750: (0.0, 'Should be the crop_list due to order', 0.0), 1378771665: (0.0, 'Should be the crop_list due to order', 0), 1378771663: (0.0, 'Should be the crop_list due to order', 0), 1378771660: (0.0, 'Should be the crop_list due to order', 0), 1378771657: (0.0, 'Should be the crop_list due to order', 0), 1378771656: (0.0, 'Should be the crop_list due to order', 0), 1378771654: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1378771927, 1378771918, 1378771915, 1378771914, 1378771836, 1378771835, 1378771833, 1378771831, 1378771828, 1378771826, 1378771761, 1378771760, 1378771750, 1378771665, 1378771663, 1378771660, 1378771657, 1378771656, 1378771654] Looping around the photos to save general results len do output : 19 /1378771927.Didn't retrieve data . /1378771918.Didn't retrieve data . /1378771915.Didn't retrieve data . /1378771914.Didn't retrieve data . /1378771836.Didn't retrieve data . /1378771835.Didn't retrieve data . /1378771833.Didn't retrieve data . /1378771831.Didn't retrieve data . /1378771828.Didn't retrieve data . /1378771826.Didn't retrieve data . /1378771761.Didn't retrieve data . /1378771760.Didn't retrieve data . /1378771750.Didn't retrieve data . /1378771665.Didn't retrieve data . /1378771663.Didn't retrieve data . /1378771660.Didn't retrieve data . /1378771657.Didn't retrieve data . /1378771656.Didn't retrieve data . /1378771654.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771927', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771918', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771915', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771914', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771836', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771835', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771833', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771831', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771828', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771826', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771761', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771760', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771750', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771665', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771663', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771660', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771657', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771656', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771654', None, None, None, None, None, '3615124') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 57 time used for this insertion : 0.015551328659057617 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.751827478408813 time spend to save output : 0.01666116714477539 total time spend for step 3 : 12.768488645553589 step4:ventilate_hashtags_in_portfolio Wed Aug 27 19:02:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26269189 get user id for portfolio 26269189 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26269189 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','papier','pet_clair','mal_croppe','carton','autre','flou','environnement','pet_fonce','background','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26269189 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','papier','pet_clair','mal_croppe','carton','autre','flou','environnement','pet_fonce','background','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26269189 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','papier','pet_clair','mal_croppe','carton','autre','flou','environnement','pet_fonce','background','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/26270659,26270660,26270661,26270662,26270663,26270664,26270665,26270666,26270667,26270668,26270669?tags=pehd,papier,pet_clair,mal_croppe,carton,autre,flou,environnement,pet_fonce,background,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1378771927, 1378771918, 1378771915, 1378771914, 1378771836, 1378771835, 1378771833, 1378771831, 1378771828, 1378771826, 1378771761, 1378771760, 1378771750, 1378771665, 1378771663, 1378771660, 1378771657, 1378771656, 1378771654] Looping around the photos to save general results len do output : 1 /26269189. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771927', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771918', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771915', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771914', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771836', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771835', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771833', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771831', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771828', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771826', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771761', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771760', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771750', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771665', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771663', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771660', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771657', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771656', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771654', None, None, None, None, None, '3615124') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.014866828918457031 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.606886625289917 time spend to save output : 0.01523447036743164 total time spend for step 4 : 1.6221210956573486 step5:final Wed Aug 27 19:02:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1378771927: ('0.15497284153671215',), 1378771918: ('0.15497284153671215',), 1378771915: ('0.15497284153671215',), 1378771914: ('0.15497284153671215',), 1378771836: ('0.15497284153671215',), 1378771835: ('0.15497284153671215',), 1378771833: ('0.15497284153671215',), 1378771831: ('0.15497284153671215',), 1378771828: ('0.15497284153671215',), 1378771826: ('0.15497284153671215',), 1378771761: ('0.15497284153671215',), 1378771760: ('0.15497284153671215',), 1378771750: ('0.15497284153671215',), 1378771665: ('0.15497284153671215',), 1378771663: ('0.15497284153671215',), 1378771660: ('0.15497284153671215',), 1378771657: ('0.15497284153671215',), 1378771656: ('0.15497284153671215',), 1378771654: ('0.15497284153671215',)} new output for save of step final : {1378771927: ('0.15497284153671215',), 1378771918: ('0.15497284153671215',), 1378771915: ('0.15497284153671215',), 1378771914: ('0.15497284153671215',), 1378771836: ('0.15497284153671215',), 1378771835: ('0.15497284153671215',), 1378771833: ('0.15497284153671215',), 1378771831: ('0.15497284153671215',), 1378771828: ('0.15497284153671215',), 1378771826: ('0.15497284153671215',), 1378771761: ('0.15497284153671215',), 1378771760: ('0.15497284153671215',), 1378771750: ('0.15497284153671215',), 1378771665: ('0.15497284153671215',), 1378771663: ('0.15497284153671215',), 1378771660: ('0.15497284153671215',), 1378771657: ('0.15497284153671215',), 1378771656: ('0.15497284153671215',), 1378771654: ('0.15497284153671215',)} [1378771927, 1378771918, 1378771915, 1378771914, 1378771836, 1378771835, 1378771833, 1378771831, 1378771828, 1378771826, 1378771761, 1378771760, 1378771750, 1378771665, 1378771663, 1378771660, 1378771657, 1378771656, 1378771654] Looping around the photos to save general results len do output : 19 /1378771927.Didn't retrieve data . /1378771918.Didn't retrieve data . /1378771915.Didn't retrieve data . /1378771914.Didn't retrieve data . /1378771836.Didn't retrieve data . /1378771835.Didn't retrieve data . /1378771833.Didn't retrieve data . /1378771831.Didn't retrieve data . /1378771828.Didn't retrieve data . /1378771826.Didn't retrieve data . /1378771761.Didn't retrieve data . /1378771760.Didn't retrieve data . /1378771750.Didn't retrieve data . /1378771665.Didn't retrieve data . /1378771663.Didn't retrieve data . /1378771660.Didn't retrieve data . /1378771657.Didn't retrieve data . /1378771656.Didn't retrieve data . /1378771654.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771927', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771918', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771915', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771914', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771836', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771835', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771833', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771831', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771828', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771826', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771761', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771760', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771750', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771665', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771663', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771660', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771657', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771656', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771654', None, None, None, None, None, '3615124') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 57 time used for this insertion : 0.013816118240356445 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11367464065551758 time spend to save output : 0.014719963073730469 total time spend for step 5 : 0.12839460372924805 step6:blur_detection Wed Aug 27 19:02:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1756314027_1016553_1378771927_5a8f9a23c8265207fd3e252c4098253d.jpg resize: (1080, 1920) 1378771927 -1.5645172505583285 treat image : temp/1756314027_1016553_1378771918_834f93710b9c05c567f78d7df3258899.jpg resize: (1080, 1920) 1378771918 -0.4108735251632148 treat image : temp/1756314027_1016553_1378771915_c7419111de4a6a36fbfa937f740e3a89.jpg resize: (1080, 1920) 1378771915 0.23391787057032842 treat image : temp/1756314027_1016553_1378771914_0e3841219dedb6294a51b7899020fb22.jpg resize: (1080, 1920) 1378771914 0.8522906397399351 treat image : temp/1756314027_1016553_1378771836_3d7f40ec5661299464d4684224bee591.jpg resize: (1080, 1920) 1378771836 -3.7189675911983238 treat image : temp/1756314027_1016553_1378771835_1e0d577c6c63906b909e5906936334ae.jpg resize: (1080, 1920) 1378771835 0.7454102943214399 treat image : temp/1756314027_1016553_1378771833_50293138627b3aec44a7741ce39d4cd6.jpg resize: (1080, 1920) 1378771833 -3.851419801210424 treat image : temp/1756314027_1016553_1378771831_4d6b945ef1a78707a815ef3e83c26442.jpg resize: (1080, 1920) 1378771831 -0.4865364964229855 treat image : temp/1756314027_1016553_1378771828_c00d4098f2ecb412eba96d2529902b27.jpg resize: (1080, 1920) 1378771828 0.27375893212523855 treat image : temp/1756314027_1016553_1378771826_db4d6e2b7012ae9b0872c41cfc749cd0.jpg resize: (1080, 1920) 1378771826 -4.07976691497853 treat image : temp/1756314027_1016553_1378771761_19ae45ca0e66df8cd3c868ba3b502e82.jpg resize: (1080, 1920) 1378771761 -4.120038847856479 treat image : temp/1756314027_1016553_1378771760_b1695adf0a79e10f4e2e3d84e485dfed.jpg resize: (1080, 1920) 1378771760 -4.988472596433235 treat image : temp/1756314027_1016553_1378771750_eae25848f69c1e494de3d014357dbd98.jpg resize: (1080, 1920) 1378771750 -0.4483451461886622 treat image : temp/1756314027_1016553_1378771665_92f7a145fe8266fcde8bbca3671dc669.jpg resize: (1080, 1920) 1378771665 -3.750492863708003 treat image : temp/1756314027_1016553_1378771663_c49f3e8bb78b7459316806ff4a6d51c5.jpg resize: (1080, 1920) 1378771663 -0.5315223806777855 treat image : temp/1756314027_1016553_1378771660_9ae77fe73a5a05dcebaafd526f469765.jpg resize: (1080, 1920) 1378771660 1.0216050717291465 treat image : temp/1756314027_1016553_1378771657_85b976e9dd28efec2033cf915d9f54fc.jpg resize: (1080, 1920) 1378771657 -1.6640504731047085 treat image : temp/1756314027_1016553_1378771656_c5394a3e5d3f92fbee4c1615abed9552.jpg resize: (1080, 1920) 1378771656 -0.27985333679096214 treat image : temp/1756314027_1016553_1378771654_529e3b9f108c8b60503b3c208ff150d0.jpg resize: (1080, 1920) 1378771654 0.6298089364935765 treat image : temp/1756314027_1016553_1378771927_5a8f9a23c8265207fd3e252c4098253d_rle_crop_3932912257_0.png resize: (188, 121) 1379717520 -0.47006701113687144 treat image : temp/1756314027_1016553_1378771927_5a8f9a23c8265207fd3e252c4098253d_rle_crop_3932912258_0.png resize: (135, 32) 1379717522 0.5549315408092544 treat image : temp/1756314027_1016553_1378771918_834f93710b9c05c567f78d7df3258899_rle_crop_3932912264_0.png resize: (83, 78) 1379717523 -2.0758768305790065 treat image : temp/1756314027_1016553_1378771918_834f93710b9c05c567f78d7df3258899_rle_crop_3932912265_0.png resize: (165, 111) 1379717524 -1.7761217284503228 treat image : temp/1756314027_1016553_1378771836_3d7f40ec5661299464d4684224bee591_rle_crop_3932912269_0.png resize: (86, 110) 1379717526 -2.135705860423926 treat image : temp/1756314027_1016553_1378771836_3d7f40ec5661299464d4684224bee591_rle_crop_3932912270_0.png resize: (102, 156) 1379717527 -1.6588812552533603 treat image : temp/1756314027_1016553_1378771836_3d7f40ec5661299464d4684224bee591_rle_crop_3932912273_0.png resize: (50, 58) 1379717528 -4.886104623609637 treat image : temp/1756314027_1016553_1378771826_db4d6e2b7012ae9b0872c41cfc749cd0_rle_crop_3932912286_0.png resize: (120, 70) 1379717529 -1.6334012542576224 treat image : temp/1756314027_1016553_1378771761_19ae45ca0e66df8cd3c868ba3b502e82_rle_crop_3932912288_0.png resize: (125, 118) 1379717531 -1.9868217345001982 treat image : temp/1756314027_1016553_1378771660_9ae77fe73a5a05dcebaafd526f469765_rle_crop_3932912295_0.png resize: (47, 57) 1379717532 -3.9861497455712365 treat image : temp/1756314027_1016553_1378771657_85b976e9dd28efec2033cf915d9f54fc_rle_crop_3932912300_0.png resize: (152, 106) 1379717533 -2.2489900478178924 treat image : temp/1756314027_1016553_1378771657_85b976e9dd28efec2033cf915d9f54fc_rle_crop_3932912301_0.png resize: (167, 104) 1379717535 -1.8017464423214 treat image : temp/1756314027_1016553_1378771656_c5394a3e5d3f92fbee4c1615abed9552_rle_crop_3932912303_0.png resize: (203, 187) 1379717536 -1.4861150240512084 treat image : temp/1756314027_1016553_1378771656_c5394a3e5d3f92fbee4c1615abed9552_rle_crop_3932912305_0.png resize: (171, 107) 1379717537 -1.0203317941706793 treat image : temp/1756314027_1016553_1378771914_0e3841219dedb6294a51b7899020fb22_rle_crop_3932912267_0.png resize: (108, 96) 1379717556 -1.0857668053911835 treat image : temp/1756314027_1016553_1378771836_3d7f40ec5661299464d4684224bee591_rle_crop_3932912271_0.png resize: (207, 348) 1379717558 -2.238809339642557 treat image : temp/1756314027_1016553_1378771836_3d7f40ec5661299464d4684224bee591_rle_crop_3932912274_0.png resize: (540, 334) 1379717559 -0.5388680744361755 treat image : temp/1756314027_1016553_1378771761_19ae45ca0e66df8cd3c868ba3b502e82_rle_crop_3932912287_0.png resize: (126, 140) 1379717560 -2.9967664089445103 treat image : temp/1756314027_1016553_1378771760_b1695adf0a79e10f4e2e3d84e485dfed_rle_crop_3932912291_0.png resize: (120, 124) 1379717563 -3.3877686402309637 treat image : temp/1756314027_1016553_1378771656_c5394a3e5d3f92fbee4c1615abed9552_rle_crop_3932912302_0.png resize: (145, 192) 1379717565 -1.6007081103096799 treat image : temp/1756314027_1016553_1378771760_b1695adf0a79e10f4e2e3d84e485dfed_rle_crop_3932912292_0.png resize: (63, 79) 1379717575 -3.3382052319456608 treat image : temp/1756314027_1016553_1378771927_5a8f9a23c8265207fd3e252c4098253d_rle_crop_3932912259_0.png resize: (961, 1010) 1379717772 0.1889240401623739 treat image : temp/1756314027_1016553_1378771918_834f93710b9c05c567f78d7df3258899_rle_crop_3932912260_0.png resize: (160, 167) 1379717773 -0.7666838894930191 treat image : temp/1756314027_1016553_1378771918_834f93710b9c05c567f78d7df3258899_rle_crop_3932912261_0.png resize: (978, 903) 1379717775 0.8139506479790931 treat image : temp/1756314027_1016553_1378771918_834f93710b9c05c567f78d7df3258899_rle_crop_3932912262_0.png resize: (160, 134) 1379717776 -0.833577759571439 treat image : temp/1756314027_1016553_1378771918_834f93710b9c05c567f78d7df3258899_rle_crop_3932912263_0.png resize: (415, 232) 1379717777 -0.7465719614422776 treat image : temp/1756314027_1016553_1378771914_0e3841219dedb6294a51b7899020fb22_rle_crop_3932912266_0.png resize: (161, 289) 1379717778 -1.4109104210086914 treat image : temp/1756314027_1016553_1378771836_3d7f40ec5661299464d4684224bee591_rle_crop_3932912268_0.png resize: (70, 144) 1379717780 -4.49942874269407 treat image : temp/1756314027_1016553_1378771836_3d7f40ec5661299464d4684224bee591_rle_crop_3932912272_0.png resize: (138, 135) 1379717781 -3.65533487812038 treat image : temp/1756314027_1016553_1378771835_1e0d577c6c63906b909e5906936334ae_rle_crop_3932912275_0.png resize: (560, 371) 1379717782 0.16748249607944368 treat image : temp/1756314027_1016553_1378771835_1e0d577c6c63906b909e5906936334ae_rle_crop_3932912276_0.png resize: (254, 247) 1379717784 -0.7961433860176013 treat image : temp/1756314027_1016553_1378771833_50293138627b3aec44a7741ce39d4cd6_rle_crop_3932912278_0.png resize: (135, 154) 1379717785 -3.2347928899985257 treat image : temp/1756314027_1016553_1378771833_50293138627b3aec44a7741ce39d4cd6_rle_crop_3932912279_0.png resize: (174, 252) 1379717786 -3.421930398543339 treat image : temp/1756314027_1016553_1378771833_50293138627b3aec44a7741ce39d4cd6_rle_crop_3932912280_0.png resize: (572, 355) 1379717788 -0.41433384305970766 treat image : temp/1756314027_1016553_1378771828_c00d4098f2ecb412eba96d2529902b27_rle_crop_3932912282_0.png resize: (280, 249) 1379717790 -1.9386403760138309 treat image : temp/1756314027_1016553_1378771828_c00d4098f2ecb412eba96d2529902b27_rle_crop_3932912283_0.png resize: (322, 669) 1379717791 -0.4804275700691261 treat image : temp/1756314027_1016553_1378771826_db4d6e2b7012ae9b0872c41cfc749cd0_rle_crop_3932912284_0.png resize: (558, 330) 1379717793 0.22546773823941355 treat image : temp/1756314027_1016553_1378771826_db4d6e2b7012ae9b0872c41cfc749cd0_rle_crop_3932912285_0.png resize: (889, 998) 1379717794 0.5550042802775751 treat image : temp/1756314027_1016553_1378771761_19ae45ca0e66df8cd3c868ba3b502e82_rle_crop_3932912289_0.png resize: (561, 350) 1379717795 0.1663746587043623 treat image : temp/1756314027_1016553_1378771760_b1695adf0a79e10f4e2e3d84e485dfed_rle_crop_3932912290_0.png resize: (519, 326) 1379717797 -0.12664955052189064 treat image : temp/1756314027_1016553_1378771665_92f7a145fe8266fcde8bbca3671dc669_rle_crop_3932912293_0.png resize: (548, 372) 1379717798 -0.0499756448455929 treat image : temp/1756314027_1016553_1378771663_c49f3e8bb78b7459316806ff4a6d51c5_rle_crop_3932912294_0.png resize: (960, 1513) 1379717799 -1.248737103353707 treat image : temp/1756314027_1016553_1378771660_9ae77fe73a5a05dcebaafd526f469765_rle_crop_3932912296_0.png resize: (949, 1069) 1379717801 -1.1975869240217043 treat image : temp/1756314027_1016553_1378771660_9ae77fe73a5a05dcebaafd526f469765_rle_crop_3932912297_0.png resize: (509, 314) 1379717802 -0.5869355236747622 treat image : temp/1756314027_1016553_1378771657_85b976e9dd28efec2033cf915d9f54fc_rle_crop_3932912298_0.png resize: (135, 145) 1379717803 -3.1078936389961327 treat image : temp/1756314027_1016553_1378771657_85b976e9dd28efec2033cf915d9f54fc_rle_crop_3932912299_0.png resize: (561, 354) 1379717805 0.22691662177960095 treat image : temp/1756314027_1016553_1378771656_c5394a3e5d3f92fbee4c1615abed9552_rle_crop_3932912304_0.png resize: (957, 921) 1379717806 0.9597373339337116 treat image : temp/1756314027_1016553_1378771656_c5394a3e5d3f92fbee4c1615abed9552_rle_crop_3932912306_0.png resize: (137, 225) 1379717807 -0.5031621613069407 treat image : temp/1756314027_1016553_1378771654_529e3b9f108c8b60503b3c208ff150d0_rle_crop_3932912307_0.png resize: (532, 357) 1379717809 -0.49759675841750206 treat image : temp/1756314027_1016553_1378771835_1e0d577c6c63906b909e5906936334ae_rle_crop_3932912277_0.png resize: (79, 97) 1379717822 -0.37537753702842 treat image : temp/1756314027_1016553_1378771828_c00d4098f2ecb412eba96d2529902b27_rle_crop_3932912281_0.png resize: (427, 299) 1379717823 -0.5014238461926506 treat image : temp/1756314027_1016553_1378771654_529e3b9f108c8b60503b3c208ff150d0_rle_crop_3932912308_0.png resize: (145, 100) 1379717824 0.8368790506256055 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 71 time used for this insertion : 0.01637721061706543 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 71 time used for this insertion : 0.01651287078857422 save missing photos in datou_result : time spend for datou_step_exec : 18.687530517578125 time spend to save output : 0.037576913833618164 total time spend for step 6 : 18.725107431411743 step7:brightness Wed Aug 27 19:02:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756314027_1016553_1378771927_5a8f9a23c8265207fd3e252c4098253d.jpg treat image : temp/1756314027_1016553_1378771918_834f93710b9c05c567f78d7df3258899.jpg treat image : temp/1756314027_1016553_1378771915_c7419111de4a6a36fbfa937f740e3a89.jpg treat image : temp/1756314027_1016553_1378771914_0e3841219dedb6294a51b7899020fb22.jpg treat image : temp/1756314027_1016553_1378771836_3d7f40ec5661299464d4684224bee591.jpg treat image : temp/1756314027_1016553_1378771835_1e0d577c6c63906b909e5906936334ae.jpg treat image : temp/1756314027_1016553_1378771833_50293138627b3aec44a7741ce39d4cd6.jpg treat image : temp/1756314027_1016553_1378771831_4d6b945ef1a78707a815ef3e83c26442.jpg treat image : temp/1756314027_1016553_1378771828_c00d4098f2ecb412eba96d2529902b27.jpg treat image : temp/1756314027_1016553_1378771826_db4d6e2b7012ae9b0872c41cfc749cd0.jpg treat image : temp/1756314027_1016553_1378771761_19ae45ca0e66df8cd3c868ba3b502e82.jpg treat image : temp/1756314027_1016553_1378771760_b1695adf0a79e10f4e2e3d84e485dfed.jpg treat image : temp/1756314027_1016553_1378771750_eae25848f69c1e494de3d014357dbd98.jpg treat image : temp/1756314027_1016553_1378771665_92f7a145fe8266fcde8bbca3671dc669.jpg treat image : temp/1756314027_1016553_1378771663_c49f3e8bb78b7459316806ff4a6d51c5.jpg treat image : temp/1756314027_1016553_1378771660_9ae77fe73a5a05dcebaafd526f469765.jpg treat image : temp/1756314027_1016553_1378771657_85b976e9dd28efec2033cf915d9f54fc.jpg treat image : temp/1756314027_1016553_1378771656_c5394a3e5d3f92fbee4c1615abed9552.jpg treat image : temp/1756314027_1016553_1378771654_529e3b9f108c8b60503b3c208ff150d0.jpg treat image : temp/1756314027_1016553_1378771927_5a8f9a23c8265207fd3e252c4098253d_rle_crop_3932912257_0.png treat image : temp/1756314027_1016553_1378771927_5a8f9a23c8265207fd3e252c4098253d_rle_crop_3932912258_0.png treat image : temp/1756314027_1016553_1378771918_834f93710b9c05c567f78d7df3258899_rle_crop_3932912264_0.png treat image : temp/1756314027_1016553_1378771918_834f93710b9c05c567f78d7df3258899_rle_crop_3932912265_0.png treat image : temp/1756314027_1016553_1378771836_3d7f40ec5661299464d4684224bee591_rle_crop_3932912269_0.png treat image : temp/1756314027_1016553_1378771836_3d7f40ec5661299464d4684224bee591_rle_crop_3932912270_0.png treat image : temp/1756314027_1016553_1378771836_3d7f40ec5661299464d4684224bee591_rle_crop_3932912273_0.png treat image : temp/1756314027_1016553_1378771826_db4d6e2b7012ae9b0872c41cfc749cd0_rle_crop_3932912286_0.png treat image : temp/1756314027_1016553_1378771761_19ae45ca0e66df8cd3c868ba3b502e82_rle_crop_3932912288_0.png treat image : temp/1756314027_1016553_1378771660_9ae77fe73a5a05dcebaafd526f469765_rle_crop_3932912295_0.png treat image : temp/1756314027_1016553_1378771657_85b976e9dd28efec2033cf915d9f54fc_rle_crop_3932912300_0.png treat image : temp/1756314027_1016553_1378771657_85b976e9dd28efec2033cf915d9f54fc_rle_crop_3932912301_0.png treat image : temp/1756314027_1016553_1378771656_c5394a3e5d3f92fbee4c1615abed9552_rle_crop_3932912303_0.png treat image : temp/1756314027_1016553_1378771656_c5394a3e5d3f92fbee4c1615abed9552_rle_crop_3932912305_0.png treat image : temp/1756314027_1016553_1378771914_0e3841219dedb6294a51b7899020fb22_rle_crop_3932912267_0.png treat image : temp/1756314027_1016553_1378771836_3d7f40ec5661299464d4684224bee591_rle_crop_3932912271_0.png treat image : temp/1756314027_1016553_1378771836_3d7f40ec5661299464d4684224bee591_rle_crop_3932912274_0.png treat image : temp/1756314027_1016553_1378771761_19ae45ca0e66df8cd3c868ba3b502e82_rle_crop_3932912287_0.png treat image : temp/1756314027_1016553_1378771760_b1695adf0a79e10f4e2e3d84e485dfed_rle_crop_3932912291_0.png treat image : temp/1756314027_1016553_1378771656_c5394a3e5d3f92fbee4c1615abed9552_rle_crop_3932912302_0.png treat image : temp/1756314027_1016553_1378771760_b1695adf0a79e10f4e2e3d84e485dfed_rle_crop_3932912292_0.png treat image : temp/1756314027_1016553_1378771927_5a8f9a23c8265207fd3e252c4098253d_rle_crop_3932912259_0.png treat image : temp/1756314027_1016553_1378771918_834f93710b9c05c567f78d7df3258899_rle_crop_3932912260_0.png treat image : temp/1756314027_1016553_1378771918_834f93710b9c05c567f78d7df3258899_rle_crop_3932912261_0.png treat image : temp/1756314027_1016553_1378771918_834f93710b9c05c567f78d7df3258899_rle_crop_3932912262_0.png treat image : temp/1756314027_1016553_1378771918_834f93710b9c05c567f78d7df3258899_rle_crop_3932912263_0.png treat image : temp/1756314027_1016553_1378771914_0e3841219dedb6294a51b7899020fb22_rle_crop_3932912266_0.png treat image : temp/1756314027_1016553_1378771836_3d7f40ec5661299464d4684224bee591_rle_crop_3932912268_0.png treat image : temp/1756314027_1016553_1378771836_3d7f40ec5661299464d4684224bee591_rle_crop_3932912272_0.png treat image : temp/1756314027_1016553_1378771835_1e0d577c6c63906b909e5906936334ae_rle_crop_3932912275_0.png treat image : temp/1756314027_1016553_1378771835_1e0d577c6c63906b909e5906936334ae_rle_crop_3932912276_0.png treat image : temp/1756314027_1016553_1378771833_50293138627b3aec44a7741ce39d4cd6_rle_crop_3932912278_0.png treat image : temp/1756314027_1016553_1378771833_50293138627b3aec44a7741ce39d4cd6_rle_crop_3932912279_0.png treat image : temp/1756314027_1016553_1378771833_50293138627b3aec44a7741ce39d4cd6_rle_crop_3932912280_0.png treat image : temp/1756314027_1016553_1378771828_c00d4098f2ecb412eba96d2529902b27_rle_crop_3932912282_0.png treat image : temp/1756314027_1016553_1378771828_c00d4098f2ecb412eba96d2529902b27_rle_crop_3932912283_0.png treat image : temp/1756314027_1016553_1378771826_db4d6e2b7012ae9b0872c41cfc749cd0_rle_crop_3932912284_0.png treat image : temp/1756314027_1016553_1378771826_db4d6e2b7012ae9b0872c41cfc749cd0_rle_crop_3932912285_0.png treat image : temp/1756314027_1016553_1378771761_19ae45ca0e66df8cd3c868ba3b502e82_rle_crop_3932912289_0.png treat image : temp/1756314027_1016553_1378771760_b1695adf0a79e10f4e2e3d84e485dfed_rle_crop_3932912290_0.png treat image : temp/1756314027_1016553_1378771665_92f7a145fe8266fcde8bbca3671dc669_rle_crop_3932912293_0.png treat image : temp/1756314027_1016553_1378771663_c49f3e8bb78b7459316806ff4a6d51c5_rle_crop_3932912294_0.png treat image : temp/1756314027_1016553_1378771660_9ae77fe73a5a05dcebaafd526f469765_rle_crop_3932912296_0.png treat image : temp/1756314027_1016553_1378771660_9ae77fe73a5a05dcebaafd526f469765_rle_crop_3932912297_0.png treat image : temp/1756314027_1016553_1378771657_85b976e9dd28efec2033cf915d9f54fc_rle_crop_3932912298_0.png treat image : temp/1756314027_1016553_1378771657_85b976e9dd28efec2033cf915d9f54fc_rle_crop_3932912299_0.png treat image : temp/1756314027_1016553_1378771656_c5394a3e5d3f92fbee4c1615abed9552_rle_crop_3932912304_0.png treat image : temp/1756314027_1016553_1378771656_c5394a3e5d3f92fbee4c1615abed9552_rle_crop_3932912306_0.png treat image : temp/1756314027_1016553_1378771654_529e3b9f108c8b60503b3c208ff150d0_rle_crop_3932912307_0.png treat image : temp/1756314027_1016553_1378771835_1e0d577c6c63906b909e5906936334ae_rle_crop_3932912277_0.png treat image : temp/1756314027_1016553_1378771828_c00d4098f2ecb412eba96d2529902b27_rle_crop_3932912281_0.png treat image : temp/1756314027_1016553_1378771654_529e3b9f108c8b60503b3c208ff150d0_rle_crop_3932912308_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 71 time used for this insertion : 0.013540506362915039 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 71 time used for this insertion : 0.015062093734741211 save missing photos in datou_result : time spend for datou_step_exec : 5.557870626449585 time spend to save output : 0.033080339431762695 total time spend for step 7 : 5.590950965881348 step8:velours_tree Wed Aug 27 19:02:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.13909387588500977 time spend to save output : 8.463859558105469e-05 total time spend for step 8 : 0.13917851448059082 step9:send_mail_cod Wed Aug 27 19:02:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26269189_27-08-2025_19_02_26.pdf 26270659 imagette262706591756314146 26270660 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262706601756314146 26270661 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262706611756314147 26270662 imagette262706621756314149 26270663 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262706631756314149 26270664 change filename to text .change filename to text .change filename to text .imagette262706641756314149 26270665 imagette262706651756314149 26270667 imagette262706671756314149 26270668 imagette262706681756314149 26270669 change filename to text .imagette262706691756314149 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26269189 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26270659,26270660,26270661,26270662,26270663,26270664,26270665,26270666,26270667,26270668,26270669?tags=pehd,papier,pet_clair,mal_croppe,carton,autre,flou,environnement,pet_fonce,background,metal args[1378771927] : ((1378771927, -1.5645172505583285, 492688767), (1378771927, 0.5497231500488684, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com args[1378771918] : ((1378771918, -0.4108735251632148, 492688767), (1378771918, 0.9131193104764724, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com args[1378771915] : ((1378771915, 0.23391787057032842, 492688767), (1378771915, 0.8744624722144806, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com args[1378771914] : ((1378771914, 0.8522906397399351, 492688767), (1378771914, 0.9252938190817309, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com args[1378771836] : ((1378771836, -3.7189675911983238, 492609224), (1378771836, 0.33213587462457006, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com args[1378771835] : ((1378771835, 0.7454102943214399, 492688767), (1378771835, 0.42983326211263434, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com args[1378771833] : ((1378771833, -3.851419801210424, 492609224), (1378771833, 0.37801840971677214, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com args[1378771831] : ((1378771831, -0.4865364964229855, 492688767), (1378771831, 0.7112350242671851, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com args[1378771828] : ((1378771828, 0.27375893212523855, 492688767), (1378771828, 0.6295747858659487, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com args[1378771826] : ((1378771826, -4.07976691497853, 492609224), (1378771826, 0.48508561458079746, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com args[1378771761] : ((1378771761, -4.120038847856479, 492609224), (1378771761, 0.627079977781639, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com args[1378771760] : ((1378771760, -4.988472596433235, 492609224), (1378771760, 0.31806635022225144, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com args[1378771750] : ((1378771750, -0.4483451461886622, 492688767), (1378771750, 1.2913660386697727, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com args[1378771665] : ((1378771665, -3.750492863708003, 492609224), (1378771665, 0.47805982691426274, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com args[1378771663] : ((1378771663, -0.5315223806777855, 492688767), (1378771663, 0.6812094523131755, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com args[1378771660] : ((1378771660, 1.0216050717291465, 492688767), (1378771660, 0.6909390173519431, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com args[1378771657] : ((1378771657, -1.6640504731047085, 492688767), (1378771657, 0.3849277233471051, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com args[1378771656] : ((1378771656, -0.27985333679096214, 492688767), (1378771656, 0.803283520341349, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com args[1378771654] : ((1378771654, 0.6298089364935765, 492688767), (1378771654, 0.30563037959343897, 2107752395), '0.15497284153671215') We are sending mail with results at report@fotonower.com refus_total : 0.15497284153671215 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26269189 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26269189_27-08-2025_19_02_26.pdf results_Auto_P26269189_27-08-2025_19_02_26.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26269189_27-08-2025_19_02_26.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26269189','results_Auto_P26269189_27-08-2025_19_02_26.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26269189_27-08-2025_19_02_26.pdf','pdf','','0.7','0.15497284153671215') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26269189

https://www.fotonower.com/image?json=false&list_photos_id=1378771927
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378771918
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378771915
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378771914
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378771836
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378771835
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378771833
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378771831
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378771828
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378771826
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378771761
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378771760
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378771750
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378771665
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378771663
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378771660
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0216050717291465)
https://www.fotonower.com/image?json=false&list_photos_id=1378771657
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378771656
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378771654
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 15.50%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/26270660?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26270661?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26270663?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26270664?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26270669?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26269189_27-08-2025_19_02_26.pdf.

Lien vers velours :https://www.fotonower.com/velours/26270659,26270660,26270661,26270662,26270663,26270664,26270665,26270666,26270667,26270668,26270669?tags=pehd,papier,pet_clair,mal_croppe,carton,autre,flou,environnement,pet_fonce,background,metal.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 27 Aug 2025 17:02:32 GMT Content-Length: 0 Connection: close X-Message-Id: 9nRtsn_xRGuhcnvKOZVDDg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1378771927, 1378771918, 1378771915, 1378771914, 1378771836, 1378771835, 1378771833, 1378771831, 1378771828, 1378771826, 1378771761, 1378771760, 1378771750, 1378771665, 1378771663, 1378771660, 1378771657, 1378771656, 1378771654] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771927', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771918', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771915', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771914', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771836', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771835', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771833', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771831', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771828', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771826', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771761', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771760', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771750', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771665', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771663', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771660', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771657', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771656', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771654', None, None, None, None, None, '3615124') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 19 time used for this insertion : 0.014777898788452148 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.640061855316162 time spend to save output : 0.015039920806884766 total time spend for step 9 : 5.655101776123047 step10:split_time_score Wed Aug 27 19:02:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 19),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 21082025 26269189 Nombre de photos uploadées : 19 / 23040 (0%) 21082025 26269189 Nombre de photos taguées (types de déchets): 0 / 19 (0%) 21082025 26269189 Nombre de photos taguées (volume) : 0 / 19 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ??????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0008902549743652344 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2133181095123291 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.06594444444444442 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26113208_21-08-2025_08_21_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26113208 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26113208 AND mptpi.`type`=3594 To do Qualite : 0.14344428077066965 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26114421_21-08-2025_09_23_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26114421 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26114421 AND mptpi.`type`=3594 To do Qualite : 0.13331061385459533 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26114424_21-08-2025_09_11_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26114424 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26114424 AND mptpi.`type`=3594 To do Qualite : 0.06449963563100139 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26115111_21-08-2025_10_02_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26115111 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26115111 AND mptpi.`type`=3594 To do Qualite : 0.037599160420340956 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26115112_21-08-2025_10_12_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26115112 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26115112 AND mptpi.`type`=3594 To do Qualite : 0.05686577690972222 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26115114_21-08-2025_09_51_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26115114 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26115114 AND mptpi.`type`=3594 To do Qualite : 0.09280790004748335 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26116300_21-08-2025_10_41_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26116300 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26116300 AND mptpi.`type`=3594 To do Qualite : 0.19969962062757196 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26116302_21-08-2025_10_52_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26116302 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26116302 AND mptpi.`type`=3594 To do Qualite : 0.07821421682098766 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26118874_21-08-2025_21_11_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26118874 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26118874 AND mptpi.`type`=3594 To do Qualite : 0.17981294608410492 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26121460_21-08-2025_22_12_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26121460 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26121460 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26269186 order by id desc limit 1 Qualite : 0.15497284153671215 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26269189_27-08-2025_19_02_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26269189 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26269189 AND mptpi.`type`=3594 To do Qualite : 0.15442059483726148 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26269192_27-08-2025_18_52_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26269192 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26269192 AND mptpi.`type`=3594 To do Qualite : 0.05954073431069959 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26269194_27-08-2025_18_41_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26269194 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26269194 AND mptpi.`type`=3594 To do Qualite : 0.1819443479938272 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26269198_27-08-2025_18_11_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26269198 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26269198 AND mptpi.`type`=3594 To do Qualite : 0.250160539514295 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26269204_27-08-2025_18_02_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26269204 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26269204 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'21082025': {'nb_upload': 19, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1378771927, 1378771918, 1378771915, 1378771914, 1378771836, 1378771835, 1378771833, 1378771831, 1378771828, 1378771826, 1378771761, 1378771760, 1378771750, 1378771665, 1378771663, 1378771660, 1378771657, 1378771656, 1378771654] Looping around the photos to save general results len do output : 1 /26269189Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771927', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771918', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771915', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771914', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771836', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771835', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771833', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771831', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771828', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771826', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771761', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771760', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771750', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771665', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771663', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771660', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771657', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771656', None, None, None, None, None, '3615124') ('3318', None, None, None, None, None, None, None, '3615124') ('3318', '26269189', '1378771654', None, None, None, None, None, '3615124') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.014851093292236328 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.239849090576172 time spend to save output : 0.015144586563110352 total time spend for step 10 : 2.2549936771392822 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 19 set_done_treatment 80.55user 25.66system 2:09.88elapsed 81%CPU (0avgtext+0avgdata 2939052maxresident)k 527840inputs+54008outputs (638major+2172913minor)pagefaults 0swaps