python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1263224 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3579195'] with mtr_portfolio_ids : ['26164720'] and first list_photo_ids : [] new path : /proc/1263224/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 13 ; length of list_pids : 13 ; length of list_args : 13 time to download the photos : 1.9923906326293945 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Sat Aug 23 01:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10614 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-23 01:20:33.095610: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-23 01:20:33.124595: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-23 01:20:33.127198: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f9bc4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-23 01:20:33.127276: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-23 01:20:33.132052: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-23 01:20:33.317097: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3778ba60 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-23 01:20:33.317207: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-23 01:20:33.319009: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-23 01:20:33.320004: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-23 01:20:33.323780: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-23 01:20:33.327510: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-23 01:20:33.328243: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-23 01:20:33.331610: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-23 01:20:33.333007: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-23 01:20:33.338376: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-23 01:20:33.340176: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-23 01:20:33.340313: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-23 01:20:33.341178: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-23 01:20:33.341197: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-23 01:20:33.341207: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-23 01:20:33.343070: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9831 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-23 01:20:33.668665: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-23 01:20:33.668748: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-23 01:20:33.668768: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-23 01:20:33.668787: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-23 01:20:33.668805: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-23 01:20:33.668823: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-23 01:20:33.668841: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-23 01:20:33.668859: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-23 01:20:33.670418: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-23 01:20:33.671876: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-23 01:20:33.671915: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-23 01:20:33.671937: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-23 01:20:33.671957: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-23 01:20:33.671977: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-23 01:20:33.671996: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-23 01:20:33.672016: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-23 01:20:33.672035: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-23 01:20:33.673565: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-23 01:20:33.673596: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-23 01:20:33.673604: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-23 01:20:33.673612: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-23 01:20:33.674898: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9831 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-23 01:20:41.798524: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-23 01:20:41.972916: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 46.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 22 Detection mask done ! Trying to reset tf kernel 1263824 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 33 tf kernel not reseted sub process len(results) : 13 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 13 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5322 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00024056434631347656 nb_pixel_total : 7334 time to create 1 rle with old method : 0.009320497512817383 length of segment : 100 time for calcul the mask position with numpy : 0.00010180473327636719 nb_pixel_total : 3837 time to create 1 rle with old method : 0.004868030548095703 length of segment : 73 time for calcul the mask position with numpy : 0.0001785755157470703 nb_pixel_total : 10218 time to create 1 rle with old method : 0.012719154357910156 length of segment : 136 time for calcul the mask position with numpy : 0.00019598007202148438 nb_pixel_total : 10913 time to create 1 rle with old method : 0.01316070556640625 length of segment : 136 time for calcul the mask position with numpy : 0.00023317337036132812 nb_pixel_total : 12255 time to create 1 rle with old method : 0.014946699142456055 length of segment : 124 time for calcul the mask position with numpy : 8.988380432128906e-05 nb_pixel_total : 4855 time to create 1 rle with old method : 0.006447553634643555 length of segment : 72 time for calcul the mask position with numpy : 0.0002586841583251953 nb_pixel_total : 15565 time to create 1 rle with old method : 0.01854991912841797 length of segment : 195 time for calcul the mask position with numpy : 0.00011777877807617188 nb_pixel_total : 6079 time to create 1 rle with old method : 0.0075702667236328125 length of segment : 81 time for calcul the mask position with numpy : 0.00023174285888671875 nb_pixel_total : 6160 time to create 1 rle with old method : 0.0075206756591796875 length of segment : 94 time for calcul the mask position with numpy : 0.00023746490478515625 nb_pixel_total : 6922 time to create 1 rle with old method : 0.010390043258666992 length of segment : 79 time for calcul the mask position with numpy : 0.00033211708068847656 nb_pixel_total : 6600 time to create 1 rle with old method : 0.008624553680419922 length of segment : 116 time for calcul the mask position with numpy : 0.001039743423461914 nb_pixel_total : 35084 time to create 1 rle with old method : 0.04276776313781738 length of segment : 224 time for calcul the mask position with numpy : 0.0005660057067871094 nb_pixel_total : 19405 time to create 1 rle with old method : 0.023762226104736328 length of segment : 151 time for calcul the mask position with numpy : 0.00041961669921875 nb_pixel_total : 10823 time to create 1 rle with old method : 0.01334071159362793 length of segment : 176 time for calcul the mask position with numpy : 0.00044989585876464844 nb_pixel_total : 12371 time to create 1 rle with old method : 0.015775203704833984 length of segment : 160 time for calcul the mask position with numpy : 0.00026226043701171875 nb_pixel_total : 14426 time to create 1 rle with old method : 0.017713546752929688 length of segment : 107 time for calcul the mask position with numpy : 0.0002574920654296875 nb_pixel_total : 14407 time to create 1 rle with old method : 0.01783466339111328 length of segment : 189 time for calcul the mask position with numpy : 0.00012421607971191406 nb_pixel_total : 5318 time to create 1 rle with old method : 0.006639003753662109 length of segment : 104 time for calcul the mask position with numpy : 0.00030922889709472656 nb_pixel_total : 14224 time to create 1 rle with old method : 0.017752408981323242 length of segment : 126 time for calcul the mask position with numpy : 0.000423431396484375 nb_pixel_total : 21097 time to create 1 rle with old method : 0.02625107765197754 length of segment : 207 time for calcul the mask position with numpy : 0.0002429485321044922 nb_pixel_total : 13566 time to create 1 rle with old method : 0.01695704460144043 length of segment : 122 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 2247 time to create 1 rle with old method : 0.0030498504638671875 length of segment : 44 time for calcul the mask position with numpy : 0.0002224445343017578 nb_pixel_total : 6063 time to create 1 rle with old method : 0.00827646255493164 length of segment : 114 time for calcul the mask position with numpy : 0.0006539821624755859 nb_pixel_total : 5152 time to create 1 rle with old method : 0.006871700286865234 length of segment : 100 time for calcul the mask position with numpy : 0.0003039836883544922 nb_pixel_total : 19310 time to create 1 rle with old method : 0.026890039443969727 length of segment : 174 time for calcul the mask position with numpy : 0.0001270771026611328 nb_pixel_total : 4034 time to create 1 rle with old method : 0.005711555480957031 length of segment : 66 time for calcul the mask position with numpy : 0.0006198883056640625 nb_pixel_total : 9721 time to create 1 rle with old method : 0.014702558517456055 length of segment : 132 time for calcul the mask position with numpy : 0.0009846687316894531 nb_pixel_total : 22825 time to create 1 rle with old method : 0.028540372848510742 length of segment : 199 time for calcul the mask position with numpy : 0.0017168521881103516 nb_pixel_total : 49142 time to create 1 rle with old method : 0.06067037582397461 length of segment : 463 time for calcul the mask position with numpy : 0.0007967948913574219 nb_pixel_total : 52660 time to create 1 rle with old method : 0.0643925666809082 length of segment : 195 time for calcul the mask position with numpy : 0.0002613067626953125 nb_pixel_total : 12832 time to create 1 rle with old method : 0.015655994415283203 length of segment : 111 time for calcul the mask position with numpy : 0.00017595291137695312 nb_pixel_total : 9010 time to create 1 rle with old method : 0.010774612426757812 length of segment : 126 time for calcul the mask position with numpy : 0.00019359588623046875 nb_pixel_total : 7848 time to create 1 rle with old method : 0.00956273078918457 length of segment : 112 time for calcul the mask position with numpy : 0.0001442432403564453 nb_pixel_total : 5752 time to create 1 rle with old method : 0.0072765350341796875 length of segment : 105 time for calcul the mask position with numpy : 0.00017333030700683594 nb_pixel_total : 9678 time to create 1 rle with old method : 0.012196779251098633 length of segment : 96 time for calcul the mask position with numpy : 0.0004870891571044922 nb_pixel_total : 11452 time to create 1 rle with old method : 0.014524221420288086 length of segment : 149 time for calcul the mask position with numpy : 0.0003955364227294922 nb_pixel_total : 8909 time to create 1 rle with old method : 0.011176824569702148 length of segment : 147 time for calcul the mask position with numpy : 0.00019431114196777344 nb_pixel_total : 2962 time to create 1 rle with old method : 0.00390625 length of segment : 51 time for calcul the mask position with numpy : 0.00019311904907226562 nb_pixel_total : 3916 time to create 1 rle with old method : 0.009902000427246094 length of segment : 46 time for calcul the mask position with numpy : 0.00189971923828125 nb_pixel_total : 36431 time to create 1 rle with old method : 0.05124306678771973 length of segment : 435 time for calcul the mask position with numpy : 0.00027823448181152344 nb_pixel_total : 8568 time to create 1 rle with old method : 0.01088571548461914 length of segment : 71 time for calcul the mask position with numpy : 0.0003056526184082031 nb_pixel_total : 7275 time to create 1 rle with old method : 0.009259223937988281 length of segment : 107 time for calcul the mask position with numpy : 0.0003285408020019531 nb_pixel_total : 9545 time to create 1 rle with old method : 0.012067794799804688 length of segment : 144 time for calcul the mask position with numpy : 0.0002627372741699219 nb_pixel_total : 5391 time to create 1 rle with old method : 0.006777286529541016 length of segment : 93 time for calcul the mask position with numpy : 0.0003037452697753906 nb_pixel_total : 4894 time to create 1 rle with old method : 0.005970478057861328 length of segment : 138 time for calcul the mask position with numpy : 0.0002598762512207031 nb_pixel_total : 6917 time to create 1 rle with old method : 0.008710861206054688 length of segment : 93 time for calcul the mask position with numpy : 0.0004937648773193359 nb_pixel_total : 18194 time to create 1 rle with old method : 0.02264237403869629 length of segment : 158 time for calcul the mask position with numpy : 0.0006742477416992188 nb_pixel_total : 14781 time to create 1 rle with old method : 0.020587682723999023 length of segment : 162 time for calcul the mask position with numpy : 0.00046181678771972656 nb_pixel_total : 13954 time to create 1 rle with old method : 0.01719498634338379 length of segment : 128 time for calcul the mask position with numpy : 0.00033164024353027344 nb_pixel_total : 9438 time to create 1 rle with old method : 0.011608600616455078 length of segment : 137 time for calcul the mask position with numpy : 0.0007431507110595703 nb_pixel_total : 22261 time to create 1 rle with old method : 0.027350187301635742 length of segment : 202 time for calcul the mask position with numpy : 0.0002353191375732422 nb_pixel_total : 8740 time to create 1 rle with old method : 0.011126279830932617 length of segment : 85 time for calcul the mask position with numpy : 0.00022864341735839844 nb_pixel_total : 5944 time to create 1 rle with old method : 0.007735490798950195 length of segment : 72 time for calcul the mask position with numpy : 0.00025272369384765625 nb_pixel_total : 10744 time to create 1 rle with old method : 0.013214588165283203 length of segment : 194 time for calcul the mask position with numpy : 0.000423431396484375 nb_pixel_total : 12755 time to create 1 rle with old method : 0.015514850616455078 length of segment : 124 time for calcul the mask position with numpy : 0.0003371238708496094 nb_pixel_total : 9954 time to create 1 rle with old method : 0.012496709823608398 length of segment : 141 time for calcul the mask position with numpy : 0.00033211708068847656 nb_pixel_total : 8900 time to create 1 rle with old method : 0.011322498321533203 length of segment : 116 time for calcul the mask position with numpy : 9.965896606445312e-05 nb_pixel_total : 3414 time to create 1 rle with old method : 0.004449367523193359 length of segment : 89 time for calcul the mask position with numpy : 0.0006120204925537109 nb_pixel_total : 11829 time to create 1 rle with old method : 0.01574254035949707 length of segment : 179 time for calcul the mask position with numpy : 0.0001819133758544922 nb_pixel_total : 2175 time to create 1 rle with old method : 0.0028336048126220703 length of segment : 63 time for calcul the mask position with numpy : 0.00028014183044433594 nb_pixel_total : 6202 time to create 1 rle with old method : 0.007895708084106445 length of segment : 85 time for calcul the mask position with numpy : 0.0002970695495605469 nb_pixel_total : 7893 time to create 1 rle with old method : 0.00991511344909668 length of segment : 106 time for calcul the mask position with numpy : 0.000461578369140625 nb_pixel_total : 11738 time to create 1 rle with old method : 0.01464080810546875 length of segment : 125 time for calcul the mask position with numpy : 0.0005710124969482422 nb_pixel_total : 11151 time to create 1 rle with old method : 0.013711690902709961 length of segment : 180 time for calcul the mask position with numpy : 0.0001709461212158203 nb_pixel_total : 3797 time to create 1 rle with old method : 0.0049648284912109375 length of segment : 47 time for calcul the mask position with numpy : 0.0003361701965332031 nb_pixel_total : 7433 time to create 1 rle with old method : 0.00908970832824707 length of segment : 108 time for calcul the mask position with numpy : 0.0003345012664794922 nb_pixel_total : 8592 time to create 1 rle with old method : 0.011183977127075195 length of segment : 88 time for calcul the mask position with numpy : 0.0005540847778320312 nb_pixel_total : 7399 time to create 1 rle with old method : 0.011171817779541016 length of segment : 327 time for calcul the mask position with numpy : 0.00016736984252929688 nb_pixel_total : 4039 time to create 1 rle with old method : 0.004957675933837891 length of segment : 91 time for calcul the mask position with numpy : 0.00046753883361816406 nb_pixel_total : 15199 time to create 1 rle with old method : 0.01849818229675293 length of segment : 137 time for calcul the mask position with numpy : 0.0003173351287841797 nb_pixel_total : 7088 time to create 1 rle with old method : 0.009163856506347656 length of segment : 119 time spent for convertir_results : 2.6515302658081055 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 71 chid ids of type : 3594 Number RLEs to save : 9546 save missing photos in datou_result : time spend for datou_step_exec : 32.49250364303589 time spend to save output : 0.9765589237213135 total time spend for step 1 : 33.4690625667572 step2:crop_condition Sat Aug 23 01:21:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 13 ! batch 1 Loaded 71 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 54 About to insert : list_path_to_insert length 54 new photo from crops ! About to upload 54 photos upload in portfolio : 3736932 init cache_photo without model_param we have 54 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755904867_1263224 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 54 photos in the portfolio 3736932 time of upload the photos Elapsed time : 13.81694769859314 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755904882_1263224 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.7532296180725098 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755904884_1263224 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5530087947845459 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755904885_1263224 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.1733617782592773 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755904888_1263224 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5634450912475586 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1378540976, 1378540840, 1378540839, 1378540823, 1378540814, 1378540781, 1378540760, 1378540646, 1378540620, 1378540605, 1378540604, 1378540603, 1378540598] Looping around the photos to save general results len do output : 71 /1378749476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378749700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540976', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540840', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540839', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540823', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540814', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540781', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540760', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540646', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540620', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540605', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540604', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540603', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540598', None, None, None, None, None, '3579195') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 226 time used for this insertion : 0.033509016036987305 save_final save missing photos in datou_result : time spend for datou_step_exec : 24.83216166496277 time spend to save output : 0.03645610809326172 total time spend for step 2 : 24.86861777305603 step3:rle_unique_nms_with_priority Sat Aug 23 01:21:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 71 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 0.9665253162384033 time for calcul the mask position with numpy : 0.24895262718200684 nb_pixel_total : 2002544 time to create 1 rle with new method : 0.2615022659301758 time for calcul the mask position with numpy : 0.006318807601928711 nb_pixel_total : 6079 time to create 1 rle with old method : 0.007245779037475586 time for calcul the mask position with numpy : 0.006646633148193359 nb_pixel_total : 15565 time to create 1 rle with old method : 0.01793217658996582 time for calcul the mask position with numpy : 0.006450653076171875 nb_pixel_total : 4855 time to create 1 rle with old method : 0.006352424621582031 time for calcul the mask position with numpy : 0.006399631500244141 nb_pixel_total : 12255 time to create 1 rle with old method : 0.014732599258422852 time for calcul the mask position with numpy : 0.007081031799316406 nb_pixel_total : 10913 time to create 1 rle with old method : 0.015012025833129883 time for calcul the mask position with numpy : 0.006590127944946289 nb_pixel_total : 10218 time to create 1 rle with old method : 0.012578964233398438 time for calcul the mask position with numpy : 0.006401777267456055 nb_pixel_total : 3837 time to create 1 rle with old method : 0.004584789276123047 time for calcul the mask position with numpy : 0.006205081939697266 nb_pixel_total : 7334 time to create 1 rle with old method : 0.008650541305541992 create new chi : 0.6647517681121826 time to delete rle : 0.020082950592041016 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 2914 TO DO : save crop sub photo not yet done ! save time : 0.21690702438354492 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.06254935264587402 time for calcul the mask position with numpy : 0.02022528648376465 nb_pixel_total : 2060518 time to create 1 rle with new method : 0.08211970329284668 time for calcul the mask position with numpy : 0.006703615188598633 nb_pixel_total : 6922 time to create 1 rle with old method : 0.008341789245605469 time for calcul the mask position with numpy : 0.006739616394042969 nb_pixel_total : 6160 time to create 1 rle with old method : 0.007538318634033203 create new chi : 0.13193845748901367 time to delete rle : 0.0002498626708984375 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1426 TO DO : save crop sub photo not yet done ! save time : 0.142317533493042 nb_obj : 5 nb_hashtags : 1 time to prepare the origin masks : 0.07870936393737793 time for calcul the mask position with numpy : 0.16214442253112793 nb_pixel_total : 1989317 time to create 1 rle with new method : 0.05926322937011719 time for calcul the mask position with numpy : 0.006457328796386719 nb_pixel_total : 12371 time to create 1 rle with old method : 0.015024185180664062 time for calcul the mask position with numpy : 0.006422996520996094 nb_pixel_total : 10823 time to create 1 rle with old method : 0.013166189193725586 time for calcul the mask position with numpy : 0.006527423858642578 nb_pixel_total : 19405 time to create 1 rle with old method : 0.023785114288330078 time for calcul the mask position with numpy : 0.0067212581634521484 nb_pixel_total : 35084 time to create 1 rle with old method : 0.042821645736694336 time for calcul the mask position with numpy : 0.0064623355865478516 nb_pixel_total : 6600 time to create 1 rle with old method : 0.008336782455444336 create new chi : 0.3576362133026123 time to delete rle : 0.00029468536376953125 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2734 TO DO : save crop sub photo not yet done ! save time : 0.2283313274383545 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 0.4964778423309326 time for calcul the mask position with numpy : 0.058957815170288086 nb_pixel_total : 1953756 time to create 1 rle with new method : 0.291672945022583 time for calcul the mask position with numpy : 0.006275177001953125 nb_pixel_total : 4034 time to create 1 rle with old method : 0.004965066909790039 time for calcul the mask position with numpy : 0.0063364505767822266 nb_pixel_total : 19310 time to create 1 rle with old method : 0.02331066131591797 time for calcul the mask position with numpy : 0.006455183029174805 nb_pixel_total : 5152 time to create 1 rle with old method : 0.009349584579467773 time for calcul the mask position with numpy : 0.006814241409301758 nb_pixel_total : 6063 time to create 1 rle with old method : 0.010584354400634766 time for calcul the mask position with numpy : 0.0067348480224609375 nb_pixel_total : 2247 time to create 1 rle with old method : 0.00395512580871582 time for calcul the mask position with numpy : 0.0067784786224365234 nb_pixel_total : 13566 time to create 1 rle with old method : 0.023258686065673828 time for calcul the mask position with numpy : 0.0068738460540771484 nb_pixel_total : 21097 time to create 1 rle with old method : 0.026678085327148438 time for calcul the mask position with numpy : 0.00639796257019043 nb_pixel_total : 14224 time to create 1 rle with old method : 0.017133235931396484 time for calcul the mask position with numpy : 0.0061953067779541016 nb_pixel_total : 5318 time to create 1 rle with old method : 0.00654292106628418 time for calcul the mask position with numpy : 0.006414651870727539 nb_pixel_total : 14407 time to create 1 rle with old method : 0.017476797103881836 time for calcul the mask position with numpy : 0.006612062454223633 nb_pixel_total : 14426 time to create 1 rle with old method : 0.017508506774902344 create new chi : 0.5958652496337891 time to delete rle : 0.0005834102630615234 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 3786 TO DO : save crop sub photo not yet done ! save time : 0.601304292678833 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.0549311637878418 time for calcul the mask position with numpy : 0.020249605178833008 nb_pixel_total : 1991912 time to create 1 rle with new method : 0.031136035919189453 time for calcul the mask position with numpy : 0.006619691848754883 nb_pixel_total : 49142 time to create 1 rle with old method : 0.05986499786376953 time for calcul the mask position with numpy : 0.006509304046630859 nb_pixel_total : 22825 time to create 1 rle with old method : 0.027680635452270508 time for calcul the mask position with numpy : 0.006343364715576172 nb_pixel_total : 9721 time to create 1 rle with old method : 0.01182103157043457 create new chi : 0.1706681251525879 time to delete rle : 0.0004425048828125 batch 1 Loaded 7 chid ids of type : 3594 +++++++Number RLEs to save : 2668 TO DO : save crop sub photo not yet done ! save time : 0.23857593536376953 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 1.1964576244354248 time for calcul the mask position with numpy : 0.06435823440551758 nb_pixel_total : 1975989 time to create 1 rle with new method : 0.29011011123657227 time for calcul the mask position with numpy : 0.0070154666900634766 nb_pixel_total : 9673 time to create 1 rle with old method : 0.011687994003295898 time for calcul the mask position with numpy : 0.0066471099853515625 nb_pixel_total : 5588 time to create 1 rle with old method : 0.006943464279174805 time for calcul the mask position with numpy : 0.006674528121948242 nb_pixel_total : 7848 time to create 1 rle with old method : 0.009592771530151367 time for calcul the mask position with numpy : 0.006922483444213867 nb_pixel_total : 9010 time to create 1 rle with old method : 0.010940074920654297 time for calcul the mask position with numpy : 0.006894826889038086 nb_pixel_total : 12832 time to create 1 rle with old method : 0.015542030334472656 time for calcul the mask position with numpy : 0.007014751434326172 nb_pixel_total : 52660 time to create 1 rle with old method : 0.07042384147644043 create new chi : 0.532825231552124 time to delete rle : 0.00046443939208984375 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 2544 TO DO : save crop sub photo not yet done ! save time : 0.21057844161987305 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.10774660110473633 time for calcul the mask position with numpy : 0.02005743980407715 nb_pixel_total : 2019301 time to create 1 rle with new method : 0.30089545249938965 time for calcul the mask position with numpy : 0.006513357162475586 nb_pixel_total : 27060 time to create 1 rle with old method : 0.03272891044616699 time for calcul the mask position with numpy : 0.006585121154785156 nb_pixel_total : 3916 time to create 1 rle with old method : 0.004876375198364258 time for calcul the mask position with numpy : 0.0064923763275146484 nb_pixel_total : 2962 time to create 1 rle with old method : 0.0036308765411376953 time for calcul the mask position with numpy : 0.006219387054443359 nb_pixel_total : 8909 time to create 1 rle with old method : 0.01078033447265625 time for calcul the mask position with numpy : 0.0076410770416259766 nb_pixel_total : 11452 time to create 1 rle with old method : 0.013768911361694336 create new chi : 0.4278597831726074 time to delete rle : 0.0004298686981201172 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 2523 TO DO : save crop sub photo not yet done ! save time : 0.21706199645996094 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.25587987899780273 time for calcul the mask position with numpy : 0.0623164176940918 nb_pixel_total : 2037927 time to create 1 rle with new method : 0.18219280242919922 time for calcul the mask position with numpy : 0.0066678524017333984 nb_pixel_total : 4894 time to create 1 rle with old method : 0.005969524383544922 time for calcul the mask position with numpy : 0.00674891471862793 nb_pixel_total : 5391 time to create 1 rle with old method : 0.006503105163574219 time for calcul the mask position with numpy : 0.006659746170043945 nb_pixel_total : 9545 time to create 1 rle with old method : 0.013217926025390625 time for calcul the mask position with numpy : 0.006786823272705078 nb_pixel_total : 7275 time to create 1 rle with old method : 0.008900642395019531 time for calcul the mask position with numpy : 0.0068967342376708984 nb_pixel_total : 8568 time to create 1 rle with old method : 0.010441780090332031 create new chi : 0.33428311347961426 time to delete rle : 0.0003807544708251953 batch 1 Loaded 11 chid ids of type : 3594 ++++++++Number RLEs to save : 2186 TO DO : save crop sub photo not yet done ! save time : 0.18365192413330078 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.047653913497924805 time for calcul the mask position with numpy : 0.02306842803955078 nb_pixel_total : 2048489 time to create 1 rle with new method : 0.1624619960784912 time for calcul the mask position with numpy : 0.0067136287689208984 nb_pixel_total : 18194 time to create 1 rle with old method : 0.022188901901245117 time for calcul the mask position with numpy : 0.006753206253051758 nb_pixel_total : 6917 time to create 1 rle with old method : 0.00843191146850586 create new chi : 0.229933500289917 time to delete rle : 0.00027370452880859375 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 1582 TO DO : save crop sub photo not yet done ! save time : 0.144484281539917 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.389373779296875 time for calcul the mask position with numpy : 0.16556644439697266 nb_pixel_total : 2044865 time to create 1 rle with new method : 0.07973337173461914 time for calcul the mask position with numpy : 0.006912946701049805 nb_pixel_total : 13954 time to create 1 rle with old method : 0.019870758056640625 time for calcul the mask position with numpy : 0.006753444671630859 nb_pixel_total : 14781 time to create 1 rle with old method : 0.018176794052124023 create new chi : 0.30852699279785156 time to delete rle : 0.0003046989440917969 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1660 TO DO : save crop sub photo not yet done ! save time : 0.15784525871276855 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.3946957588195801 time for calcul the mask position with numpy : 0.15867352485656738 nb_pixel_total : 2016473 time to create 1 rle with new method : 0.08995985984802246 time for calcul the mask position with numpy : 0.006807804107666016 nb_pixel_total : 10744 time to create 1 rle with old method : 0.013170957565307617 time for calcul the mask position with numpy : 0.006261587142944336 nb_pixel_total : 5944 time to create 1 rle with old method : 0.007307291030883789 time for calcul the mask position with numpy : 0.006328105926513672 nb_pixel_total : 8740 time to create 1 rle with old method : 0.011279582977294922 time for calcul the mask position with numpy : 0.007170677185058594 nb_pixel_total : 22261 time to create 1 rle with old method : 0.02919745445251465 time for calcul the mask position with numpy : 0.0071430206298828125 nb_pixel_total : 9438 time to create 1 rle with old method : 0.01149892807006836 create new chi : 0.36643028259277344 time to delete rle : 0.0005071163177490234 batch 1 Loaded 11 chid ids of type : 3594 ++++++++Number RLEs to save : 2460 TO DO : save crop sub photo not yet done ! save time : 0.20026087760925293 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.06716775894165039 time for calcul the mask position with numpy : 0.039444684982299805 nb_pixel_total : 2026748 time to create 1 rle with new method : 0.2267591953277588 time for calcul the mask position with numpy : 0.0062901973724365234 nb_pixel_total : 11829 time to create 1 rle with old method : 0.014312505722045898 time for calcul the mask position with numpy : 0.006263256072998047 nb_pixel_total : 3414 time to create 1 rle with old method : 0.004237174987792969 time for calcul the mask position with numpy : 0.005917072296142578 nb_pixel_total : 8900 time to create 1 rle with old method : 0.010451793670654297 time for calcul the mask position with numpy : 0.005926847457885742 nb_pixel_total : 9954 time to create 1 rle with old method : 0.012091875076293945 time for calcul the mask position with numpy : 0.006696939468383789 nb_pixel_total : 12755 time to create 1 rle with old method : 0.01560521125793457 create new chi : 0.3649275302886963 time to delete rle : 0.0004589557647705078 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2378 TO DO : save crop sub photo not yet done ! save time : 0.18250441551208496 nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 0.4967973232269287 time for calcul the mask position with numpy : 0.31051111221313477 nb_pixel_total : 1982071 time to create 1 rle with new method : 0.07485151290893555 time for calcul the mask position with numpy : 0.008946418762207031 nb_pixel_total : 7088 time to create 1 rle with old method : 0.00853109359741211 time for calcul the mask position with numpy : 0.006216287612915039 nb_pixel_total : 15199 time to create 1 rle with old method : 0.017766714096069336 time for calcul the mask position with numpy : 0.009894132614135742 nb_pixel_total : 4037 time to create 1 rle with old method : 0.00473475456237793 time for calcul the mask position with numpy : 0.010085344314575195 nb_pixel_total : 6224 time to create 1 rle with old method : 0.007493495941162109 time for calcul the mask position with numpy : 0.009975433349609375 nb_pixel_total : 8592 time to create 1 rle with old method : 0.010265350341796875 time for calcul the mask position with numpy : 0.009892702102661133 nb_pixel_total : 7433 time to create 1 rle with old method : 0.009077072143554688 time for calcul the mask position with numpy : 0.009195566177368164 nb_pixel_total : 3797 time to create 1 rle with old method : 0.00451350212097168 time for calcul the mask position with numpy : 0.008082389831542969 nb_pixel_total : 11151 time to create 1 rle with old method : 0.01307988166809082 time for calcul the mask position with numpy : 0.0062711238861083984 nb_pixel_total : 11738 time to create 1 rle with old method : 0.013918638229370117 time for calcul the mask position with numpy : 0.006039142608642578 nb_pixel_total : 7893 time to create 1 rle with old method : 0.009421110153198242 time for calcul the mask position with numpy : 0.00632929801940918 nb_pixel_total : 6202 time to create 1 rle with old method : 0.007326841354370117 time for calcul the mask position with numpy : 0.0062677860260009766 nb_pixel_total : 2175 time to create 1 rle with old method : 0.0026352405548095703 create new chi : 0.6027076244354248 time to delete rle : 0.0006546974182128906 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 3876 TO DO : save crop sub photo not yet done ! save time : 0.3036839962005615 map_output_result : {1378540976: (0.0, 'Should be the crop_list due to order', 0), 1378540840: (0.0, 'Should be the crop_list due to order', 0), 1378540839: (0.0, 'Should be the crop_list due to order', 0), 1378540823: (0.0, 'Should be the crop_list due to order', 0), 1378540814: (0.0, 'Should be the crop_list due to order', 0), 1378540781: (0.0, 'Should be the crop_list due to order', 0), 1378540760: (0.0, 'Should be the crop_list due to order', 0), 1378540646: (0.0, 'Should be the crop_list due to order', 0), 1378540620: (0.0, 'Should be the crop_list due to order', 0), 1378540605: (0.0, 'Should be the crop_list due to order', 0), 1378540604: (0.0, 'Should be the crop_list due to order', 0), 1378540603: (0.0, 'Should be the crop_list due to order', 0), 1378540598: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1378540976, 1378540840, 1378540839, 1378540823, 1378540814, 1378540781, 1378540760, 1378540646, 1378540620, 1378540605, 1378540604, 1378540603, 1378540598] Looping around the photos to save general results len do output : 13 /1378540976.Didn't retrieve data . /1378540840.Didn't retrieve data . /1378540839.Didn't retrieve data . /1378540823.Didn't retrieve data . /1378540814.Didn't retrieve data . /1378540781.Didn't retrieve data . /1378540760.Didn't retrieve data . /1378540646.Didn't retrieve data . /1378540620.Didn't retrieve data . /1378540605.Didn't retrieve data . /1378540604.Didn't retrieve data . /1378540603.Didn't retrieve data . /1378540598.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540976', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540840', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540839', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540823', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540814', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540781', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540760', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540646', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540620', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540605', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540604', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540603', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540598', None, None, None, None, None, '3579195') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.10815191268920898 save_final save missing photos in datou_result : time spend for datou_step_exec : 13.247552871704102 time spend to save output : 0.10864424705505371 total time spend for step 3 : 13.356197118759155 step4:ventilate_hashtags_in_portfolio Sat Aug 23 01:21:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26164720 get user id for portfolio 26164720 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26164720 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','metal','mal_croppe','pehd','autre','flou','background','carton','environnement','papier','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26164720 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','metal','mal_croppe','pehd','autre','flou','background','carton','environnement','papier','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26164720 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','metal','mal_croppe','pehd','autre','flou','background','carton','environnement','papier','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/26166347,26166348,26166349,26166350,26166351,26166352,26166353,26166354,26166355,26166356,26166357?tags=pet_clair,metal,mal_croppe,pehd,autre,flou,background,carton,environnement,papier,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1378540976, 1378540840, 1378540839, 1378540823, 1378540814, 1378540781, 1378540760, 1378540646, 1378540620, 1378540605, 1378540604, 1378540603, 1378540598] Looping around the photos to save general results len do output : 1 /26164720. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540976', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540840', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540839', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540823', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540814', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540781', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540760', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540646', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540620', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540605', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540604', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540603', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540598', None, None, None, None, None, '3579195') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.0561528205871582 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6712236404418945 time spend to save output : 0.05642199516296387 total time spend for step 4 : 1.7276456356048584 step5:final Sat Aug 23 01:21:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1378540976: ('0.029932707146248815',), 1378540840: ('0.029932707146248815',), 1378540839: ('0.029932707146248815',), 1378540823: ('0.029932707146248815',), 1378540814: ('0.029932707146248815',), 1378540781: ('0.029932707146248815',), 1378540760: ('0.029932707146248815',), 1378540646: ('0.029932707146248815',), 1378540620: ('0.029932707146248815',), 1378540605: ('0.029932707146248815',), 1378540604: ('0.029932707146248815',), 1378540603: ('0.029932707146248815',), 1378540598: ('0.029932707146248815',)} new output for save of step final : {1378540976: ('0.029932707146248815',), 1378540840: ('0.029932707146248815',), 1378540839: ('0.029932707146248815',), 1378540823: ('0.029932707146248815',), 1378540814: ('0.029932707146248815',), 1378540781: ('0.029932707146248815',), 1378540760: ('0.029932707146248815',), 1378540646: ('0.029932707146248815',), 1378540620: ('0.029932707146248815',), 1378540605: ('0.029932707146248815',), 1378540604: ('0.029932707146248815',), 1378540603: ('0.029932707146248815',), 1378540598: ('0.029932707146248815',)} [1378540976, 1378540840, 1378540839, 1378540823, 1378540814, 1378540781, 1378540760, 1378540646, 1378540620, 1378540605, 1378540604, 1378540603, 1378540598] Looping around the photos to save general results len do output : 13 /1378540976.Didn't retrieve data . /1378540840.Didn't retrieve data . /1378540839.Didn't retrieve data . /1378540823.Didn't retrieve data . /1378540814.Didn't retrieve data . /1378540781.Didn't retrieve data . /1378540760.Didn't retrieve data . /1378540646.Didn't retrieve data . /1378540620.Didn't retrieve data . /1378540605.Didn't retrieve data . /1378540604.Didn't retrieve data . /1378540603.Didn't retrieve data . /1378540598.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540976', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540840', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540839', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540823', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540814', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540781', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540760', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540646', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540620', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540605', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540604', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540603', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540598', None, None, None, None, None, '3579195') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.019240617752075195 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12415504455566406 time spend to save output : 0.019854068756103516 total time spend for step 5 : 0.14400911331176758 step6:blur_detection Sat Aug 23 01:21:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1755904828_1263224_1378540976_b47e1ba00f09e2fa155a77305ebd42ca.jpg resize: (1080, 1920) 1378540976 -0.013088670736868238 treat image : temp/1755904828_1263224_1378540840_1e5740022e560a57f7dbdb34b0de36f2.jpg resize: (1080, 1920) 1378540840 0.2245407570446669 treat image : temp/1755904828_1263224_1378540839_7bd6488d4beea8a4cccf86a79a8f7a64.jpg resize: (1080, 1920) 1378540839 -0.08352620636220458 treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa.jpg resize: (1080, 1920) 1378540823 -0.6792614937119791 treat image : temp/1755904828_1263224_1378540814_ef648ba52fce3ffa3e017904b591fbad.jpg resize: (1080, 1920) 1378540814 0.902874651632766 treat image : temp/1755904828_1263224_1378540781_90ff215ccff115162a8be3af40b94e41.jpg resize: (1080, 1920) 1378540781 0.3661220425264158 treat image : temp/1755904828_1263224_1378540760_721823b0f9ee0094da08a570afd9644a.jpg resize: (1080, 1920) 1378540760 0.7052259153121859 treat image : temp/1755904828_1263224_1378540646_41ff94d5b398afaf79c2b4fa82a243d2.jpg resize: (1080, 1920) 1378540646 -0.3568349845690518 treat image : temp/1755904828_1263224_1378540620_4109cd234ef5b4429d114df580e4ee8c.jpg resize: (1080, 1920) 1378540620 0.5498324347698481 treat image : temp/1755904828_1263224_1378540605_ad80ba068291bc9b48c04e5a9cc49b42.jpg resize: (1080, 1920) 1378540605 0.5942030419330723 treat image : temp/1755904828_1263224_1378540604_fb6bd529f86d682cd71d1ad44f197b7f.jpg resize: (1080, 1920) 1378540604 2.68806394216363 treat image : temp/1755904828_1263224_1378540603_8df780ac81df91d939b2e753bfb7a588.jpg resize: (1080, 1920) 1378540603 0.2058586259696203 treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56.jpg resize: (1080, 1920) 1378540598 1.3251976355851145 treat image : temp/1755904828_1263224_1378540976_b47e1ba00f09e2fa155a77305ebd42ca_rle_crop_3926797427_0.png resize: (100, 114) 1378749476 -0.20598694280712335 treat image : temp/1755904828_1263224_1378540976_b47e1ba00f09e2fa155a77305ebd42ca_rle_crop_3926797428_0.png resize: (73, 79) 1378749479 -1.2826616690512673 treat image : temp/1755904828_1263224_1378540976_b47e1ba00f09e2fa155a77305ebd42ca_rle_crop_3926797431_0.png resize: (112, 159) 1378749482 -0.551841481077782 treat image : temp/1755904828_1263224_1378540976_b47e1ba00f09e2fa155a77305ebd42ca_rle_crop_3926797432_0.png resize: (70, 88) 1378749486 0.5031726930488586 treat image : temp/1755904828_1263224_1378540976_b47e1ba00f09e2fa155a77305ebd42ca_rle_crop_3926797434_0.png resize: (80, 127) 1378749488 -0.26300695801464274 treat image : temp/1755904828_1263224_1378540840_1e5740022e560a57f7dbdb34b0de36f2_rle_crop_3926797435_0.png resize: (90, 103) 1378749491 -0.7390595801046378 treat image : temp/1755904828_1263224_1378540840_1e5740022e560a57f7dbdb34b0de36f2_rle_crop_3926797436_0.png resize: (79, 117) 1378749494 1.6981785104223728 treat image : temp/1755904828_1263224_1378540839_7bd6488d4beea8a4cccf86a79a8f7a64_rle_crop_3926797437_0.png resize: (116, 100) 1378749496 0.1458549411285853 treat image : temp/1755904828_1263224_1378540839_7bd6488d4beea8a4cccf86a79a8f7a64_rle_crop_3926797438_0.png resize: (174, 311) 1378749499 -1.7685064673308888 treat image : temp/1755904828_1263224_1378540839_7bd6488d4beea8a4cccf86a79a8f7a64_rle_crop_3926797439_0.png resize: (151, 177) 1378749502 -0.9665239230900885 treat image : temp/1755904828_1263224_1378540839_7bd6488d4beea8a4cccf86a79a8f7a64_rle_crop_3926797440_0.png resize: (176, 106) 1378749504 -0.4926162073501344 treat image : temp/1755904828_1263224_1378540839_7bd6488d4beea8a4cccf86a79a8f7a64_rle_crop_3926797441_0.png resize: (159, 105) 1378749507 0.2687056723674855 treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797442_0.png resize: (106, 178) 1378749510 0.1809420009183115 treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797443_0.png resize: (165, 138) 1378749512 -1.6939361960931207 treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797444_0.png resize: (103, 68) 1378749515 -1.9492362881709442 treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797446_0.png resize: (207, 172) 1378749518 -0.8916266602162124 treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797447_0.png resize: (97, 217) 1378749519 -2.410033272226786 treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797448_0.png resize: (42, 84) 1378749523 5.005328014082241 treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797449_0.png resize: (99, 116) 1378749526 -2.253438478926181 treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797450_0.png resize: (113, 161) 1378749529 -2.002292402215653 treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797452_0.png resize: (65, 100) 1378749532 1.1806378517083231 treat image : temp/1755904828_1263224_1378540814_ef648ba52fce3ffa3e017904b591fbad_rle_crop_3926797455_0.png resize: (281, 359) 1378749534 -1.0527075021729495 treat image : temp/1755904828_1263224_1378540781_90ff215ccff115162a8be3af40b94e41_rle_crop_3926797456_0.png resize: (193, 376) 1378749537 -1.6956152073036463 treat image : temp/1755904828_1263224_1378540781_90ff215ccff115162a8be3af40b94e41_rle_crop_3926797457_0.png resize: (110, 164) 1378749540 2.139237805607988 treat image : temp/1755904828_1263224_1378540781_90ff215ccff115162a8be3af40b94e41_rle_crop_3926797460_0.png resize: (82, 124) 1378749542 -1.0749872594679153 treat image : temp/1755904828_1263224_1378540781_90ff215ccff115162a8be3af40b94e41_rle_crop_3926797461_0.png resize: (96, 148) 1378749545 2.1327678428279704 treat image : temp/1755904828_1263224_1378540760_721823b0f9ee0094da08a570afd9644a_rle_crop_3926797462_0.png resize: (149, 124) 1378749548 -0.07632783449469564 treat image : temp/1755904828_1263224_1378540760_721823b0f9ee0094da08a570afd9644a_rle_crop_3926797464_0.png resize: (51, 90) 1378749550 -0.5512153775107052 treat image : temp/1755904828_1263224_1378540760_721823b0f9ee0094da08a570afd9644a_rle_crop_3926797465_0.png resize: (46, 117) 1378749553 -0.008307836737743697 treat image : temp/1755904828_1263224_1378540760_721823b0f9ee0094da08a570afd9644a_rle_crop_3926797466_0.png resize: (398, 401) 1378749555 -0.6512260800606094 treat image : temp/1755904828_1263224_1378540646_41ff94d5b398afaf79c2b4fa82a243d2_rle_crop_3926797467_0.png resize: (70, 155) 1378749557 -0.8791663011620495 treat image : temp/1755904828_1263224_1378540646_41ff94d5b398afaf79c2b4fa82a243d2_rle_crop_3926797468_0.png resize: (89, 137) 1378749559 -0.5443953950225103 treat image : temp/1755904828_1263224_1378540620_4109cd234ef5b4429d114df580e4ee8c_rle_crop_3926797472_0.png resize: (93, 103) 1378749561 -0.9383293877170071 treat image : temp/1755904828_1263224_1378540620_4109cd234ef5b4429d114df580e4ee8c_rle_crop_3926797473_0.png resize: (147, 182) 1378749562 0.6755012964148315 treat image : temp/1755904828_1263224_1378540605_ad80ba068291bc9b48c04e5a9cc49b42_rle_crop_3926797474_0.png resize: (147, 186) 1378749564 -1.6452860828415685 treat image : temp/1755904828_1263224_1378540605_ad80ba068291bc9b48c04e5a9cc49b42_rle_crop_3926797475_0.png resize: (127, 169) 1378749566 -1.2157733585321973 treat image : temp/1755904828_1263224_1378540604_fb6bd529f86d682cd71d1ad44f197b7f_rle_crop_3926797477_0.png resize: (194, 192) 1378749567 0.6364827116044103 treat image : temp/1755904828_1263224_1378540604_fb6bd529f86d682cd71d1ad44f197b7f_rle_crop_3926797478_0.png resize: (85, 134) 1378749569 3.8790562698668207 treat image : temp/1755904828_1263224_1378540604_fb6bd529f86d682cd71d1ad44f197b7f_rle_crop_3926797480_0.png resize: (142, 97) 1378749571 0.9740391907679093 treat image : temp/1755904828_1263224_1378540603_8df780ac81df91d939b2e753bfb7a588_rle_crop_3926797481_0.png resize: (124, 202) 1378749572 0.82503957756321 treat image : temp/1755904828_1263224_1378540603_8df780ac81df91d939b2e753bfb7a588_rle_crop_3926797483_0.png resize: (116, 129) 1378749574 -0.4388104553351444 treat image : temp/1755904828_1263224_1378540603_8df780ac81df91d939b2e753bfb7a588_rle_crop_3926797484_0.png resize: (49, 102) 1378749575 -0.7334412312231104 treat image : temp/1755904828_1263224_1378540603_8df780ac81df91d939b2e753bfb7a588_rle_crop_3926797485_0.png resize: (179, 113) 1378749578 -0.45457077380312005 treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797486_0.png resize: (63, 49) 1378749579 0.6487737542561484 treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797487_0.png resize: (83, 106) 1378749581 0.2604882469416109 treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797488_0.png resize: (104, 110) 1378749583 0.2128275381522761 treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797490_0.png resize: (179, 114) 1378749584 -0.5155152134503849 treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797491_0.png resize: (42, 127) 1378749587 0.37690052933415635 treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797492_0.png resize: (108, 108) 1378749588 -1.200200431749803 treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797493_0.png resize: (83, 155) 1378749590 -0.9478648522842511 treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797494_0.png resize: (166, 206) 1378749592 -1.0934740043478017 treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797495_0.png resize: (90, 56) 1378749593 -0.5537765103513438 treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797496_0.png resize: (137, 176) 1378749595 -0.32399039538218083 treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797497_0.png resize: (78, 174) 1378749596 -2.310157663228023 treat image : temp/1755904828_1263224_1378540976_b47e1ba00f09e2fa155a77305ebd42ca_rle_crop_3926797430_0.png resize: (136, 114) 1378749623 -1.055092601819745 treat image : temp/1755904828_1263224_1378540976_b47e1ba00f09e2fa155a77305ebd42ca_rle_crop_3926797433_0.png resize: (195, 110) 1378749624 -1.088884123613979 treat image : temp/1755904828_1263224_1378540814_ef648ba52fce3ffa3e017904b591fbad_rle_crop_3926797454_0.png resize: (186, 218) 1378749626 -1.613626161024632 treat image : temp/1755904828_1263224_1378540781_90ff215ccff115162a8be3af40b94e41_rle_crop_3926797459_0.png resize: (111, 118) 1378749627 -1.5669489194430812 treat image : temp/1755904828_1263224_1378540646_41ff94d5b398afaf79c2b4fa82a243d2_rle_crop_3926797470_0.png resize: (93, 93) 1378749629 -1.8374835203318811 treat image : temp/1755904828_1263224_1378540646_41ff94d5b398afaf79c2b4fa82a243d2_rle_crop_3926797471_0.png resize: (123, 65) 1378749631 -1.873653139306172 treat image : temp/1755904828_1263224_1378540604_fb6bd529f86d682cd71d1ad44f197b7f_rle_crop_3926797479_0.png resize: (70, 147) 1378749632 -2.371492690685404 treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797489_0.png resize: (124, 122) 1378749644 -0.788552571743711 treat image : temp/1755904828_1263224_1378540976_b47e1ba00f09e2fa155a77305ebd42ca_rle_crop_3926797429_0.png resize: (134, 93) 1378749674 -2.9932338285853657 treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797445_0.png resize: (126, 149) 1378749677 -0.7096629958530608 treat image : temp/1755904828_1263224_1378540814_ef648ba52fce3ffa3e017904b591fbad_rle_crop_3926797453_0.png resize: (132, 99) 1378749679 -2.126328773483301 treat image : temp/1755904828_1263224_1378540781_90ff215ccff115162a8be3af40b94e41_rle_crop_3926797458_0.png resize: (126, 90) 1378749680 -2.2486680262975938 treat image : temp/1755904828_1263224_1378540760_721823b0f9ee0094da08a570afd9644a_rle_crop_3926797463_0.png resize: (137, 79) 1378749683 -2.6944058724986655 treat image : temp/1755904828_1263224_1378540646_41ff94d5b398afaf79c2b4fa82a243d2_rle_crop_3926797469_0.png resize: (127, 98) 1378749684 -2.177849041849416 treat image : temp/1755904828_1263224_1378540604_fb6bd529f86d682cd71d1ad44f197b7f_rle_crop_3926797476_0.png resize: (137, 95) 1378749685 -2.0928329207720355 treat image : temp/1755904828_1263224_1378540603_8df780ac81df91d939b2e753bfb7a588_rle_crop_3926797482_0.png resize: (140, 95) 1378749688 -2.5925909789690276 treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797451_0.png resize: (174, 137) 1378749700 -0.07215245537526604 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 84 time used for this insertion : 0.017511367797851562 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 84 time used for this insertion : 0.022434473037719727 save missing photos in datou_result : time spend for datou_step_exec : 10.456090927124023 time spend to save output : 0.044702768325805664 total time spend for step 6 : 10.500793695449829 step7:brightness Sat Aug 23 01:21:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1755904828_1263224_1378540976_b47e1ba00f09e2fa155a77305ebd42ca.jpg treat image : temp/1755904828_1263224_1378540840_1e5740022e560a57f7dbdb34b0de36f2.jpg treat image : temp/1755904828_1263224_1378540839_7bd6488d4beea8a4cccf86a79a8f7a64.jpg treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa.jpg treat image : temp/1755904828_1263224_1378540814_ef648ba52fce3ffa3e017904b591fbad.jpg treat image : temp/1755904828_1263224_1378540781_90ff215ccff115162a8be3af40b94e41.jpg treat image : temp/1755904828_1263224_1378540760_721823b0f9ee0094da08a570afd9644a.jpg treat image : temp/1755904828_1263224_1378540646_41ff94d5b398afaf79c2b4fa82a243d2.jpg treat image : temp/1755904828_1263224_1378540620_4109cd234ef5b4429d114df580e4ee8c.jpg treat image : temp/1755904828_1263224_1378540605_ad80ba068291bc9b48c04e5a9cc49b42.jpg treat image : temp/1755904828_1263224_1378540604_fb6bd529f86d682cd71d1ad44f197b7f.jpg treat image : temp/1755904828_1263224_1378540603_8df780ac81df91d939b2e753bfb7a588.jpg treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56.jpg treat image : temp/1755904828_1263224_1378540976_b47e1ba00f09e2fa155a77305ebd42ca_rle_crop_3926797427_0.png treat image : temp/1755904828_1263224_1378540976_b47e1ba00f09e2fa155a77305ebd42ca_rle_crop_3926797428_0.png treat image : temp/1755904828_1263224_1378540976_b47e1ba00f09e2fa155a77305ebd42ca_rle_crop_3926797431_0.png treat image : temp/1755904828_1263224_1378540976_b47e1ba00f09e2fa155a77305ebd42ca_rle_crop_3926797432_0.png treat image : temp/1755904828_1263224_1378540976_b47e1ba00f09e2fa155a77305ebd42ca_rle_crop_3926797434_0.png treat image : temp/1755904828_1263224_1378540840_1e5740022e560a57f7dbdb34b0de36f2_rle_crop_3926797435_0.png treat image : temp/1755904828_1263224_1378540840_1e5740022e560a57f7dbdb34b0de36f2_rle_crop_3926797436_0.png treat image : temp/1755904828_1263224_1378540839_7bd6488d4beea8a4cccf86a79a8f7a64_rle_crop_3926797437_0.png treat image : temp/1755904828_1263224_1378540839_7bd6488d4beea8a4cccf86a79a8f7a64_rle_crop_3926797438_0.png treat image : temp/1755904828_1263224_1378540839_7bd6488d4beea8a4cccf86a79a8f7a64_rle_crop_3926797439_0.png treat image : temp/1755904828_1263224_1378540839_7bd6488d4beea8a4cccf86a79a8f7a64_rle_crop_3926797440_0.png treat image : temp/1755904828_1263224_1378540839_7bd6488d4beea8a4cccf86a79a8f7a64_rle_crop_3926797441_0.png treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797442_0.png treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797443_0.png treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797444_0.png treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797446_0.png treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797447_0.png treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797448_0.png treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797449_0.png treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797450_0.png treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797452_0.png treat image : temp/1755904828_1263224_1378540814_ef648ba52fce3ffa3e017904b591fbad_rle_crop_3926797455_0.png treat image : temp/1755904828_1263224_1378540781_90ff215ccff115162a8be3af40b94e41_rle_crop_3926797456_0.png treat image : temp/1755904828_1263224_1378540781_90ff215ccff115162a8be3af40b94e41_rle_crop_3926797457_0.png treat image : temp/1755904828_1263224_1378540781_90ff215ccff115162a8be3af40b94e41_rle_crop_3926797460_0.png treat image : temp/1755904828_1263224_1378540781_90ff215ccff115162a8be3af40b94e41_rle_crop_3926797461_0.png treat image : temp/1755904828_1263224_1378540760_721823b0f9ee0094da08a570afd9644a_rle_crop_3926797462_0.png treat image : temp/1755904828_1263224_1378540760_721823b0f9ee0094da08a570afd9644a_rle_crop_3926797464_0.png treat image : temp/1755904828_1263224_1378540760_721823b0f9ee0094da08a570afd9644a_rle_crop_3926797465_0.png treat image : temp/1755904828_1263224_1378540760_721823b0f9ee0094da08a570afd9644a_rle_crop_3926797466_0.png treat image : temp/1755904828_1263224_1378540646_41ff94d5b398afaf79c2b4fa82a243d2_rle_crop_3926797467_0.png treat image : temp/1755904828_1263224_1378540646_41ff94d5b398afaf79c2b4fa82a243d2_rle_crop_3926797468_0.png treat image : temp/1755904828_1263224_1378540620_4109cd234ef5b4429d114df580e4ee8c_rle_crop_3926797472_0.png treat image : temp/1755904828_1263224_1378540620_4109cd234ef5b4429d114df580e4ee8c_rle_crop_3926797473_0.png treat image : temp/1755904828_1263224_1378540605_ad80ba068291bc9b48c04e5a9cc49b42_rle_crop_3926797474_0.png treat image : temp/1755904828_1263224_1378540605_ad80ba068291bc9b48c04e5a9cc49b42_rle_crop_3926797475_0.png treat image : temp/1755904828_1263224_1378540604_fb6bd529f86d682cd71d1ad44f197b7f_rle_crop_3926797477_0.png treat image : temp/1755904828_1263224_1378540604_fb6bd529f86d682cd71d1ad44f197b7f_rle_crop_3926797478_0.png treat image : temp/1755904828_1263224_1378540604_fb6bd529f86d682cd71d1ad44f197b7f_rle_crop_3926797480_0.png treat image : temp/1755904828_1263224_1378540603_8df780ac81df91d939b2e753bfb7a588_rle_crop_3926797481_0.png treat image : temp/1755904828_1263224_1378540603_8df780ac81df91d939b2e753bfb7a588_rle_crop_3926797483_0.png treat image : temp/1755904828_1263224_1378540603_8df780ac81df91d939b2e753bfb7a588_rle_crop_3926797484_0.png treat image : temp/1755904828_1263224_1378540603_8df780ac81df91d939b2e753bfb7a588_rle_crop_3926797485_0.png treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797486_0.png treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797487_0.png treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797488_0.png treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797490_0.png treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797491_0.png treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797492_0.png treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797493_0.png treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797494_0.png treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797495_0.png treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797496_0.png treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797497_0.png treat image : temp/1755904828_1263224_1378540976_b47e1ba00f09e2fa155a77305ebd42ca_rle_crop_3926797430_0.png treat image : temp/1755904828_1263224_1378540976_b47e1ba00f09e2fa155a77305ebd42ca_rle_crop_3926797433_0.png treat image : temp/1755904828_1263224_1378540814_ef648ba52fce3ffa3e017904b591fbad_rle_crop_3926797454_0.png treat image : temp/1755904828_1263224_1378540781_90ff215ccff115162a8be3af40b94e41_rle_crop_3926797459_0.png treat image : temp/1755904828_1263224_1378540646_41ff94d5b398afaf79c2b4fa82a243d2_rle_crop_3926797470_0.png treat image : temp/1755904828_1263224_1378540646_41ff94d5b398afaf79c2b4fa82a243d2_rle_crop_3926797471_0.png treat image : temp/1755904828_1263224_1378540604_fb6bd529f86d682cd71d1ad44f197b7f_rle_crop_3926797479_0.png treat image : temp/1755904828_1263224_1378540598_638039df0133d1817f9f7b5e35a8df56_rle_crop_3926797489_0.png treat image : temp/1755904828_1263224_1378540976_b47e1ba00f09e2fa155a77305ebd42ca_rle_crop_3926797429_0.png treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797445_0.png treat image : temp/1755904828_1263224_1378540814_ef648ba52fce3ffa3e017904b591fbad_rle_crop_3926797453_0.png treat image : temp/1755904828_1263224_1378540781_90ff215ccff115162a8be3af40b94e41_rle_crop_3926797458_0.png treat image : temp/1755904828_1263224_1378540760_721823b0f9ee0094da08a570afd9644a_rle_crop_3926797463_0.png treat image : temp/1755904828_1263224_1378540646_41ff94d5b398afaf79c2b4fa82a243d2_rle_crop_3926797469_0.png treat image : temp/1755904828_1263224_1378540604_fb6bd529f86d682cd71d1ad44f197b7f_rle_crop_3926797476_0.png treat image : temp/1755904828_1263224_1378540603_8df780ac81df91d939b2e753bfb7a588_rle_crop_3926797482_0.png treat image : temp/1755904828_1263224_1378540823_70aabd4b50b4617bb616300bbc0de7fa_rle_crop_3926797451_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 84 time used for this insertion : 0.020354270935058594 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 84 time used for this insertion : 0.01898956298828125 save missing photos in datou_result : time spend for datou_step_exec : 2.9861414432525635 time spend to save output : 0.04593300819396973 total time spend for step 7 : 3.032074451446533 step8:velours_tree Sat Aug 23 01:21:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.20108914375305176 time spend to save output : 4.696846008300781e-05 total time spend for step 8 : 0.20113611221313477 step9:send_mail_cod Sat Aug 23 01:21:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26164720_23-08-2025_01_21_57.pdf 26166347 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette261663471755904917 26166348 change filename to text .imagette261663481755904917 26166349 imagette261663491755904918 26166350 imagette261663501755904918 26166351 change filename to text .imagette261663511755904918 26166352 imagette261663521755904918 26166353 imagette261663531755904918 26166354 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette261663541755904918 26166356 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette261663561755904918 26166357 imagette261663571755904919 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26164720 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26166347,26166348,26166349,26166350,26166351,26166352,26166353,26166354,26166355,26166356,26166357?tags=pet_clair,metal,mal_croppe,pehd,autre,flou,background,carton,environnement,papier,pet_fonce args[1378540976] : ((1378540976, -0.013088670736868238, 492688767), (1378540976, 0.5887434906203303, 2107752395), '0.029932707146248815') We are sending mail with results at report@fotonower.com args[1378540840] : ((1378540840, 0.2245407570446669, 492688767), (1378540840, 0.6044282007486099, 2107752395), '0.029932707146248815') We are sending mail with results at report@fotonower.com args[1378540839] : ((1378540839, -0.08352620636220458, 492688767), (1378540839, 0.6124319116391964, 2107752395), '0.029932707146248815') We are sending mail with results at report@fotonower.com args[1378540823] : ((1378540823, -0.6792614937119791, 492688767), (1378540823, 0.45452054588914115, 2107752395), '0.029932707146248815') We are sending mail with results at report@fotonower.com args[1378540814] : ((1378540814, 0.902874651632766, 492688767), (1378540814, 0.4877067059700941, 2107752395), '0.029932707146248815') We are sending mail with results at report@fotonower.com args[1378540781] : ((1378540781, 0.3661220425264158, 492688767), (1378540781, 0.44872748636529336, 2107752395), '0.029932707146248815') We are sending mail with results at report@fotonower.com args[1378540760] : ((1378540760, 0.7052259153121859, 492688767), (1378540760, 0.6203042282323539, 2107752395), '0.029932707146248815') We are sending mail with results at report@fotonower.com args[1378540646] : ((1378540646, -0.3568349845690518, 492688767), (1378540646, 0.5148071156832497, 2107752395), '0.029932707146248815') We are sending mail with results at report@fotonower.com args[1378540620] : ((1378540620, 0.5498324347698481, 492688767), (1378540620, 0.28009682099546346, 2107752395), '0.029932707146248815') We are sending mail with results at report@fotonower.com args[1378540605] : ((1378540605, 0.5942030419330723, 492688767), (1378540605, 0.5449710297780945, 2107752395), '0.029932707146248815') We are sending mail with results at report@fotonower.com args[1378540604] : ((1378540604, 2.68806394216363, 492688767), (1378540604, 0.28182492038036044, 2107752395), '0.029932707146248815') We are sending mail with results at report@fotonower.com args[1378540603] : ((1378540603, 0.2058586259696203, 492688767), (1378540603, 0.8593636558735102, 2107752395), '0.029932707146248815') We are sending mail with results at report@fotonower.com args[1378540598] : ((1378540598, 1.3251976355851145, 492688767), (1378540598, 0.562027554954881, 2107752395), '0.029932707146248815') We are sending mail with results at report@fotonower.com refus_total : 0.029932707146248815 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26164720 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26164720_23-08-2025_01_21_57.pdf results_Auto_P26164720_23-08-2025_01_21_57.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26164720_23-08-2025_01_21_57.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26164720','results_Auto_P26164720_23-08-2025_01_21_57.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26164720_23-08-2025_01_21_57.pdf','pdf','','0.18','0.029932707146248815') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26164720

https://www.fotonower.com/image?json=false&list_photos_id=1378540976
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378540840
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378540839
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378540823
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378540814
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378540781
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378540760
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378540646
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378540620
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378540605
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378540604
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.68806394216363)
https://www.fotonower.com/image?json=false&list_photos_id=1378540603
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378540598
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.3251976355851145)

Dans ces conditions,le taux de refus est: 2.99%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/26166347?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26166348?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26166351?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26166354?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26166356?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26164720_23-08-2025_01_21_57.pdf.

Lien vers velours :https://www.fotonower.com/velours/26166347,26166348,26166349,26166350,26166351,26166352,26166353,26166354,26166355,26166356,26166357?tags=pet_clair,metal,mal_croppe,pehd,autre,flou,background,carton,environnement,papier,pet_fonce.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 22 Aug 2025 23:22:01 GMT Content-Length: 0 Connection: close X-Message-Id: uBoJEDVSSGO9asy4Uidpyw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1378540976, 1378540840, 1378540839, 1378540823, 1378540814, 1378540781, 1378540760, 1378540646, 1378540620, 1378540605, 1378540604, 1378540603, 1378540598] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540976', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540840', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540839', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540823', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540814', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540781', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540760', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540646', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540620', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540605', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540604', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540603', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540598', None, None, None, None, None, '3579195') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.07427668571472168 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.7629828453063965 time spend to save output : 0.07457709312438965 total time spend for step 9 : 3.837559938430786 step10:split_time_score Sat Aug 23 01:22:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 13),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 22082025 26164720 Nombre de photos uploadées : 13 / 23040 (0%) 22082025 26164720 Nombre de photos taguées (types de déchets): 0 / 13 (0%) 22082025 26164720 Nombre de photos taguées (volume) : 0 / 13 (0%) elapsed_time : load_data_split_time_score 3.814697265625e-06 elapsed_time : order_list_meta_photo_and_scores 1.2159347534179688e-05 ????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007283687591552734 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.1987757682800293 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.053570387517146746 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26141104_22-08-2025_09_21_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26141104 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26141104 AND mptpi.`type`=3594 To do Qualite : 0.16548168572984748 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26143316_22-08-2025_10_12_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26143316 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26143316 AND mptpi.`type`=3594 To do Qualite : 0.16004099151234566 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26143317_22-08-2025_10_01_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26143317 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26143317 AND mptpi.`type`=3594 To do Qualite : 0.1262686011904762 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26143318_22-08-2025_09_51_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26143318 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26143318 AND mptpi.`type`=3594 To do Qualite : 0.062375230409808004 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26143320_22-08-2025_11_12_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26143320 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26143320 AND mptpi.`type`=3594 To do Qualite : 0.08817406925154322 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26144654_22-08-2025_12_01_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26144654 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26144654 AND mptpi.`type`=3594 To do Qualite : 0.023325424382716047 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26144656_22-08-2025_11_51_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26144656 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26144656 AND mptpi.`type`=3594 To do Qualite : 0.21387386485042736 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26145859_22-08-2025_11_22_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26145859 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26145859 AND mptpi.`type`=3594 To do Qualite : 0.029932707146248815 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26164720_23-08-2025_01_21_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26164720 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26164720 AND mptpi.`type`=3594 To do Qualite : 0.22931479255698012 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26164724_23-08-2025_01_12_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26164724 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26164724 AND mptpi.`type`=3594 To do Qualite : 0.12674397554605885 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26164725_23-08-2025_01_01_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26164725 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26164725 AND mptpi.`type`=3594 To do Qualite : 0.16831627363040122 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26164729_23-08-2025_00_51_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26164729 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26164729 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26164731 order by id desc limit 1 Qualite : 0.1956407455632716 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26164736_23-08-2025_00_32_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26164736 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26164736 AND mptpi.`type`=3594 To do Qualite : 0.13695674189814816 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26164772_23-08-2025_00_21_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26164772 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26164772 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'22082025': {'nb_upload': 13, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1378540976, 1378540840, 1378540839, 1378540823, 1378540814, 1378540781, 1378540760, 1378540646, 1378540620, 1378540605, 1378540604, 1378540603, 1378540598] Looping around the photos to save general results len do output : 1 /26164720Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540976', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540840', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540839', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540823', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540814', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540781', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540760', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540646', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540620', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540605', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540604', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540603', None, None, None, None, None, '3579195') ('3318', None, None, None, None, None, None, None, '3579195') ('3318', '26164720', '1378540598', None, None, None, None, None, '3579195') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.019604921340942383 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.123162269592285 time spend to save output : 0.019829511642456055 total time spend for step 10 : 2.142991781234741 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 13 set_done_treatment 41.61user 30.12system 1:37.74elapsed 73%CPU (0avgtext+0avgdata 3137464maxresident)k 599472inputs+14576outputs (817major+1932780minor)pagefaults 0swaps