python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 573959 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3436450'] with mtr_portfolio_ids : ['25646331'] and first list_photo_ids : [] new path : /proc/573959/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 18 ; length of list_pids : 18 ; length of list_args : 18 time to download the photos : 2.3323590755462646 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Aug 4 20:30:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10957 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-04 20:30:34.979586: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-04 20:30:35.007417: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-08-04 20:30:35.009600: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f2148000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-04 20:30:35.009657: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-04 20:30:35.013691: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-04 20:30:35.141580: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3a81a9d0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-04 20:30:35.141627: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-04 20:30:35.143084: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-04 20:30:35.143511: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-04 20:30:35.146763: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-04 20:30:35.149851: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-04 20:30:35.150365: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-04 20:30:35.153112: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-04 20:30:35.154193: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-04 20:30:35.158756: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-04 20:30:35.160285: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-04 20:30:35.160363: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-04 20:30:35.161130: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-04 20:30:35.161146: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-04 20:30:35.161155: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-04 20:30:35.162481: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10011 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-04 20:30:35.416108: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-04 20:30:35.416234: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-04 20:30:35.416251: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-04 20:30:35.416266: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-04 20:30:35.416280: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-04 20:30:35.416293: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-04 20:30:35.416307: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-04 20:30:35.416321: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-04 20:30:35.417525: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-04 20:30:35.418715: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-04 20:30:35.418748: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-04 20:30:35.418766: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-04 20:30:35.418782: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-04 20:30:35.418798: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-04 20:30:35.418814: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-04 20:30:35.418832: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-04 20:30:35.418848: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-04 20:30:35.420082: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-04 20:30:35.420117: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-04 20:30:35.420125: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-04 20:30:35.420133: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-04 20:30:35.421370: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10011 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-04 20:30:45.386894: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-04 20:30:45.565528: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 18 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 Detection mask done ! Trying to reset tf kernel 574778 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1089 tf kernel not reseted sub process len(results) : 18 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 18 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6144 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0005278587341308594 nb_pixel_total : 18718 time to create 1 rle with old method : 0.02196192741394043 length of segment : 131 time for calcul the mask position with numpy : 0.00011324882507324219 nb_pixel_total : 4771 time to create 1 rle with old method : 0.005740165710449219 length of segment : 62 time for calcul the mask position with numpy : 0.0002372264862060547 nb_pixel_total : 13171 time to create 1 rle with old method : 0.015354633331298828 length of segment : 131 time for calcul the mask position with numpy : 0.011147499084472656 nb_pixel_total : 713803 time to create 1 rle with new method : 0.04562568664550781 length of segment : 934 time for calcul the mask position with numpy : 0.0014247894287109375 nb_pixel_total : 105473 time to create 1 rle with old method : 0.1163930892944336 length of segment : 532 time for calcul the mask position with numpy : 9.632110595703125e-05 nb_pixel_total : 4108 time to create 1 rle with old method : 0.004876852035522461 length of segment : 55 time for calcul the mask position with numpy : 0.010442495346069336 nb_pixel_total : 769541 time to create 1 rle with new method : 0.024624347686767578 length of segment : 1000 time for calcul the mask position with numpy : 0.000141143798828125 nb_pixel_total : 7431 time to create 1 rle with old method : 0.008607149124145508 length of segment : 105 time for calcul the mask position with numpy : 0.00018596649169921875 nb_pixel_total : 11001 time to create 1 rle with old method : 0.012934684753417969 length of segment : 90 time for calcul the mask position with numpy : 0.000118255615234375 nb_pixel_total : 6036 time to create 1 rle with old method : 0.006894350051879883 length of segment : 113 time for calcul the mask position with numpy : 0.00030732154846191406 nb_pixel_total : 11943 time to create 1 rle with old method : 0.013729333877563477 length of segment : 302 time for calcul the mask position with numpy : 0.001714468002319336 nb_pixel_total : 100920 time to create 1 rle with old method : 0.12841057777404785 length of segment : 527 time for calcul the mask position with numpy : 0.06379413604736328 nb_pixel_total : 1471633 time to create 1 rle with new method : 0.05781960487365723 length of segment : 1273 time for calcul the mask position with numpy : 0.00019979476928710938 nb_pixel_total : 3722 time to create 1 rle with old method : 0.004279136657714844 length of segment : 80 time for calcul the mask position with numpy : 0.003750324249267578 nb_pixel_total : 105360 time to create 1 rle with old method : 0.12369751930236816 length of segment : 491 time for calcul the mask position with numpy : 0.00010991096496582031 nb_pixel_total : 1603 time to create 1 rle with old method : 0.0020351409912109375 length of segment : 36 time for calcul the mask position with numpy : 0.01702594757080078 nb_pixel_total : 795100 time to create 1 rle with new method : 0.025424718856811523 length of segment : 1182 time for calcul the mask position with numpy : 0.0001938343048095703 nb_pixel_total : 3709 time to create 1 rle with old method : 0.00445246696472168 length of segment : 86 time for calcul the mask position with numpy : 0.0002617835998535156 nb_pixel_total : 6051 time to create 1 rle with old method : 0.007078647613525391 length of segment : 143 time for calcul the mask position with numpy : 0.00042819976806640625 nb_pixel_total : 10463 time to create 1 rle with old method : 0.012307405471801758 length of segment : 211 time for calcul the mask position with numpy : 0.00037407875061035156 nb_pixel_total : 8382 time to create 1 rle with old method : 0.0099639892578125 length of segment : 210 time for calcul the mask position with numpy : 0.00029087066650390625 nb_pixel_total : 10104 time to create 1 rle with old method : 0.012186050415039062 length of segment : 87 time for calcul the mask position with numpy : 0.014754772186279297 nb_pixel_total : 919176 time to create 1 rle with new method : 0.024148941040039062 length of segment : 1607 time for calcul the mask position with numpy : 0.014027118682861328 nb_pixel_total : 747474 time to create 1 rle with new method : 0.019980192184448242 length of segment : 951 time for calcul the mask position with numpy : 0.0005567073822021484 nb_pixel_total : 18226 time to create 1 rle with old method : 0.021574020385742188 length of segment : 203 time for calcul the mask position with numpy : 0.021662473678588867 nb_pixel_total : 784189 time to create 1 rle with new method : 0.030283689498901367 length of segment : 1015 time for calcul the mask position with numpy : 0.00046253204345703125 nb_pixel_total : 11668 time to create 1 rle with old method : 0.013483047485351562 length of segment : 154 time for calcul the mask position with numpy : 0.0003895759582519531 nb_pixel_total : 14252 time to create 1 rle with old method : 0.016718149185180664 length of segment : 121 time for calcul the mask position with numpy : 0.000152587890625 nb_pixel_total : 1794 time to create 1 rle with old method : 0.002190828323364258 length of segment : 57 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 1114 time to create 1 rle with old method : 0.0013811588287353516 length of segment : 57 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 1895 time to create 1 rle with old method : 0.002404451370239258 length of segment : 41 time for calcul the mask position with numpy : 0.00019788742065429688 nb_pixel_total : 2698 time to create 1 rle with old method : 0.003441333770751953 length of segment : 82 time for calcul the mask position with numpy : 0.0003795623779296875 nb_pixel_total : 8955 time to create 1 rle with old method : 0.010648965835571289 length of segment : 102 time for calcul the mask position with numpy : 0.00046133995056152344 nb_pixel_total : 7489 time to create 1 rle with old method : 0.008880138397216797 length of segment : 154 time for calcul the mask position with numpy : 0.00018644332885742188 nb_pixel_total : 2328 time to create 1 rle with old method : 0.0028786659240722656 length of segment : 50 time for calcul the mask position with numpy : 9.918212890625e-05 nb_pixel_total : 972 time to create 1 rle with old method : 0.0012066364288330078 length of segment : 47 time for calcul the mask position with numpy : 0.002771139144897461 nb_pixel_total : 107622 time to create 1 rle with old method : 0.11884593963623047 length of segment : 502 time for calcul the mask position with numpy : 0.001112222671508789 nb_pixel_total : 25872 time to create 1 rle with old method : 0.027863025665283203 length of segment : 390 time for calcul the mask position with numpy : 0.0004494190216064453 nb_pixel_total : 13301 time to create 1 rle with old method : 0.014548301696777344 length of segment : 189 time for calcul the mask position with numpy : 0.019213438034057617 nb_pixel_total : 1037188 time to create 1 rle with new method : 0.048980712890625 length of segment : 1804 time for calcul the mask position with numpy : 0.002630949020385742 nb_pixel_total : 110891 time to create 1 rle with old method : 0.11969876289367676 length of segment : 530 time for calcul the mask position with numpy : 0.0002892017364501953 nb_pixel_total : 5840 time to create 1 rle with old method : 0.006675243377685547 length of segment : 76 time for calcul the mask position with numpy : 0.0159456729888916 nb_pixel_total : 781270 time to create 1 rle with new method : 0.026490211486816406 length of segment : 1415 time for calcul the mask position with numpy : 0.00021886825561523438 nb_pixel_total : 4263 time to create 1 rle with old method : 0.008478164672851562 length of segment : 140 time for calcul the mask position with numpy : 0.0007145404815673828 nb_pixel_total : 15024 time to create 1 rle with old method : 0.029011249542236328 length of segment : 171 time for calcul the mask position with numpy : 0.0007305145263671875 nb_pixel_total : 21223 time to create 1 rle with old method : 0.028703927993774414 length of segment : 172 time for calcul the mask position with numpy : 0.0023543834686279297 nb_pixel_total : 113593 time to create 1 rle with old method : 0.13116860389709473 length of segment : 519 time for calcul the mask position with numpy : 0.0003466606140136719 nb_pixel_total : 8947 time to create 1 rle with old method : 0.010730266571044922 length of segment : 122 time for calcul the mask position with numpy : 0.0006184577941894531 nb_pixel_total : 31384 time to create 1 rle with old method : 0.036745548248291016 length of segment : 200 time for calcul the mask position with numpy : 0.0004138946533203125 nb_pixel_total : 13582 time to create 1 rle with old method : 0.016236066818237305 length of segment : 150 time for calcul the mask position with numpy : 0.00020885467529296875 nb_pixel_total : 6690 time to create 1 rle with old method : 0.008029699325561523 length of segment : 93 time for calcul the mask position with numpy : 0.000213623046875 nb_pixel_total : 5588 time to create 1 rle with old method : 0.0069234371185302734 length of segment : 73 time for calcul the mask position with numpy : 0.0007171630859375 nb_pixel_total : 25285 time to create 1 rle with old method : 0.029328584671020508 length of segment : 194 time for calcul the mask position with numpy : 0.0005285739898681641 nb_pixel_total : 22780 time to create 1 rle with old method : 0.026844024658203125 length of segment : 127 time for calcul the mask position with numpy : 0.017687559127807617 nb_pixel_total : 729990 time to create 1 rle with new method : 0.025727272033691406 length of segment : 1092 time spent for convertir_results : 4.719254493713379 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 55 chid ids of type : 3594 Number RLEs to save : 20381 save missing photos in datou_result : time spend for datou_step_exec : 31.342546224594116 time spend to save output : 1.1962316036224365 total time spend for step 1 : 32.53877782821655 step2:crop_condition Mon Aug 4 20:31:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 18 ! batch 1 Loaded 55 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754332266_573959 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.77899694442749 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754332271_573959 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.8638546466827393 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754332274_573959 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.73978590965271 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 25 About to insert : list_path_to_insert length 25 new photo from crops ! About to upload 25 photos upload in portfolio : 3736932 init cache_photo without model_param we have 25 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754332313_573959 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 25 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.522689342498779 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754332322_573959 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.1741185188293457 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1375138635, 1375138634, 1375138632, 1375138629, 1375138626, 1375138624, 1375138608, 1375138607, 1375138604, 1375138602, 1375138600, 1375138599, 1375138577, 1375138576, 1375138573, 1375138571, 1375138569, 1375138568] Looping around the photos to save general results len do output : 55 /1375156817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375156896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138635', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138634', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138632', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138629', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138626', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138624', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138608', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138607', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138604', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138602', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138600', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138599', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138577', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138576', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138573', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138571', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138569', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138568', None, None, None, None, None, '3436450') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 183 time used for this insertion : 0.024492502212524414 save_final save missing photos in datou_result : time spend for datou_step_exec : 59.03456974029541 time spend to save output : 0.0270540714263916 total time spend for step 2 : 59.0616238117218 step3:rle_unique_nms_with_priority Mon Aug 4 20:32:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 55 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.6370618343353271 time for calcul the mask position with numpy : 0.07599043846130371 nb_pixel_total : 1323137 time to create 1 rle with new method : 0.18802523612976074 time for calcul the mask position with numpy : 0.012851715087890625 nb_pixel_total : 713803 time to create 1 rle with new method : 0.136338472366333 time for calcul the mask position with numpy : 0.006908893585205078 nb_pixel_total : 13171 time to create 1 rle with old method : 0.015136957168579102 time for calcul the mask position with numpy : 0.006287336349487305 nb_pixel_total : 4771 time to create 1 rle with old method : 0.005484104156494141 time for calcul the mask position with numpy : 0.006363391876220703 nb_pixel_total : 18718 time to create 1 rle with old method : 0.02118682861328125 create new chi : 0.49268651008605957 time to delete rle : 0.022002696990966797 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3596 TO DO : save crop sub photo not yet done ! save time : 0.26183271408081055 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.4331984519958496 time for calcul the mask position with numpy : 0.13596606254577637 nb_pixel_total : 1194478 time to create 1 rle with new method : 0.18405890464782715 time for calcul the mask position with numpy : 0.012575149536132812 nb_pixel_total : 769541 time to create 1 rle with new method : 0.11702251434326172 time for calcul the mask position with numpy : 0.0068624019622802734 nb_pixel_total : 4108 time to create 1 rle with old method : 0.004776477813720703 time for calcul the mask position with numpy : 0.0073070526123046875 nb_pixel_total : 105473 time to create 1 rle with old method : 0.11854028701782227 create new chi : 0.5960826873779297 time to delete rle : 0.0007860660552978516 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 4254 TO DO : save crop sub photo not yet done ! save time : 0.29958343505859375 nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 0.47935032844543457 time for calcul the mask position with numpy : 0.11921548843383789 nb_pixel_total : 1936269 time to create 1 rle with new method : 0.2633225917816162 time for calcul the mask position with numpy : 0.008621692657470703 nb_pixel_total : 100920 time to create 1 rle with old method : 0.12009906768798828 time for calcul the mask position with numpy : 0.0068206787109375 nb_pixel_total : 11943 time to create 1 rle with old method : 0.013647079467773438 time for calcul the mask position with numpy : 0.006636142730712891 nb_pixel_total : 6036 time to create 1 rle with old method : 0.006768465042114258 time for calcul the mask position with numpy : 0.0068340301513671875 nb_pixel_total : 11001 time to create 1 rle with old method : 0.01238870620727539 time for calcul the mask position with numpy : 0.0070798397064208984 nb_pixel_total : 7431 time to create 1 rle with old method : 0.008651018142700195 create new chi : 0.5954685211181641 time to delete rle : 0.0005843639373779297 batch 1 Loaded 11 chid ids of type : 3594 ++++++++Number RLEs to save : 3354 TO DO : save crop sub photo not yet done ! save time : 0.2477097511291504 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.05353736877441406 time for calcul the mask position with numpy : 0.012504816055297852 nb_pixel_total : 601967 time to create 1 rle with new method : 0.03714275360107422 time for calcul the mask position with numpy : 0.020748615264892578 nb_pixel_total : 1471633 time to create 1 rle with new method : 0.033655405044555664 create new chi : 0.10459351539611816 time to delete rle : 0.0004000663757324219 batch 1 Loaded 4 chid ids of type : 3594 ++++Number RLEs to save : 3626 TO DO : save crop sub photo not yet done ! save time : 0.25102949142456055 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.07616519927978516 time for calcul the mask position with numpy : 0.935338020324707 nb_pixel_total : 1171537 time to create 1 rle with new method : 0.13005781173706055 time for calcul the mask position with numpy : 0.013334035873413086 nb_pixel_total : 795100 time to create 1 rle with new method : 0.26445746421813965 time for calcul the mask position with numpy : 0.006004810333251953 nb_pixel_total : 1603 time to create 1 rle with old method : 0.001857757568359375 time for calcul the mask position with numpy : 0.007027626037597656 nb_pixel_total : 105360 time to create 1 rle with old method : 0.1188497543334961 create new chi : 1.4957778453826904 time to delete rle : 0.0007529258728027344 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 4498 TO DO : save crop sub photo not yet done ! save time : 0.29682087898254395 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04825091361999512 time for calcul the mask position with numpy : 0.13602757453918457 nb_pixel_total : 2053377 time to create 1 rle with new method : 0.10972785949707031 time for calcul the mask position with numpy : 0.0063321590423583984 nb_pixel_total : 10463 time to create 1 rle with old method : 0.011960506439208984 time for calcul the mask position with numpy : 0.006114959716796875 nb_pixel_total : 6051 time to create 1 rle with old method : 0.01716923713684082 time for calcul the mask position with numpy : 0.005994319915771484 nb_pixel_total : 3709 time to create 1 rle with old method : 0.004205465316772461 create new chi : 0.3083949089050293 time to delete rle : 0.00034689903259277344 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1960 TO DO : save crop sub photo not yet done ! save time : 0.14222931861877441 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.17872881889343262 time for calcul the mask position with numpy : 0.052692413330078125 nb_pixel_total : 1150180 time to create 1 rle with new method : 0.22225666046142578 time for calcul the mask position with numpy : 0.01203298568725586 nb_pixel_total : 904934 time to create 1 rle with new method : 0.09984922409057617 time for calcul the mask position with numpy : 0.006261348724365234 nb_pixel_total : 10104 time to create 1 rle with old method : 0.01104283332824707 time for calcul the mask position with numpy : 0.006361961364746094 nb_pixel_total : 8382 time to create 1 rle with old method : 0.009399890899658203 create new chi : 0.42978978157043457 time to delete rle : 0.0007660388946533203 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 4805 TO DO : save crop sub photo not yet done ! save time : 0.3190169334411621 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04804825782775879 time for calcul the mask position with numpy : 0.017747163772583008 nb_pixel_total : 1326126 time to create 1 rle with new method : 0.20532441139221191 time for calcul the mask position with numpy : 0.011945724487304688 nb_pixel_total : 747474 time to create 1 rle with new method : 0.07085752487182617 create new chi : 0.31355810165405273 time to delete rle : 0.00036215782165527344 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2982 TO DO : save crop sub photo not yet done ! save time : 0.19965076446533203 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.42510366439819336 time for calcul the mask position with numpy : 0.19939064979553223 nb_pixel_total : 1271185 time to create 1 rle with new method : 0.21816420555114746 time for calcul the mask position with numpy : 0.01797342300415039 nb_pixel_total : 784189 time to create 1 rle with new method : 0.12088298797607422 time for calcul the mask position with numpy : 0.009357213973999023 nb_pixel_total : 18226 time to create 1 rle with old method : 0.020424842834472656 create new chi : 0.596311092376709 time to delete rle : 0.0008442401885986328 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 3516 TO DO : save crop sub photo not yet done ! save time : 0.256925106048584 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.0831451416015625 time for calcul the mask position with numpy : 0.018584728240966797 nb_pixel_total : 2047680 time to create 1 rle with new method : 0.19778776168823242 time for calcul the mask position with numpy : 0.006620883941650391 nb_pixel_total : 14252 time to create 1 rle with old method : 0.016040325164794922 time for calcul the mask position with numpy : 0.006139039993286133 nb_pixel_total : 11668 time to create 1 rle with old method : 0.012797355651855469 create new chi : 0.2689237594604492 time to delete rle : 0.00030994415283203125 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1630 TO DO : save crop sub photo not yet done ! save time : 0.14032411575317383 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.24552392959594727 time for calcul the mask position with numpy : 0.19257593154907227 nb_pixel_total : 2066099 time to create 1 rle with new method : 0.12604975700378418 time for calcul the mask position with numpy : 0.006215095520019531 nb_pixel_total : 2698 time to create 1 rle with old method : 0.003081798553466797 time for calcul the mask position with numpy : 0.010016679763793945 nb_pixel_total : 1895 time to create 1 rle with old method : 0.0021305084228515625 time for calcul the mask position with numpy : 0.01051640510559082 nb_pixel_total : 1114 time to create 1 rle with old method : 0.0012116432189941406 time for calcul the mask position with numpy : 0.010495185852050781 nb_pixel_total : 1794 time to create 1 rle with old method : 0.0020961761474609375 create new chi : 0.37657952308654785 time to delete rle : 0.0004150867462158203 batch 1 Loaded 9 chid ids of type : 3594 +++++++Number RLEs to save : 1554 TO DO : save crop sub photo not yet done ! save time : 0.14593100547790527 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.11726808547973633 time for calcul the mask position with numpy : 0.08455586433410645 nb_pixel_total : 2053856 time to create 1 rle with new method : 0.1553184986114502 time for calcul the mask position with numpy : 0.006079196929931641 nb_pixel_total : 972 time to create 1 rle with old method : 0.0011255741119384766 time for calcul the mask position with numpy : 0.005929708480834961 nb_pixel_total : 2328 time to create 1 rle with old method : 0.0026960372924804688 time for calcul the mask position with numpy : 0.005867719650268555 nb_pixel_total : 7489 time to create 1 rle with old method : 0.008281469345092773 time for calcul the mask position with numpy : 0.006057024002075195 nb_pixel_total : 8955 time to create 1 rle with old method : 0.009684324264526367 create new chi : 0.29633331298828125 time to delete rle : 0.00036072731018066406 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1786 TO DO : save crop sub photo not yet done ! save time : 0.1569349765777588 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 0.0758366584777832 time for calcul the mask position with numpy : 0.0166778564453125 nb_pixel_total : 889741 time to create 1 rle with new method : 0.20568108558654785 time for calcul the mask position with numpy : 0.025634288787841797 nb_pixel_total : 1037064 time to create 1 rle with new method : 0.07067155838012695 time for calcul the mask position with numpy : 0.006819009780883789 nb_pixel_total : 13301 time to create 1 rle with old method : 0.015111684799194336 time for calcul the mask position with numpy : 0.006272554397583008 nb_pixel_total : 25872 time to create 1 rle with old method : 0.02940988540649414 time for calcul the mask position with numpy : 0.007004261016845703 nb_pixel_total : 107622 time to create 1 rle with old method : 0.12009477615356445 create new chi : 0.5123462677001953 time to delete rle : 0.0010497570037841797 batch 1 Loaded 9 chid ids of type : 3594 +++++++++++Number RLEs to save : 6829 TO DO : save crop sub photo not yet done ! save time : 0.4239192008972168 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.07754254341125488 time for calcul the mask position with numpy : 0.1834099292755127 nb_pixel_total : 1171547 time to create 1 rle with new method : 0.11532425880432129 time for calcul the mask position with numpy : 0.010372638702392578 nb_pixel_total : 4263 time to create 1 rle with old method : 0.004854440689086914 time for calcul the mask position with numpy : 0.018730878829956055 nb_pixel_total : 781059 time to create 1 rle with new method : 0.15410637855529785 time for calcul the mask position with numpy : 0.006644010543823242 nb_pixel_total : 5840 time to create 1 rle with old method : 0.00670623779296875 time for calcul the mask position with numpy : 0.007341146469116211 nb_pixel_total : 110891 time to create 1 rle with old method : 0.1247568130493164 create new chi : 0.6426119804382324 time to delete rle : 0.000904083251953125 batch 1 Loaded 9 chid ids of type : 3594 +++++++Number RLEs to save : 5390 TO DO : save crop sub photo not yet done ! save time : 0.3453974723815918 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.05891108512878418 time for calcul the mask position with numpy : 0.029349088668823242 nb_pixel_total : 2058576 time to create 1 rle with new method : 0.03495621681213379 time for calcul the mask position with numpy : 0.006467103958129883 nb_pixel_total : 15024 time to create 1 rle with old method : 0.017182111740112305 create new chi : 0.09556221961975098 time to delete rle : 0.00030231475830078125 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1422 TO DO : save crop sub photo not yet done ! save time : 0.13135600090026855 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.2165687084197998 time for calcul the mask position with numpy : 0.08577919006347656 nb_pixel_total : 1898453 time to create 1 rle with new method : 0.2326047420501709 time for calcul the mask position with numpy : 0.006999969482421875 nb_pixel_total : 31384 time to create 1 rle with old method : 0.05361342430114746 time for calcul the mask position with numpy : 0.007571697235107422 nb_pixel_total : 8947 time to create 1 rle with old method : 0.011058568954467773 time for calcul the mask position with numpy : 0.006966829299926758 nb_pixel_total : 113593 time to create 1 rle with old method : 0.130934476852417 time for calcul the mask position with numpy : 0.01077890396118164 nb_pixel_total : 21223 time to create 1 rle with old method : 0.023895263671875 create new chi : 0.5839316844940186 time to delete rle : 0.0006556510925292969 batch 1 Loaded 9 chid ids of type : 3594 +++++++Number RLEs to save : 3106 TO DO : save crop sub photo not yet done ! save time : 0.23036646842956543 nb_obj : 4 nb_hashtags : 4 time to prepare the origin masks : 0.13847947120666504 time for calcul the mask position with numpy : 0.08991003036499023 nb_pixel_total : 2022455 time to create 1 rle with new method : 0.17666912078857422 time for calcul the mask position with numpy : 0.006413698196411133 nb_pixel_total : 25285 time to create 1 rle with old method : 0.028409719467163086 time for calcul the mask position with numpy : 0.006280183792114258 nb_pixel_total : 5588 time to create 1 rle with old method : 0.0064849853515625 time for calcul the mask position with numpy : 0.0061609745025634766 nb_pixel_total : 6690 time to create 1 rle with old method : 0.007563591003417969 time for calcul the mask position with numpy : 0.00633692741394043 nb_pixel_total : 13582 time to create 1 rle with old method : 0.01539158821105957 create new chi : 0.3605220317840576 time to delete rle : 0.0003800392150878906 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2100 TO DO : save crop sub photo not yet done ! save time : 0.17167878150939941 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04729938507080078 time for calcul the mask position with numpy : 0.01822948455810547 nb_pixel_total : 1320830 time to create 1 rle with new method : 0.23564362525939941 time for calcul the mask position with numpy : 0.014808893203735352 nb_pixel_total : 729990 time to create 1 rle with new method : 0.03233504295349121 time for calcul the mask position with numpy : 0.0069463253021240234 nb_pixel_total : 22780 time to create 1 rle with old method : 0.03898310661315918 create new chi : 0.3475921154022217 time to delete rle : 0.0008153915405273438 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 3518 TO DO : save crop sub photo not yet done ! save time : 0.2545146942138672 map_output_result : {1375138635: (0.0, 'Should be the crop_list due to order', 0), 1375138634: (0.0, 'Should be the crop_list due to order', 0), 1375138632: (0.0, 'Should be the crop_list due to order', 0), 1375138629: (0.0, 'Should be the crop_list due to order', 0), 1375138626: (0.0, 'Should be the crop_list due to order', 0), 1375138624: (0.0, 'Should be the crop_list due to order', 0), 1375138608: (0.0, 'Should be the crop_list due to order', 0), 1375138607: (0.0, 'Should be the crop_list due to order', 0), 1375138604: (0.0, 'Should be the crop_list due to order', 0), 1375138602: (0.0, 'Should be the crop_list due to order', 0), 1375138600: (0.0, 'Should be the crop_list due to order', 0), 1375138599: (0.0, 'Should be the crop_list due to order', 0), 1375138577: (0.0, 'Should be the crop_list due to order', 0), 1375138576: (0.0, 'Should be the crop_list due to order', 0), 1375138573: (0.0, 'Should be the crop_list due to order', 0), 1375138571: (0.0, 'Should be the crop_list due to order', 0), 1375138569: (0.0, 'Should be the crop_list due to order', 0), 1375138568: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1375138635, 1375138634, 1375138632, 1375138629, 1375138626, 1375138624, 1375138608, 1375138607, 1375138604, 1375138602, 1375138600, 1375138599, 1375138577, 1375138576, 1375138573, 1375138571, 1375138569, 1375138568] Looping around the photos to save general results len do output : 18 /1375138635.Didn't retrieve data . /1375138634.Didn't retrieve data . /1375138632.Didn't retrieve data . /1375138629.Didn't retrieve data . /1375138626.Didn't retrieve data . /1375138624.Didn't retrieve data . /1375138608.Didn't retrieve data . /1375138607.Didn't retrieve data . /1375138604.Didn't retrieve data . /1375138602.Didn't retrieve data . /1375138600.Didn't retrieve data . /1375138599.Didn't retrieve data . /1375138577.Didn't retrieve data . /1375138576.Didn't retrieve data . /1375138573.Didn't retrieve data . /1375138571.Didn't retrieve data . /1375138569.Didn't retrieve data . /1375138568.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138635', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138634', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138632', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138629', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138626', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138624', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138608', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138607', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138604', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138602', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138600', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138599', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138577', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138576', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138573', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138571', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138569', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138568', None, None, None, None, None, '3436450') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 54 time used for this insertion : 0.020989179611206055 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.819077491760254 time spend to save output : 0.021968603134155273 total time spend for step 3 : 16.84104609489441 step4:ventilate_hashtags_in_portfolio Mon Aug 4 20:32:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25646331 get user id for portfolio 25646331 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25646331 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','pet_fonce','papier','metal','background','pehd','mal_croppe','flou','autre','carton','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25646331 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','pet_fonce','papier','metal','background','pehd','mal_croppe','flou','autre','carton','environnement')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25646331 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','pet_fonce','papier','metal','background','pehd','mal_croppe','flou','autre','carton','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25649215,25649216,25649217,25649218,25649219,25649220,25649221,25649222,25649223,25649224,25649225?tags=pet_clair,pet_fonce,papier,metal,background,pehd,mal_croppe,flou,autre,carton,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1375138635, 1375138634, 1375138632, 1375138629, 1375138626, 1375138624, 1375138608, 1375138607, 1375138604, 1375138602, 1375138600, 1375138599, 1375138577, 1375138576, 1375138573, 1375138571, 1375138569, 1375138568] Looping around the photos to save general results len do output : 1 /25646331. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138635', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138634', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138632', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138629', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138626', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138624', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138608', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138607', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138604', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138602', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138600', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138599', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138577', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138576', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138573', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138571', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138569', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138568', None, None, None, None, None, '3436450') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 19 time used for this insertion : 0.015660524368286133 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7180483341217041 time spend to save output : 0.015991687774658203 total time spend for step 4 : 0.7340400218963623 step5:final Mon Aug 4 20:32:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1375138635: ('0.26168410815329224',), 1375138634: ('0.26168410815329224',), 1375138632: ('0.26168410815329224',), 1375138629: ('0.26168410815329224',), 1375138626: ('0.26168410815329224',), 1375138624: ('0.26168410815329224',), 1375138608: ('0.26168410815329224',), 1375138607: ('0.26168410815329224',), 1375138604: ('0.26168410815329224',), 1375138602: ('0.26168410815329224',), 1375138600: ('0.26168410815329224',), 1375138599: ('0.26168410815329224',), 1375138577: ('0.26168410815329224',), 1375138576: ('0.26168410815329224',), 1375138573: ('0.26168410815329224',), 1375138571: ('0.26168410815329224',), 1375138569: ('0.26168410815329224',), 1375138568: ('0.26168410815329224',)} new output for save of step final : {1375138635: ('0.26168410815329224',), 1375138634: ('0.26168410815329224',), 1375138632: ('0.26168410815329224',), 1375138629: ('0.26168410815329224',), 1375138626: ('0.26168410815329224',), 1375138624: ('0.26168410815329224',), 1375138608: ('0.26168410815329224',), 1375138607: ('0.26168410815329224',), 1375138604: ('0.26168410815329224',), 1375138602: ('0.26168410815329224',), 1375138600: ('0.26168410815329224',), 1375138599: ('0.26168410815329224',), 1375138577: ('0.26168410815329224',), 1375138576: ('0.26168410815329224',), 1375138573: ('0.26168410815329224',), 1375138571: ('0.26168410815329224',), 1375138569: ('0.26168410815329224',), 1375138568: ('0.26168410815329224',)} [1375138635, 1375138634, 1375138632, 1375138629, 1375138626, 1375138624, 1375138608, 1375138607, 1375138604, 1375138602, 1375138600, 1375138599, 1375138577, 1375138576, 1375138573, 1375138571, 1375138569, 1375138568] Looping around the photos to save general results len do output : 18 /1375138635.Didn't retrieve data . /1375138634.Didn't retrieve data . /1375138632.Didn't retrieve data . /1375138629.Didn't retrieve data . /1375138626.Didn't retrieve data . /1375138624.Didn't retrieve data . /1375138608.Didn't retrieve data . /1375138607.Didn't retrieve data . /1375138604.Didn't retrieve data . /1375138602.Didn't retrieve data . /1375138600.Didn't retrieve data . /1375138599.Didn't retrieve data . /1375138577.Didn't retrieve data . /1375138576.Didn't retrieve data . /1375138573.Didn't retrieve data . /1375138571.Didn't retrieve data . /1375138569.Didn't retrieve data . /1375138568.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138635', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138634', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138632', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138629', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138626', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138624', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138608', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138607', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138604', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138602', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138600', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138599', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138577', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138576', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138573', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138571', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138569', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138568', None, None, None, None, None, '3436450') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 54 time used for this insertion : 0.013328075408935547 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12790703773498535 time spend to save output : 0.014277935028076172 total time spend for step 5 : 0.14218497276306152 step6:blur_detection Mon Aug 4 20:32:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1754332230_573959_1375138635_99fda06141645dd7ab1c09bf0cd60deb.jpg resize: (1080, 1920) 1375138635 -1.2179639948284935 treat image : temp/1754332230_573959_1375138634_f612923bf1e512b1173ffff038881c5b.jpg resize: (1080, 1920) 1375138634 -2.377874743658809 treat image : temp/1754332230_573959_1375138632_b7c4f3cbd8fed69ac5bf0b647782dd71.jpg resize: (1080, 1920) 1375138632 -2.156482401480735 treat image : temp/1754332230_573959_1375138629_b03aebf345d9a2629743a55c5c515af7.jpg resize: (1080, 1920) 1375138629 -2.4925108518439334 treat image : temp/1754332230_573959_1375138626_7b2398fd8a1949cf9e6717ef5ca7e130.jpg resize: (1080, 1920) 1375138626 -2.961245924241711 treat image : temp/1754332230_573959_1375138624_011e99f02f5916ccae34d188a62d43ec.jpg resize: (1080, 1920) 1375138624 0.5203835309954162 treat image : temp/1754332230_573959_1375138608_507b3098494eb3758bc23d711950895b.jpg resize: (1080, 1920) 1375138608 -1.9477706366582177 treat image : temp/1754332230_573959_1375138607_ece34380a11ec2207e561975c6f27949.jpg resize: (1080, 1920) 1375138607 -2.0769059411931483 treat image : temp/1754332230_573959_1375138604_9076b007ff34b72849ad9a30928b0f09.jpg resize: (1080, 1920) 1375138604 -2.0970429260008236 treat image : temp/1754332230_573959_1375138602_a9c1914a754e76bd5da5380a12e54bdc.jpg resize: (1080, 1920) 1375138602 -1.5784469883078955 treat image : temp/1754332230_573959_1375138600_c4f5266f2bfb9e2a47214e1dc8411d78.jpg resize: (1080, 1920) 1375138600 -2.38601190438677 treat image : temp/1754332230_573959_1375138599_fb3c2f36a3b3d816309fd0926cf3e76b.jpg resize: (1080, 1920) 1375138599 -1.2992544439727784 treat image : temp/1754332230_573959_1375138577_1cfde9d52563045b5443084cd9a6ff68.jpg resize: (1080, 1920) 1375138577 -2.228027600450463 treat image : temp/1754332230_573959_1375138576_c095641cfac58f7433e02c49f1b8f789.jpg resize: (1080, 1920) 1375138576 -0.6327621605756568 treat image : temp/1754332230_573959_1375138573_338b4e0b28623991d39601468a1f9048.jpg resize: (1080, 1920) 1375138573 -1.8397574345637175 treat image : temp/1754332230_573959_1375138571_8814c0ef5c5a7a47c0f952b33337e67f.jpg resize: (1080, 1920) 1375138571 -2.2748300576444134 treat image : temp/1754332230_573959_1375138569_65a614e943127ae2574b882592387d2e.jpg resize: (1080, 1920) 1375138569 -1.7965697709975201 treat image : temp/1754332230_573959_1375138568_93dca45acfdce42da5a62b34ad379b0d.jpg resize: (1080, 1920) 1375138568 -1.1351687721783807 treat image : temp/1754332230_573959_1375138635_99fda06141645dd7ab1c09bf0cd60deb_rle_crop_3902767719_0.png resize: (59, 109) 1375156817 -0.6817582103004864 treat image : temp/1754332230_573959_1375138634_f612923bf1e512b1173ffff038881c5b_rle_crop_3902767723_0.png resize: (55, 109) 1375156818 -1.6704918755485267 treat image : temp/1754332230_573959_1375138632_b7c4f3cbd8fed69ac5bf0b647782dd71_rle_crop_3902767728_0.png resize: (251, 145) 1375156819 -2.198385134264747 treat image : temp/1754332230_573959_1375138626_7b2398fd8a1949cf9e6717ef5ca7e130_rle_crop_3902767733_0.png resize: (36, 56) 1375156820 0.8961235536437511 treat image : temp/1754332230_573959_1375138624_011e99f02f5916ccae34d188a62d43ec_rle_crop_3902767735_0.png resize: (86, 70) 1375156821 -2.1002993171446867 treat image : temp/1754332230_573959_1375138624_011e99f02f5916ccae34d188a62d43ec_rle_crop_3902767737_0.png resize: (211, 105) 1375156822 -2.4403790640953753 treat image : temp/1754332230_573959_1375138608_507b3098494eb3758bc23d711950895b_rle_crop_3902767738_0.png resize: (210, 50) 1375156823 -2.3413327701449713 treat image : temp/1754332230_573959_1375138602_a9c1914a754e76bd5da5380a12e54bdc_rle_crop_3902767745_0.png resize: (100, 184) 1375156824 -1.0085082561281606 treat image : temp/1754332230_573959_1375138600_c4f5266f2bfb9e2a47214e1dc8411d78_rle_crop_3902767749_0.png resize: (60, 87) 1375156825 -2.631640799212021 treat image : temp/1754332230_573959_1375138599_fb3c2f36a3b3d816309fd0926cf3e76b_rle_crop_3902767751_0.png resize: (151, 117) 1375156826 -2.721622849184917 treat image : temp/1754332230_573959_1375138576_c095641cfac58f7433e02c49f1b8f789_rle_crop_3902767759_0.png resize: (72, 123) 1375156827 -1.655214231166229 treat image : temp/1754332230_573959_1375138576_c095641cfac58f7433e02c49f1b8f789_rle_crop_3902767761_0.png resize: (140, 47) 1375156828 -1.978245507794537 treat image : temp/1754332230_573959_1375138571_8814c0ef5c5a7a47c0f952b33337e67f_rle_crop_3902767763_0.png resize: (169, 215) 1375156829 -1.2639929455830912 treat image : temp/1754332230_573959_1375138571_8814c0ef5c5a7a47c0f952b33337e67f_rle_crop_3902767766_0.png resize: (152, 270) 1375156830 -2.5089435019482145 treat image : temp/1754332230_573959_1375138569_65a614e943127ae2574b882592387d2e_rle_crop_3902767769_0.png resize: (73, 107) 1375156831 -1.126454705746625 treat image : temp/1754332230_573959_1375138632_b7c4f3cbd8fed69ac5bf0b647782dd71_rle_crop_3902767727_0.png resize: (112, 68) 1375156834 0.08756205323418649 treat image : temp/1754332230_573959_1375138629_b03aebf345d9a2629743a55c5c515af7_rle_crop_3902767731_0.png resize: (80, 61) 1375156835 0.1167158499524677 treat image : temp/1754332230_573959_1375138608_507b3098494eb3758bc23d711950895b_rle_crop_3902767739_0.png resize: (87, 133) 1375156836 6.007999379599459 treat image : temp/1754332230_573959_1375138602_a9c1914a754e76bd5da5380a12e54bdc_rle_crop_3902767744_0.png resize: (138, 118) 1375156837 -1.4528993254241522 treat image : temp/1754332230_573959_1375138599_fb3c2f36a3b3d816309fd0926cf3e76b_rle_crop_3902767752_0.png resize: (50, 84) 1375156838 -2.531835706859705 treat image : temp/1754332230_573959_1375138569_65a614e943127ae2574b882592387d2e_rle_crop_3902767770_0.png resize: (189, 182) 1375156839 -1.3729139159400194 treat image : temp/1754332230_573959_1375138632_b7c4f3cbd8fed69ac5bf0b647782dd71_rle_crop_3902767725_0.png resize: (99, 105) 1375156840 -1.191323537750809 treat image : temp/1754332230_573959_1375138635_99fda06141645dd7ab1c09bf0cd60deb_rle_crop_3902767718_0.png resize: (129, 215) 1375156864 -2.194251939284341 treat image : temp/1754332230_573959_1375138635_99fda06141645dd7ab1c09bf0cd60deb_rle_crop_3902767720_0.png resize: (129, 159) 1375156865 -0.7621849132522031 treat image : temp/1754332230_573959_1375138635_99fda06141645dd7ab1c09bf0cd60deb_rle_crop_3902767721_0.png resize: (931, 958) 1375156866 0.9386733227331541 treat image : temp/1754332230_573959_1375138634_f612923bf1e512b1173ffff038881c5b_rle_crop_3902767722_0.png resize: (522, 339) 1375156867 0.07994606813962458 treat image : temp/1754332230_573959_1375138634_f612923bf1e512b1173ffff038881c5b_rle_crop_3902767724_0.png resize: (1000, 1060) 1375156868 -0.6556682917792757 treat image : temp/1754332230_573959_1375138632_b7c4f3cbd8fed69ac5bf0b647782dd71_rle_crop_3902767726_0.png resize: (90, 158) 1375156869 -3.9065306359795926 treat image : temp/1754332230_573959_1375138632_b7c4f3cbd8fed69ac5bf0b647782dd71_rle_crop_3902767729_0.png resize: (516, 336) 1375156870 -0.11519211615281552 treat image : temp/1754332230_573959_1375138629_b03aebf345d9a2629743a55c5c515af7_rle_crop_3902767730_0.png resize: (951, 1666) 1375156871 -2.8704144939843115 treat image : temp/1754332230_573959_1375138626_7b2398fd8a1949cf9e6717ef5ca7e130_rle_crop_3902767732_0.png resize: (483, 366) 1375156872 -0.4110222215001867 treat image : temp/1754332230_573959_1375138626_7b2398fd8a1949cf9e6717ef5ca7e130_rle_crop_3902767734_0.png resize: (990, 1116) 1375156873 -1.432607778454536 treat image : temp/1754332230_573959_1375138608_507b3098494eb3758bc23d711950895b_rle_crop_3902767740_0.png resize: (1003, 1182) 1375156874 -1.6946881084721737 treat image : temp/1754332230_573959_1375138607_ece34380a11ec2207e561975c6f27949_rle_crop_3902767741_0.png resize: (948, 1033) 1375156875 0.6732020615054444 treat image : temp/1754332230_573959_1375138604_9076b007ff34b72849ad9a30928b0f09_rle_crop_3902767742_0.png resize: (187, 118) 1375156876 -1.8218256112066598 treat image : temp/1754332230_573959_1375138604_9076b007ff34b72849ad9a30928b0f09_rle_crop_3902767743_0.png resize: (991, 1088) 1375156877 -0.23408740412766918 treat image : temp/1754332230_573959_1375138577_1cfde9d52563045b5443084cd9a6ff68_rle_crop_3902767754_0.png resize: (498, 379) 1375156878 0.12227809476679943 treat image : temp/1754332230_573959_1375138577_1cfde9d52563045b5443084cd9a6ff68_rle_crop_3902767755_0.png resize: (295, 161) 1375156879 -2.7364421036698676 treat image : temp/1754332230_573959_1375138577_1cfde9d52563045b5443084cd9a6ff68_rle_crop_3902767756_0.png resize: (164, 121) 1375156880 -3.8296279208139694 treat image : temp/1754332230_573959_1375138577_1cfde9d52563045b5443084cd9a6ff68_rle_crop_3902767757_0.png resize: (996, 1266) 1375156881 -1.9297149781766507 treat image : temp/1754332230_573959_1375138576_c095641cfac58f7433e02c49f1b8f789_rle_crop_3902767758_0.png resize: (525, 352) 1375156882 -0.029300747223001494 treat image : temp/1754332230_573959_1375138576_c095641cfac58f7433e02c49f1b8f789_rle_crop_3902767760_0.png resize: (983, 1139) 1375156883 -0.6974228024707577 treat image : temp/1754332230_573959_1375138573_338b4e0b28623991d39601468a1f9048_rle_crop_3902767762_0.png resize: (154, 117) 1375156884 -0.5560006913270483 treat image : temp/1754332230_573959_1375138571_8814c0ef5c5a7a47c0f952b33337e67f_rle_crop_3902767764_0.png resize: (519, 352) 1375156885 -0.1635459936301476 treat image : temp/1754332230_573959_1375138569_65a614e943127ae2574b882592387d2e_rle_crop_3902767767_0.png resize: (118, 158) 1375156886 -1.9873275996435773 treat image : temp/1754332230_573959_1375138568_93dca45acfdce42da5a62b34ad379b0d_rle_crop_3902767771_0.png resize: (127, 238) 1375156887 -2.8591919881199743 treat image : temp/1754332230_573959_1375138568_93dca45acfdce42da5a62b34ad379b0d_rle_crop_3902767772_0.png resize: (976, 1025) 1375156888 0.5080692250866738 treat image : temp/1754332230_573959_1375138624_011e99f02f5916ccae34d188a62d43ec_rle_crop_3902767736_0.png resize: (139, 63) 1375156889 -1.550296393688204 treat image : temp/1754332230_573959_1375138600_c4f5266f2bfb9e2a47214e1dc8411d78_rle_crop_3902767746_0.png resize: (52, 44) 1375156890 5.369913801672675 treat image : temp/1754332230_573959_1375138600_c4f5266f2bfb9e2a47214e1dc8411d78_rle_crop_3902767747_0.png resize: (57, 26) 1375156891 4.260079319654135 treat image : temp/1754332230_573959_1375138600_c4f5266f2bfb9e2a47214e1dc8411d78_rle_crop_3902767748_0.png resize: (41, 56) 1375156892 5.149144877203501 treat image : temp/1754332230_573959_1375138599_fb3c2f36a3b3d816309fd0926cf3e76b_rle_crop_3902767750_0.png resize: (102, 118) 1375156893 -2.0891386413885678 treat image : temp/1754332230_573959_1375138599_fb3c2f36a3b3d816309fd0926cf3e76b_rle_crop_3902767753_0.png resize: (46, 27) 1375156894 4.727046469526033 treat image : temp/1754332230_573959_1375138571_8814c0ef5c5a7a47c0f952b33337e67f_rle_crop_3902767765_0.png resize: (122, 108) 1375156895 -3.2285110650584024 treat image : temp/1754332230_573959_1375138569_65a614e943127ae2574b882592387d2e_rle_crop_3902767768_0.png resize: (93, 92) 1375156896 -0.9384190984520285 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 73 time used for this insertion : 0.01453709602355957 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 73 time used for this insertion : 0.01706981658935547 save missing photos in datou_result : time spend for datou_step_exec : 19.751934051513672 time spend to save output : 0.0378413200378418 total time spend for step 6 : 19.789775371551514 step7:brightness Mon Aug 4 20:32:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1754332230_573959_1375138635_99fda06141645dd7ab1c09bf0cd60deb.jpg treat image : temp/1754332230_573959_1375138634_f612923bf1e512b1173ffff038881c5b.jpg treat image : temp/1754332230_573959_1375138632_b7c4f3cbd8fed69ac5bf0b647782dd71.jpg treat image : temp/1754332230_573959_1375138629_b03aebf345d9a2629743a55c5c515af7.jpg treat image : temp/1754332230_573959_1375138626_7b2398fd8a1949cf9e6717ef5ca7e130.jpg treat image : temp/1754332230_573959_1375138624_011e99f02f5916ccae34d188a62d43ec.jpg treat image : temp/1754332230_573959_1375138608_507b3098494eb3758bc23d711950895b.jpg treat image : temp/1754332230_573959_1375138607_ece34380a11ec2207e561975c6f27949.jpg treat image : temp/1754332230_573959_1375138604_9076b007ff34b72849ad9a30928b0f09.jpg treat image : temp/1754332230_573959_1375138602_a9c1914a754e76bd5da5380a12e54bdc.jpg treat image : temp/1754332230_573959_1375138600_c4f5266f2bfb9e2a47214e1dc8411d78.jpg treat image : temp/1754332230_573959_1375138599_fb3c2f36a3b3d816309fd0926cf3e76b.jpg treat image : temp/1754332230_573959_1375138577_1cfde9d52563045b5443084cd9a6ff68.jpg treat image : temp/1754332230_573959_1375138576_c095641cfac58f7433e02c49f1b8f789.jpg treat image : temp/1754332230_573959_1375138573_338b4e0b28623991d39601468a1f9048.jpg treat image : temp/1754332230_573959_1375138571_8814c0ef5c5a7a47c0f952b33337e67f.jpg treat image : temp/1754332230_573959_1375138569_65a614e943127ae2574b882592387d2e.jpg treat image : temp/1754332230_573959_1375138568_93dca45acfdce42da5a62b34ad379b0d.jpg treat image : temp/1754332230_573959_1375138635_99fda06141645dd7ab1c09bf0cd60deb_rle_crop_3902767719_0.png treat image : temp/1754332230_573959_1375138634_f612923bf1e512b1173ffff038881c5b_rle_crop_3902767723_0.png treat image : temp/1754332230_573959_1375138632_b7c4f3cbd8fed69ac5bf0b647782dd71_rle_crop_3902767728_0.png treat image : temp/1754332230_573959_1375138626_7b2398fd8a1949cf9e6717ef5ca7e130_rle_crop_3902767733_0.png treat image : temp/1754332230_573959_1375138624_011e99f02f5916ccae34d188a62d43ec_rle_crop_3902767735_0.png treat image : temp/1754332230_573959_1375138624_011e99f02f5916ccae34d188a62d43ec_rle_crop_3902767737_0.png treat image : temp/1754332230_573959_1375138608_507b3098494eb3758bc23d711950895b_rle_crop_3902767738_0.png treat image : temp/1754332230_573959_1375138602_a9c1914a754e76bd5da5380a12e54bdc_rle_crop_3902767745_0.png treat image : temp/1754332230_573959_1375138600_c4f5266f2bfb9e2a47214e1dc8411d78_rle_crop_3902767749_0.png treat image : temp/1754332230_573959_1375138599_fb3c2f36a3b3d816309fd0926cf3e76b_rle_crop_3902767751_0.png treat image : temp/1754332230_573959_1375138576_c095641cfac58f7433e02c49f1b8f789_rle_crop_3902767759_0.png treat image : temp/1754332230_573959_1375138576_c095641cfac58f7433e02c49f1b8f789_rle_crop_3902767761_0.png treat image : temp/1754332230_573959_1375138571_8814c0ef5c5a7a47c0f952b33337e67f_rle_crop_3902767763_0.png treat image : temp/1754332230_573959_1375138571_8814c0ef5c5a7a47c0f952b33337e67f_rle_crop_3902767766_0.png treat image : temp/1754332230_573959_1375138569_65a614e943127ae2574b882592387d2e_rle_crop_3902767769_0.png treat image : temp/1754332230_573959_1375138632_b7c4f3cbd8fed69ac5bf0b647782dd71_rle_crop_3902767727_0.png treat image : temp/1754332230_573959_1375138629_b03aebf345d9a2629743a55c5c515af7_rle_crop_3902767731_0.png treat image : temp/1754332230_573959_1375138608_507b3098494eb3758bc23d711950895b_rle_crop_3902767739_0.png treat image : temp/1754332230_573959_1375138602_a9c1914a754e76bd5da5380a12e54bdc_rle_crop_3902767744_0.png treat image : temp/1754332230_573959_1375138599_fb3c2f36a3b3d816309fd0926cf3e76b_rle_crop_3902767752_0.png treat image : temp/1754332230_573959_1375138569_65a614e943127ae2574b882592387d2e_rle_crop_3902767770_0.png treat image : temp/1754332230_573959_1375138632_b7c4f3cbd8fed69ac5bf0b647782dd71_rle_crop_3902767725_0.png treat image : temp/1754332230_573959_1375138635_99fda06141645dd7ab1c09bf0cd60deb_rle_crop_3902767718_0.png treat image : temp/1754332230_573959_1375138635_99fda06141645dd7ab1c09bf0cd60deb_rle_crop_3902767720_0.png treat image : temp/1754332230_573959_1375138635_99fda06141645dd7ab1c09bf0cd60deb_rle_crop_3902767721_0.png treat image : temp/1754332230_573959_1375138634_f612923bf1e512b1173ffff038881c5b_rle_crop_3902767722_0.png treat image : temp/1754332230_573959_1375138634_f612923bf1e512b1173ffff038881c5b_rle_crop_3902767724_0.png treat image : temp/1754332230_573959_1375138632_b7c4f3cbd8fed69ac5bf0b647782dd71_rle_crop_3902767726_0.png treat image : temp/1754332230_573959_1375138632_b7c4f3cbd8fed69ac5bf0b647782dd71_rle_crop_3902767729_0.png treat image : temp/1754332230_573959_1375138629_b03aebf345d9a2629743a55c5c515af7_rle_crop_3902767730_0.png treat image : temp/1754332230_573959_1375138626_7b2398fd8a1949cf9e6717ef5ca7e130_rle_crop_3902767732_0.png treat image : temp/1754332230_573959_1375138626_7b2398fd8a1949cf9e6717ef5ca7e130_rle_crop_3902767734_0.png treat image : temp/1754332230_573959_1375138608_507b3098494eb3758bc23d711950895b_rle_crop_3902767740_0.png treat image : temp/1754332230_573959_1375138607_ece34380a11ec2207e561975c6f27949_rle_crop_3902767741_0.png treat image : temp/1754332230_573959_1375138604_9076b007ff34b72849ad9a30928b0f09_rle_crop_3902767742_0.png treat image : temp/1754332230_573959_1375138604_9076b007ff34b72849ad9a30928b0f09_rle_crop_3902767743_0.png treat image : temp/1754332230_573959_1375138577_1cfde9d52563045b5443084cd9a6ff68_rle_crop_3902767754_0.png treat image : temp/1754332230_573959_1375138577_1cfde9d52563045b5443084cd9a6ff68_rle_crop_3902767755_0.png treat image : temp/1754332230_573959_1375138577_1cfde9d52563045b5443084cd9a6ff68_rle_crop_3902767756_0.png treat image : temp/1754332230_573959_1375138577_1cfde9d52563045b5443084cd9a6ff68_rle_crop_3902767757_0.png treat image : temp/1754332230_573959_1375138576_c095641cfac58f7433e02c49f1b8f789_rle_crop_3902767758_0.png treat image : temp/1754332230_573959_1375138576_c095641cfac58f7433e02c49f1b8f789_rle_crop_3902767760_0.png treat image : temp/1754332230_573959_1375138573_338b4e0b28623991d39601468a1f9048_rle_crop_3902767762_0.png treat image : temp/1754332230_573959_1375138571_8814c0ef5c5a7a47c0f952b33337e67f_rle_crop_3902767764_0.png treat image : temp/1754332230_573959_1375138569_65a614e943127ae2574b882592387d2e_rle_crop_3902767767_0.png treat image : temp/1754332230_573959_1375138568_93dca45acfdce42da5a62b34ad379b0d_rle_crop_3902767771_0.png treat image : temp/1754332230_573959_1375138568_93dca45acfdce42da5a62b34ad379b0d_rle_crop_3902767772_0.png treat image : temp/1754332230_573959_1375138624_011e99f02f5916ccae34d188a62d43ec_rle_crop_3902767736_0.png treat image : temp/1754332230_573959_1375138600_c4f5266f2bfb9e2a47214e1dc8411d78_rle_crop_3902767746_0.png treat image : temp/1754332230_573959_1375138600_c4f5266f2bfb9e2a47214e1dc8411d78_rle_crop_3902767747_0.png treat image : temp/1754332230_573959_1375138600_c4f5266f2bfb9e2a47214e1dc8411d78_rle_crop_3902767748_0.png treat image : temp/1754332230_573959_1375138599_fb3c2f36a3b3d816309fd0926cf3e76b_rle_crop_3902767750_0.png treat image : temp/1754332230_573959_1375138599_fb3c2f36a3b3d816309fd0926cf3e76b_rle_crop_3902767753_0.png treat image : temp/1754332230_573959_1375138571_8814c0ef5c5a7a47c0f952b33337e67f_rle_crop_3902767765_0.png treat image : temp/1754332230_573959_1375138569_65a614e943127ae2574b882592387d2e_rle_crop_3902767768_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 73 time used for this insertion : 0.016894102096557617 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 73 time used for this insertion : 0.01707935333251953 save missing photos in datou_result : time spend for datou_step_exec : 5.231791019439697 time spend to save output : 0.03843498229980469 total time spend for step 7 : 5.270226001739502 step8:velours_tree Mon Aug 4 20:32:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.17883563041687012 time spend to save output : 5.7220458984375e-05 total time spend for step 8 : 0.1788928508758545 step9:send_mail_cod Mon Aug 4 20:32:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25646331_04-08-2025_20_32_46.pdf 25649215 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette256492151754332366 25649216 imagette256492161754332368 25649217 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette256492171754332368 25649218 change filename to text .imagette256492181754332369 25649219 imagette256492191754332369 25649220 imagette256492201754332369 25649221 imagette256492211754332369 25649222 imagette256492221754332369 25649223 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette256492231754332369 25649224 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette256492241754332370 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25646331 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25649215,25649216,25649217,25649218,25649219,25649220,25649221,25649222,25649223,25649224,25649225?tags=pet_clair,pet_fonce,papier,metal,background,pehd,mal_croppe,flou,autre,carton,environnement args[1375138635] : ((1375138635, -1.2179639948284935, 492688767), (1375138635, 0.4492850924214087, 2107752395), '0.26168410815329224') We are sending mail with results at report@fotonower.com args[1375138634] : ((1375138634, -2.377874743658809, 492609224), (1375138634, 0.418792392320434, 2107752395), '0.26168410815329224') We are sending mail with results at report@fotonower.com args[1375138632] : ((1375138632, -2.156482401480735, 492609224), (1375138632, 0.45916055248007553, 2107752395), '0.26168410815329224') We are sending mail with results at report@fotonower.com args[1375138629] : ((1375138629, -2.4925108518439334, 492609224), (1375138629, 0.38765828040721556, 2107752395), '0.26168410815329224') We are sending mail with results at report@fotonower.com args[1375138626] : ((1375138626, -2.961245924241711, 492609224), (1375138626, 0.47245092975170083, 2107752395), '0.26168410815329224') We are sending mail with results at report@fotonower.com args[1375138624] : ((1375138624, 0.5203835309954162, 492688767), (1375138624, 0.2483380365853906, 2107752395), '0.26168410815329224') We are sending mail with results at report@fotonower.com args[1375138608] : ((1375138608, -1.9477706366582177, 492688767), (1375138608, 0.4508538190716515, 2107752395), '0.26168410815329224') We are sending mail with results at report@fotonower.com args[1375138607] : ((1375138607, -2.0769059411931483, 492609224), (1375138607, 0.3145650755585604, 2107752395), '0.26168410815329224') We are sending mail with results at report@fotonower.com args[1375138604] : ((1375138604, -2.0970429260008236, 492609224), (1375138604, 0.569445699439229, 2107752395), '0.26168410815329224') We are sending mail with results at report@fotonower.com args[1375138602] : ((1375138602, -1.5784469883078955, 492688767), (1375138602, 0.6103536666998418, 2107752395), '0.26168410815329224') We are sending mail with results at report@fotonower.com args[1375138600] : ((1375138600, -2.38601190438677, 492609224), (1375138600, 0.6104625845390991, 2107752395), '0.26168410815329224') We are sending mail with results at report@fotonower.com args[1375138599] : ((1375138599, -1.2992544439727784, 492688767), (1375138599, 0.46344602267919605, 2107752395), '0.26168410815329224') We are sending mail with results at report@fotonower.com args[1375138577] : ((1375138577, -2.228027600450463, 492609224), (1375138577, 0.5925678587181555, 2107752395), '0.26168410815329224') We are sending mail with results at report@fotonower.com args[1375138576] : ((1375138576, -0.6327621605756568, 492688767), (1375138576, 0.24368581997784908, 2107752395), '0.26168410815329224') We are sending mail with results at report@fotonower.com args[1375138573] : ((1375138573, -1.8397574345637175, 492688767), (1375138573, 0.32003960129994574, 2107752395), '0.26168410815329224') We are sending mail with results at report@fotonower.com args[1375138571] : ((1375138571, -2.2748300576444134, 492609224), (1375138571, 0.5146429155671313, 2107752395), '0.26168410815329224') We are sending mail with results at report@fotonower.com args[1375138569] : ((1375138569, -1.7965697709975201, 492688767), (1375138569, 0.6954960141495311, 2107752395), '0.26168410815329224') We are sending mail with results at report@fotonower.com args[1375138568] : ((1375138568, -1.1351687721783807, 492688767), (1375138568, 0.6654051946971238, 2107752395), '0.26168410815329224') We are sending mail with results at report@fotonower.com refus_total : 0.26168410815329224 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25646331 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25646331_04-08-2025_20_32_46.pdf results_Auto_P25646331_04-08-2025_20_32_46.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25646331_04-08-2025_20_32_46.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25646331','results_Auto_P25646331_04-08-2025_20_32_46.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25646331_04-08-2025_20_32_46.pdf','pdf','','0.94','0.26168410815329224') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25646331

https://www.fotonower.com/image?json=false&list_photos_id=1375138635
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375138634
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375138632
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375138629
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375138626
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375138624
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375138608
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375138607
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375138604
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375138602
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375138600
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375138599
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375138577
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375138576
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375138573
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375138571
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375138569
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375138568
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 26.17%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/25649215?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/25649217?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/25649218?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/25649223?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/25649224?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25646331_04-08-2025_20_32_46.pdf.

Lien vers velours :https://www.fotonower.com/velours/25649215,25649216,25649217,25649218,25649219,25649220,25649221,25649222,25649223,25649224,25649225?tags=pet_clair,pet_fonce,papier,metal,background,pehd,mal_croppe,flou,autre,carton,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 04 Aug 2025 18:32:53 GMT Content-Length: 0 Connection: close X-Message-Id: qTGHK0pESiee9W-xtiyMqw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1375138635, 1375138634, 1375138632, 1375138629, 1375138626, 1375138624, 1375138608, 1375138607, 1375138604, 1375138602, 1375138600, 1375138599, 1375138577, 1375138576, 1375138573, 1375138571, 1375138569, 1375138568] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138635', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138634', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138632', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138629', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138626', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138624', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138608', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138607', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138604', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138602', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138600', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138599', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138577', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138576', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138573', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138571', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138569', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138568', None, None, None, None, None, '3436450') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.017720460891723633 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.572236061096191 time spend to save output : 0.017986059188842773 total time spend for step 9 : 6.590222120285034 step10:split_time_score Mon Aug 4 20:32:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 18),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 04082025 25646331 Nombre de photos uploadées : 18 / 23040 (0%) 04082025 25646331 Nombre de photos taguées (types de déchets): 0 / 18 (0%) 04082025 25646331 Nombre de photos taguées (volume) : 0 / 18 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ?????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0009486675262451172 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2356433868408203 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.020633053626543208 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25630909_04-08-2025_08_41_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25630909 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25630909 AND mptpi.`type`=3594 To do Qualite : 0.08988558545524694 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25632840_04-08-2025_10_01_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25632840 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25632840 AND mptpi.`type`=3594 To do Qualite : 0.26266080729166663 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25636092_04-08-2025_12_12_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25636092 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25636092 AND mptpi.`type`=3594 To do Qualite : 0.26008359053497937 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25636094_04-08-2025_11_52_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25636094 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25636094 AND mptpi.`type`=3594 To do Qualite : 0.031987895447530876 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25636131_04-08-2025_11_41_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25636131 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25636131 AND mptpi.`type`=3594 To do Qualite : 0.11313122106481481 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25638279_04-08-2025_13_31_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25638279 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25638279 AND mptpi.`type`=3594 To do Qualite : 0.23567206790123452 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25638287_04-08-2025_13_21_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25638287 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25638287 AND mptpi.`type`=3594 To do Qualite : 0.03279818469785575 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25638289_04-08-2025_13_12_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25638289 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25638289 AND mptpi.`type`=3594 To do Qualite : 0.1903817033179012 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25643801_04-08-2025_19_32_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25643801 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25643801 AND mptpi.`type`=3594 To do Qualite : 0.033507855366941015 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25643835_04-08-2025_17_41_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25643835 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25643835 AND mptpi.`type`=3594 To do Qualite : 0.26168410815329224 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25646331_04-08-2025_20_32_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25646331 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25646331 AND mptpi.`type`=3594 To do Qualite : 0.03587871334876542 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25646334_04-08-2025_19_11_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25646334 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25646334 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'04082025': {'nb_upload': 18, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1375138635, 1375138634, 1375138632, 1375138629, 1375138626, 1375138624, 1375138608, 1375138607, 1375138604, 1375138602, 1375138600, 1375138599, 1375138577, 1375138576, 1375138573, 1375138571, 1375138569, 1375138568] Looping around the photos to save general results len do output : 1 /25646331Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138635', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138634', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138632', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138629', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138626', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138624', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138608', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138607', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138604', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138602', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138600', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138599', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138577', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138576', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138573', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138571', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138569', None, None, None, None, None, '3436450') ('3318', None, None, None, None, None, None, None, '3436450') ('3318', '25646331', '1375138568', None, None, None, None, None, '3436450') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 19 time used for this insertion : 0.017536163330078125 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.1096763610839844 time spend to save output : 0.017826080322265625 total time spend for step 10 : 1.12750244140625 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 18 set_done_treatment 92.69user 30.56system 2:28.94elapsed 82%CPU (0avgtext+0avgdata 2974252maxresident)k 580672inputs+72440outputs (6279major+2391497minor)pagefaults 0swaps