python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1843230 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3695524'] with mtr_portfolio_ids : ['26761139'] and first list_photo_ids : [] new path : /proc/1843230/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 17 ; length of list_pids : 17 ; length of list_args : 17 time to download the photos : 2.364776849746704 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Sep 11 18:10:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10370 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-11 18:10:34.611281: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-11 18:10:34.636673: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-11 18:10:34.638867: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7ff938000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-11 18:10:34.638941: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-11 18:10:34.643322: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-11 18:10:34.775787: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1c31c4b0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-11 18:10:34.775866: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-11 18:10:34.777430: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-11 18:10:34.777937: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-11 18:10:34.781014: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-11 18:10:34.784056: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-11 18:10:34.784781: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-11 18:10:34.787274: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-11 18:10:34.788488: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-11 18:10:34.793133: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-11 18:10:34.794736: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-11 18:10:34.794847: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-11 18:10:34.795649: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-11 18:10:34.795665: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-11 18:10:34.795689: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-11 18:10:34.797107: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9461 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-11 18:10:35.223546: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-11 18:10:35.223645: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-11 18:10:35.223663: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-11 18:10:35.223683: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-11 18:10:35.223701: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-11 18:10:35.223717: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-11 18:10:35.223733: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-11 18:10:35.223750: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-11 18:10:35.225087: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-11 18:10:35.226653: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-11 18:10:35.226724: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-11 18:10:35.226741: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-11 18:10:35.226755: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-11 18:10:35.226768: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-11 18:10:35.226782: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-11 18:10:35.226796: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-11 18:10:35.226811: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-11 18:10:35.228094: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-11 18:10:35.228136: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-11 18:10:35.228145: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-11 18:10:35.228153: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-11 18:10:35.229598: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9461 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-11 18:10:44.813821: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-11 18:10:45.031147: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 17 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 45.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 Detection mask done ! Trying to reset tf kernel 1843865 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 505 tf kernel not reseted sub process len(results) : 17 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 17 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5758 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00037217140197753906 nb_pixel_total : 10809 time to create 1 rle with old method : 0.012418508529663086 length of segment : 173 time for calcul the mask position with numpy : 0.00014090538024902344 nb_pixel_total : 4457 time to create 1 rle with old method : 0.005543231964111328 length of segment : 88 time for calcul the mask position with numpy : 0.005828857421875 nb_pixel_total : 271445 time to create 1 rle with new method : 0.031809091567993164 length of segment : 1261 time for calcul the mask position with numpy : 0.0003643035888671875 nb_pixel_total : 11878 time to create 1 rle with old method : 0.014272928237915039 length of segment : 154 time for calcul the mask position with numpy : 0.00011277198791503906 nb_pixel_total : 3948 time to create 1 rle with old method : 0.004675388336181641 length of segment : 69 time for calcul the mask position with numpy : 0.00019788742065429688 nb_pixel_total : 11581 time to create 1 rle with old method : 0.01352381706237793 length of segment : 175 time for calcul the mask position with numpy : 0.0002601146697998047 nb_pixel_total : 17642 time to create 1 rle with old method : 0.02081465721130371 length of segment : 92 time for calcul the mask position with numpy : 0.0002391338348388672 nb_pixel_total : 14466 time to create 1 rle with old method : 0.017077922821044922 length of segment : 171 time for calcul the mask position with numpy : 0.0002162456512451172 nb_pixel_total : 11623 time to create 1 rle with old method : 0.014141082763671875 length of segment : 90 time for calcul the mask position with numpy : 0.0002281665802001953 nb_pixel_total : 11742 time to create 1 rle with old method : 0.014075279235839844 length of segment : 140 time for calcul the mask position with numpy : 9.393692016601562e-05 nb_pixel_total : 3610 time to create 1 rle with old method : 0.004871368408203125 length of segment : 42 time for calcul the mask position with numpy : 0.0002315044403076172 nb_pixel_total : 9556 time to create 1 rle with old method : 0.011368036270141602 length of segment : 167 time for calcul the mask position with numpy : 0.0003941059112548828 nb_pixel_total : 18885 time to create 1 rle with old method : 0.022194385528564453 length of segment : 177 time for calcul the mask position with numpy : 0.00017523765563964844 nb_pixel_total : 8584 time to create 1 rle with old method : 0.010312557220458984 length of segment : 124 time for calcul the mask position with numpy : 0.00014901161193847656 nb_pixel_total : 6155 time to create 1 rle with old method : 0.0076024532318115234 length of segment : 78 time for calcul the mask position with numpy : 0.00030732154846191406 nb_pixel_total : 15418 time to create 1 rle with old method : 0.01804184913635254 length of segment : 148 time for calcul the mask position with numpy : 0.00045752525329589844 nb_pixel_total : 22170 time to create 1 rle with old method : 0.026120662689208984 length of segment : 234 time for calcul the mask position with numpy : 0.0001709461212158203 nb_pixel_total : 6766 time to create 1 rle with old method : 0.008121252059936523 length of segment : 110 time for calcul the mask position with numpy : 0.0002751350402832031 nb_pixel_total : 10912 time to create 1 rle with old method : 0.012937068939208984 length of segment : 180 time for calcul the mask position with numpy : 0.00019979476928710938 nb_pixel_total : 10166 time to create 1 rle with old method : 0.01786494255065918 length of segment : 99 time for calcul the mask position with numpy : 0.007213115692138672 nb_pixel_total : 271047 time to create 1 rle with new method : 0.021047115325927734 length of segment : 951 time for calcul the mask position with numpy : 0.0005583763122558594 nb_pixel_total : 12973 time to create 1 rle with old method : 0.01464080810546875 length of segment : 165 time for calcul the mask position with numpy : 0.00034809112548828125 nb_pixel_total : 10205 time to create 1 rle with old method : 0.011503219604492188 length of segment : 107 time for calcul the mask position with numpy : 0.00021195411682128906 nb_pixel_total : 4711 time to create 1 rle with old method : 0.005681037902832031 length of segment : 49 time for calcul the mask position with numpy : 0.00024318695068359375 nb_pixel_total : 4198 time to create 1 rle with old method : 0.004895925521850586 length of segment : 94 time for calcul the mask position with numpy : 0.0005133152008056641 nb_pixel_total : 9750 time to create 1 rle with old method : 0.010971307754516602 length of segment : 186 time for calcul the mask position with numpy : 0.00029969215393066406 nb_pixel_total : 4797 time to create 1 rle with old method : 0.0054399967193603516 length of segment : 123 time for calcul the mask position with numpy : 0.0010623931884765625 nb_pixel_total : 22720 time to create 1 rle with old method : 0.025042057037353516 length of segment : 268 time for calcul the mask position with numpy : 0.0006046295166015625 nb_pixel_total : 17967 time to create 1 rle with old method : 0.02030014991760254 length of segment : 163 time for calcul the mask position with numpy : 0.000431060791015625 nb_pixel_total : 10025 time to create 1 rle with old method : 0.01144099235534668 length of segment : 108 time for calcul the mask position with numpy : 0.0004925727844238281 nb_pixel_total : 5776 time to create 1 rle with old method : 0.006818532943725586 length of segment : 142 time for calcul the mask position with numpy : 0.00025963783264160156 nb_pixel_total : 8838 time to create 1 rle with old method : 0.010739803314208984 length of segment : 144 time for calcul the mask position with numpy : 0.00022554397583007812 nb_pixel_total : 8996 time to create 1 rle with old method : 0.010553836822509766 length of segment : 169 time for calcul the mask position with numpy : 0.0001418590545654297 nb_pixel_total : 4281 time to create 1 rle with old method : 0.005065441131591797 length of segment : 68 time for calcul the mask position with numpy : 0.00037980079650878906 nb_pixel_total : 9916 time to create 1 rle with old method : 0.011156797409057617 length of segment : 178 time for calcul the mask position with numpy : 0.00026869773864746094 nb_pixel_total : 7443 time to create 1 rle with old method : 0.008375883102416992 length of segment : 87 time for calcul the mask position with numpy : 0.00034356117248535156 nb_pixel_total : 6572 time to create 1 rle with old method : 0.0081024169921875 length of segment : 85 time for calcul the mask position with numpy : 0.0001811981201171875 nb_pixel_total : 4763 time to create 1 rle with old method : 0.005746126174926758 length of segment : 134 time for calcul the mask position with numpy : 0.00020051002502441406 nb_pixel_total : 7590 time to create 1 rle with old method : 0.008653640747070312 length of segment : 196 time for calcul the mask position with numpy : 0.0002307891845703125 nb_pixel_total : 13350 time to create 1 rle with old method : 0.015787601470947266 length of segment : 105 time for calcul the mask position with numpy : 0.0002238750457763672 nb_pixel_total : 9853 time to create 1 rle with old method : 0.011811971664428711 length of segment : 116 time for calcul the mask position with numpy : 0.00038313865661621094 nb_pixel_total : 9304 time to create 1 rle with old method : 0.010854721069335938 length of segment : 145 time for calcul the mask position with numpy : 0.0004699230194091797 nb_pixel_total : 11345 time to create 1 rle with old method : 0.013432502746582031 length of segment : 136 time for calcul the mask position with numpy : 0.00022554397583007812 nb_pixel_total : 6955 time to create 1 rle with old method : 0.008356809616088867 length of segment : 126 time for calcul the mask position with numpy : 0.0003402233123779297 nb_pixel_total : 7512 time to create 1 rle with old method : 0.009950637817382812 length of segment : 122 time spent for convertir_results : 2.857259511947632 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 45 chid ids of type : 3594 Number RLEs to save : 7939 save missing photos in datou_result : time spend for datou_step_exec : 30.167140007019043 time spend to save output : 1.0387275218963623 total time spend for step 1 : 31.205867528915405 step2:crop_condition Thu Sep 11 18:11:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 17 ! batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 3736932 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757607066_1843230 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 24 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.203177690505981 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757607077_1843230 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.4303622245788574 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757607080_1843230 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8334109783172607 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757607082_1843230 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.5499231815338135 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757607086_1843230 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.6275906562805176 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757607088_1843230 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1189897060394287 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1383263994, 1383263991, 1383263988, 1383263939, 1383263937, 1383263934, 1383263931, 1383263910, 1383263906, 1383263904, 1383263900, 1383263897, 1383263894, 1383263856, 1383263854, 1383263852, 1383263848] Looping around the photos to save general results len do output : 45 /1383285108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383285165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263994', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263991', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263988', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263939', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263937', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263934', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263931', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263910', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263906', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263904', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263900', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263897', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263894', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263856', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263854', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263852', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263848', None, None, None, None, None, '3695524') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 152 time used for this insertion : 0.048148155212402344 save_final save missing photos in datou_result : time spend for datou_step_exec : 26.289931535720825 time spend to save output : 0.04980802536010742 total time spend for step 2 : 26.339739561080933 step3:rle_unique_nms_with_priority Thu Sep 11 18:11:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.35241127014160156 time for calcul the mask position with numpy : 0.11835122108459473 nb_pixel_total : 2058334 time to create 1 rle with new method : 0.19397211074829102 time for calcul the mask position with numpy : 0.01007080078125 nb_pixel_total : 4457 time to create 1 rle with old method : 0.00806427001953125 time for calcul the mask position with numpy : 0.009190082550048828 nb_pixel_total : 10809 time to create 1 rle with old method : 0.012119293212890625 create new chi : 0.3694267272949219 time to delete rle : 0.04780292510986328 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1602 TO DO : save crop sub photo not yet done ! save time : 0.2574911117553711 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.42175769805908203 time for calcul the mask position with numpy : 0.0815732479095459 nb_pixel_total : 1774748 time to create 1 rle with new method : 0.13806605339050293 time for calcul the mask position with numpy : 0.00968480110168457 nb_pixel_total : 11581 time to create 1 rle with old method : 0.021637678146362305 time for calcul the mask position with numpy : 0.011374473571777344 nb_pixel_total : 3948 time to create 1 rle with old method : 0.006883144378662109 time for calcul the mask position with numpy : 0.007455348968505859 nb_pixel_total : 11878 time to create 1 rle with old method : 0.01584935188293457 time for calcul the mask position with numpy : 0.011485576629638672 nb_pixel_total : 271445 time to create 1 rle with new method : 0.18240666389465332 create new chi : 0.500370979309082 time to delete rle : 0.0009558200836181641 batch 1 Loaded 9 chid ids of type : 3594 +++++++Number RLEs to save : 4398 TO DO : save crop sub photo not yet done ! save time : 0.5726718902587891 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.07621312141418457 time for calcul the mask position with numpy : 0.023779869079589844 nb_pixel_total : 2029869 time to create 1 rle with new method : 0.12572956085205078 time for calcul the mask position with numpy : 0.006775379180908203 nb_pixel_total : 11623 time to create 1 rle with old method : 0.01491856575012207 time for calcul the mask position with numpy : 0.011981487274169922 nb_pixel_total : 14466 time to create 1 rle with old method : 0.016223669052124023 time for calcul the mask position with numpy : 0.012801170349121094 nb_pixel_total : 17642 time to create 1 rle with old method : 0.019728899002075195 create new chi : 0.24139928817749023 time to delete rle : 0.00047969818115234375 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1786 TO DO : save crop sub photo not yet done ! save time : 0.32746362686157227 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.41107916831970215 time for calcul the mask position with numpy : 0.08046221733093262 nb_pixel_total : 2029807 time to create 1 rle with new method : 0.0998849868774414 time for calcul the mask position with numpy : 0.006989002227783203 nb_pixel_total : 18885 time to create 1 rle with old method : 0.021170616149902344 time for calcul the mask position with numpy : 0.006595611572265625 nb_pixel_total : 9556 time to create 1 rle with old method : 0.010673761367797852 time for calcul the mask position with numpy : 0.007429838180541992 nb_pixel_total : 3610 time to create 1 rle with old method : 0.005706310272216797 time for calcul the mask position with numpy : 0.006610870361328125 nb_pixel_total : 11742 time to create 1 rle with old method : 0.012985467910766602 create new chi : 0.26978325843811035 time to delete rle : 0.00034332275390625 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2132 TO DO : save crop sub photo not yet done ! save time : 0.41439390182495117 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.08260726928710938 time for calcul the mask position with numpy : 0.3736410140991211 nb_pixel_total : 2043528 time to create 1 rle with new method : 0.40946197509765625 time for calcul the mask position with numpy : 0.010440826416015625 nb_pixel_total : 15333 time to create 1 rle with old method : 0.017401695251464844 time for calcul the mask position with numpy : 0.010762929916381836 nb_pixel_total : 6155 time to create 1 rle with old method : 0.006975650787353516 time for calcul the mask position with numpy : 0.008175849914550781 nb_pixel_total : 8584 time to create 1 rle with old method : 0.009718656539916992 create new chi : 0.8593401908874512 time to delete rle : 0.0004677772521972656 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 1777 TO DO : save crop sub photo not yet done ! save time : 0.4041426181793213 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.17406105995178223 time for calcul the mask position with numpy : 0.4322481155395508 nb_pixel_total : 2023586 time to create 1 rle with new method : 0.08992290496826172 time for calcul the mask position with numpy : 0.006246805191040039 nb_pixel_total : 10166 time to create 1 rle with old method : 0.011129140853881836 time for calcul the mask position with numpy : 0.006133556365966797 nb_pixel_total : 10912 time to create 1 rle with old method : 0.01175069808959961 time for calcul the mask position with numpy : 0.006369590759277344 nb_pixel_total : 6766 time to create 1 rle with old method : 0.007469654083251953 time for calcul the mask position with numpy : 0.00620579719543457 nb_pixel_total : 22170 time to create 1 rle with old method : 0.0242156982421875 create new chi : 0.6127145290374756 time to delete rle : 0.00039458274841308594 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2326 TO DO : save crop sub photo not yet done ! save time : 0.48580503463745117 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03731799125671387 time for calcul the mask position with numpy : 0.019275188446044922 nb_pixel_total : 1802553 time to create 1 rle with new method : 0.05875396728515625 time for calcul the mask position with numpy : 0.008535385131835938 nb_pixel_total : 271047 time to create 1 rle with new method : 0.04207301139831543 create new chi : 0.12912678718566895 time to delete rle : 0.0003409385681152344 batch 1 Loaded 3 chid ids of type : 3594 +++++++Number RLEs to save : 2982 TO DO : save crop sub photo not yet done ! save time : 0.4155290126800537 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.6339859962463379 time for calcul the mask position with numpy : 0.08478927612304688 nb_pixel_total : 2050422 time to create 1 rle with new method : 0.10392951965332031 time for calcul the mask position with numpy : 0.009810686111450195 nb_pixel_total : 10205 time to create 1 rle with old method : 0.011521100997924805 time for calcul the mask position with numpy : 0.007010936737060547 nb_pixel_total : 12973 time to create 1 rle with old method : 0.014669179916381836 create new chi : 0.24443745613098145 time to delete rle : 0.0005044937133789062 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1624 TO DO : save crop sub photo not yet done ! save time : 0.40000033378601074 No data in photo_id : 1383263906 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.07796049118041992 time for calcul the mask position with numpy : 0.3941187858581543 nb_pixel_total : 2054941 time to create 1 rle with new method : 0.08953356742858887 time for calcul the mask position with numpy : 0.006749153137207031 nb_pixel_total : 9750 time to create 1 rle with old method : 0.010885000228881836 time for calcul the mask position with numpy : 0.006582498550415039 nb_pixel_total : 4198 time to create 1 rle with old method : 0.0046689510345458984 time for calcul the mask position with numpy : 0.006543636322021484 nb_pixel_total : 4711 time to create 1 rle with old method : 0.005311250686645508 create new chi : 0.5364100933074951 time to delete rle : 0.0003573894500732422 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1738 TO DO : save crop sub photo not yet done ! save time : 0.4036128520965576 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03704977035522461 time for calcul the mask position with numpy : 0.022573232650756836 nb_pixel_total : 2068803 time to create 1 rle with new method : 0.12428045272827148 time for calcul the mask position with numpy : 0.0065746307373046875 nb_pixel_total : 4797 time to create 1 rle with old method : 0.006028652191162109 create new chi : 0.16743969917297363 time to delete rle : 0.0002493858337402344 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1326 TO DO : save crop sub photo not yet done ! save time : 0.3264784812927246 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 1.111886739730835 time for calcul the mask position with numpy : 0.23641133308410645 nb_pixel_total : 2008274 time to create 1 rle with new method : 0.5993411540985107 time for calcul the mask position with numpy : 0.007261991500854492 nb_pixel_total : 8838 time to create 1 rle with old method : 0.009908437728881836 time for calcul the mask position with numpy : 0.011060953140258789 nb_pixel_total : 5776 time to create 1 rle with old method : 0.006585836410522461 time for calcul the mask position with numpy : 0.011287689208984375 nb_pixel_total : 10025 time to create 1 rle with old method : 0.011340618133544922 time for calcul the mask position with numpy : 0.0113525390625 nb_pixel_total : 17967 time to create 1 rle with old method : 0.01997971534729004 time for calcul the mask position with numpy : 0.011708736419677734 nb_pixel_total : 22720 time to create 1 rle with old method : 0.025430917739868164 create new chi : 0.9731109142303467 time to delete rle : 0.0004820823669433594 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 2730 TO DO : save crop sub photo not yet done ! save time : 0.5327787399291992 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.11570906639099121 time for calcul the mask position with numpy : 0.0341191291809082 nb_pixel_total : 2050407 time to create 1 rle with new method : 0.13074278831481934 time for calcul the mask position with numpy : 0.007114887237548828 nb_pixel_total : 9916 time to create 1 rle with old method : 0.011075496673583984 time for calcul the mask position with numpy : 0.006970405578613281 nb_pixel_total : 4281 time to create 1 rle with old method : 0.004812002182006836 time for calcul the mask position with numpy : 0.01187276840209961 nb_pixel_total : 8996 time to create 1 rle with old method : 0.01004648208618164 create new chi : 0.2171933650970459 time to delete rle : 0.0003647804260253906 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 1910 TO DO : save crop sub photo not yet done ! save time : 0.3968520164489746 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.05975794792175293 time for calcul the mask position with numpy : 0.026342391967773438 nb_pixel_total : 2059585 time to create 1 rle with new method : 0.3510925769805908 time for calcul the mask position with numpy : 0.00682520866394043 nb_pixel_total : 6572 time to create 1 rle with old method : 0.007460832595825195 time for calcul the mask position with numpy : 0.007115602493286133 nb_pixel_total : 7443 time to create 1 rle with old method : 0.0084381103515625 create new chi : 0.4076502323150635 time to delete rle : 0.0004646778106689453 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 1424 TO DO : save crop sub photo not yet done ! save time : 0.26354527473449707 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 1.1329841613769531 time for calcul the mask position with numpy : 0.0704185962677002 nb_pixel_total : 2038044 time to create 1 rle with new method : 0.10699105262756348 time for calcul the mask position with numpy : 0.00803375244140625 nb_pixel_total : 9853 time to create 1 rle with old method : 0.011352062225341797 time for calcul the mask position with numpy : 0.0071659088134765625 nb_pixel_total : 13350 time to create 1 rle with old method : 0.01636528968811035 time for calcul the mask position with numpy : 0.0062046051025390625 nb_pixel_total : 7590 time to create 1 rle with old method : 0.008861541748046875 time for calcul the mask position with numpy : 0.0061872005462646484 nb_pixel_total : 4763 time to create 1 rle with old method : 0.005362033843994141 create new chi : 0.2620816230773926 time to delete rle : 0.0003991127014160156 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2182 TO DO : save crop sub photo not yet done ! save time : 0.37751078605651855 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.05454444885253906 time for calcul the mask position with numpy : 0.024216413497924805 nb_pixel_total : 2064296 time to create 1 rle with new method : 0.06164097785949707 time for calcul the mask position with numpy : 0.006369829177856445 nb_pixel_total : 9304 time to create 1 rle with old method : 0.010411500930786133 create new chi : 0.1029057502746582 time to delete rle : 0.00024628639221191406 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1370 TO DO : save crop sub photo not yet done ! save time : 0.2640039920806885 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.11199593544006348 time for calcul the mask position with numpy : 0.0205838680267334 nb_pixel_total : 2047788 time to create 1 rle with new method : 0.6567566394805908 time for calcul the mask position with numpy : 0.006675243377685547 nb_pixel_total : 7512 time to create 1 rle with old method : 0.00845193862915039 time for calcul the mask position with numpy : 0.006429433822631836 nb_pixel_total : 6955 time to create 1 rle with old method : 0.007803440093994141 time for calcul the mask position with numpy : 0.006667137145996094 nb_pixel_total : 11345 time to create 1 rle with old method : 0.012632131576538086 create new chi : 0.7372283935546875 time to delete rle : 0.00039958953857421875 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1848 TO DO : save crop sub photo not yet done ! save time : 0.37541651725769043 map_output_result : {1383263994: (0.0, 'Should be the crop_list due to order', 0), 1383263991: (0.0, 'Should be the crop_list due to order', 0), 1383263988: (0.0, 'Should be the crop_list due to order', 0), 1383263939: (0.0, 'Should be the crop_list due to order', 0), 1383263937: (0.0, 'Should be the crop_list due to order', 0), 1383263934: (0.0, 'Should be the crop_list due to order', 0), 1383263931: (0.0, 'Should be the crop_list due to order', 0), 1383263910: (0.0, 'Should be the crop_list due to order', 0), 1383263906: (0.0, 'Should be the crop_list due to order', 0.0), 1383263904: (0.0, 'Should be the crop_list due to order', 0), 1383263900: (0.0, 'Should be the crop_list due to order', 0), 1383263897: (0.0, 'Should be the crop_list due to order', 0), 1383263894: (0.0, 'Should be the crop_list due to order', 0), 1383263856: (0.0, 'Should be the crop_list due to order', 0), 1383263854: (0.0, 'Should be the crop_list due to order', 0), 1383263852: (0.0, 'Should be the crop_list due to order', 0), 1383263848: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1383263994, 1383263991, 1383263988, 1383263939, 1383263937, 1383263934, 1383263931, 1383263910, 1383263906, 1383263904, 1383263900, 1383263897, 1383263894, 1383263856, 1383263854, 1383263852, 1383263848] Looping around the photos to save general results len do output : 17 /1383263994.Didn't retrieve data . /1383263991.Didn't retrieve data . /1383263988.Didn't retrieve data . /1383263939.Didn't retrieve data . /1383263937.Didn't retrieve data . /1383263934.Didn't retrieve data . /1383263931.Didn't retrieve data . /1383263910.Didn't retrieve data . /1383263906.Didn't retrieve data . /1383263904.Didn't retrieve data . /1383263900.Didn't retrieve data . /1383263897.Didn't retrieve data . /1383263894.Didn't retrieve data . /1383263856.Didn't retrieve data . /1383263854.Didn't retrieve data . /1383263852.Didn't retrieve data . /1383263848.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263994', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263991', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263988', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263939', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263937', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263934', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263931', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263910', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263906', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263904', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263900', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263897', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263894', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263856', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263854', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263852', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263848', None, None, None, None, None, '3695524') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 51 time used for this insertion : 0.04179787635803223 save_final save missing photos in datou_result : time spend for datou_step_exec : 18.515974283218384 time spend to save output : 0.04253053665161133 total time spend for step 3 : 18.558504819869995 step4:ventilate_hashtags_in_portfolio Thu Sep 11 18:11:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26761139 get user id for portfolio 26761139 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26761139 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','pehd','pet_clair','background','autre','metal','flou','papier','mal_croppe','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26761139 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','pehd','pet_clair','background','autre','metal','flou','papier','mal_croppe','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26761725,26761726,26761727,26761729,26761730,26761731,26761732,26761733,26761734,26761735,26761736?tags=environnement,pet_clair,pet_fonce,carton,autre,papier,flou,pehd,metal,mal_croppe,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1383263994, 1383263991, 1383263988, 1383263939, 1383263937, 1383263934, 1383263931, 1383263910, 1383263906, 1383263904, 1383263900, 1383263897, 1383263894, 1383263856, 1383263854, 1383263852, 1383263848] Looping around the photos to save general results len do output : 1 /26761139. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263994', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263991', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263988', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263939', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263937', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263934', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263931', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263910', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263906', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263904', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263900', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263897', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263894', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263856', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263854', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263852', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263848', None, None, None, None, None, '3695524') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.04748988151550293 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.778949499130249 time spend to save output : 0.04792618751525879 total time spend for step 4 : 1.8268756866455078 step5:final Thu Sep 11 18:11:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1383263994: ('0.05953526877572015',), 1383263991: ('0.05953526877572015',), 1383263988: ('0.05953526877572015',), 1383263939: ('0.05953526877572015',), 1383263937: ('0.05953526877572015',), 1383263934: ('0.05953526877572015',), 1383263931: ('0.05953526877572015',), 1383263910: ('0.05953526877572015',), 1383263906: ('0.05953526877572015',), 1383263904: ('0.05953526877572015',), 1383263900: ('0.05953526877572015',), 1383263897: ('0.05953526877572015',), 1383263894: ('0.05953526877572015',), 1383263856: ('0.05953526877572015',), 1383263854: ('0.05953526877572015',), 1383263852: ('0.05953526877572015',), 1383263848: ('0.05953526877572015',)} new output for save of step final : {1383263994: ('0.05953526877572015',), 1383263991: ('0.05953526877572015',), 1383263988: ('0.05953526877572015',), 1383263939: ('0.05953526877572015',), 1383263937: ('0.05953526877572015',), 1383263934: ('0.05953526877572015',), 1383263931: ('0.05953526877572015',), 1383263910: ('0.05953526877572015',), 1383263906: ('0.05953526877572015',), 1383263904: ('0.05953526877572015',), 1383263900: ('0.05953526877572015',), 1383263897: ('0.05953526877572015',), 1383263894: ('0.05953526877572015',), 1383263856: ('0.05953526877572015',), 1383263854: ('0.05953526877572015',), 1383263852: ('0.05953526877572015',), 1383263848: ('0.05953526877572015',)} [1383263994, 1383263991, 1383263988, 1383263939, 1383263937, 1383263934, 1383263931, 1383263910, 1383263906, 1383263904, 1383263900, 1383263897, 1383263894, 1383263856, 1383263854, 1383263852, 1383263848] Looping around the photos to save general results len do output : 17 /1383263994.Didn't retrieve data . /1383263991.Didn't retrieve data . /1383263988.Didn't retrieve data . /1383263939.Didn't retrieve data . /1383263937.Didn't retrieve data . /1383263934.Didn't retrieve data . /1383263931.Didn't retrieve data . /1383263910.Didn't retrieve data . /1383263906.Didn't retrieve data . /1383263904.Didn't retrieve data . /1383263900.Didn't retrieve data . /1383263897.Didn't retrieve data . /1383263894.Didn't retrieve data . /1383263856.Didn't retrieve data . /1383263854.Didn't retrieve data . /1383263852.Didn't retrieve data . /1383263848.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263994', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263991', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263988', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263939', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263937', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263934', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263931', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263910', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263906', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263904', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263900', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263897', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263894', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263856', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263854', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263852', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263848', None, None, None, None, None, '3695524') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 51 time used for this insertion : 0.04658341407775879 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.46007847785949707 time spend to save output : 0.047306060791015625 total time spend for step 5 : 0.5073845386505127 step6:blur_detection Thu Sep 11 18:11:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1757607029_1843230_1383263994_0718ff376a914128b73403ffa1a29ac0.jpg resize: (1080, 1920) 1383263994 0.22926671350384464 treat image : temp/1757607029_1843230_1383263991_182c85e7110cbb4416ca750051ae645b.jpg resize: (1080, 1920) 1383263991 0.634687261487593 treat image : temp/1757607029_1843230_1383263988_060be9bd84ec8717ea1bce3ce9c68d3a.jpg resize: (1080, 1920) 1383263988 0.13544085104128253 treat image : temp/1757607029_1843230_1383263939_5c8915f4cb68077aaebd17da410d533a.jpg resize: (1080, 1920) 1383263939 -0.2352519985733176 treat image : temp/1757607029_1843230_1383263937_fff708d004c1e5327cbbeb17230e91f6.jpg resize: (1080, 1920) 1383263937 0.20442120126879346 treat image : temp/1757607029_1843230_1383263934_0cf03a71ae0c9eb9dd42e607e83a6363.jpg resize: (1080, 1920) 1383263934 2.2513349414374892 treat image : temp/1757607029_1843230_1383263931_f6be7ec11898f5012537aed51dd82b49.jpg resize: (1080, 1920) 1383263931 0.7271700776459782 treat image : temp/1757607029_1843230_1383263910_7f4ad3d7b561daa470741e40e1302320.jpg resize: (1080, 1920) 1383263910 0.7781470096488222 treat image : temp/1757607029_1843230_1383263906_64ad1c195f5cb465ca118f7bd73b1d3d.jpg resize: (1080, 1920) 1383263906 0.7105937476328543 treat image : temp/1757607029_1843230_1383263904_96c50c7a6779f6f863ebcab81401e835.jpg resize: (1080, 1920) 1383263904 0.22817081737654657 treat image : temp/1757607029_1843230_1383263900_8422df6d635da4c9767fc32992da7f3c.jpg resize: (1080, 1920) 1383263900 0.43350782628484824 treat image : temp/1757607029_1843230_1383263897_f5e4f5ff0d4b3369f7d8c173875bc080.jpg resize: (1080, 1920) 1383263897 0.48570035687797275 treat image : temp/1757607029_1843230_1383263894_fb67e6ad3345cf50e865c133f770833c.jpg resize: (1080, 1920) 1383263894 0.3371427270533246 treat image : temp/1757607029_1843230_1383263856_0797a490a2d2363c47ad2e1e45659580.jpg resize: (1080, 1920) 1383263856 0.19773897312241986 treat image : temp/1757607029_1843230_1383263854_ce6ef54356ab729b921a678a2bf3f76c.jpg resize: (1080, 1920) 1383263854 -0.655863544798674 treat image : temp/1757607029_1843230_1383263852_a6a71b4100a49d88c4c76ad3f6889187.jpg resize: (1080, 1920) 1383263852 -0.151764227962281 treat image : temp/1757607029_1843230_1383263848_671655e1129159b39542c97f1a4a0bf5.jpg resize: (1080, 1920) 1383263848 -0.4163650815687996 treat image : temp/1757607029_1843230_1383263994_0718ff376a914128b73403ffa1a29ac0_rle_crop_3955721585_0.png resize: (172, 119) 1383285108 -1.2610187639899721 treat image : temp/1757607029_1843230_1383263994_0718ff376a914128b73403ffa1a29ac0_rle_crop_3955721586_0.png resize: (88, 85) 1383285109 -1.076790828953897 treat image : temp/1757607029_1843230_1383263939_5c8915f4cb68077aaebd17da410d533a_rle_crop_3955721596_0.png resize: (167, 94) 1383285111 -0.4986945167932624 treat image : temp/1757607029_1843230_1383263939_5c8915f4cb68077aaebd17da410d533a_rle_crop_3955721597_0.png resize: (176, 177) 1383285112 -2.531154777108163 treat image : temp/1757607029_1843230_1383263939_5c8915f4cb68077aaebd17da410d533a_rle_crop_3955721595_0.png resize: (41, 129) 1383285113 -0.5167390963724116 treat image : temp/1757607029_1843230_1383263937_fff708d004c1e5327cbbeb17230e91f6_rle_crop_3955721599_0.png resize: (64, 167) 1383285115 -2.508378631121972 treat image : temp/1757607029_1843230_1383263934_0cf03a71ae0c9eb9dd42e607e83a6363_rle_crop_3955721603_0.png resize: (180, 110) 1383285116 -0.4679251877070247 treat image : temp/1757607029_1843230_1383263931_f6be7ec11898f5012537aed51dd82b49_rle_crop_3955721605_0.png resize: (813, 836) 1383285117 0.3964225431810498 treat image : temp/1757607029_1843230_1383263904_96c50c7a6779f6f863ebcab81401e835_rle_crop_3955721610_0.png resize: (186, 116) 1383285118 -1.9368017503842623 treat image : temp/1757607029_1843230_1383263904_96c50c7a6779f6f863ebcab81401e835_rle_crop_3955721608_0.png resize: (49, 129) 1383285119 1.3023746228319344 treat image : temp/1757607029_1843230_1383263904_96c50c7a6779f6f863ebcab81401e835_rle_crop_3955721609_0.png resize: (93, 52) 1383285121 2.918205120051741 treat image : temp/1757607029_1843230_1383263900_8422df6d635da4c9767fc32992da7f3c_rle_crop_3955721611_0.png resize: (123, 72) 1383285122 -2.0884294093377664 treat image : temp/1757607029_1843230_1383263897_f5e4f5ff0d4b3369f7d8c173875bc080_rle_crop_3955721615_0.png resize: (93, 160) 1383285123 -0.9728204814520982 treat image : temp/1757607029_1843230_1383263897_f5e4f5ff0d4b3369f7d8c173875bc080_rle_crop_3955721613_0.png resize: (157, 142) 1383285124 -1.2965839492024192 treat image : temp/1757607029_1843230_1383263894_fb67e6ad3345cf50e865c133f770833c_rle_crop_3955721619_0.png resize: (178, 100) 1383285125 -0.9675843713885411 treat image : temp/1757607029_1843230_1383263894_fb67e6ad3345cf50e865c133f770833c_rle_crop_3955721618_0.png resize: (68, 115) 1383285126 -0.8919387911924099 treat image : temp/1757607029_1843230_1383263894_fb67e6ad3345cf50e865c133f770833c_rle_crop_3955721617_0.png resize: (115, 133) 1383285127 -1.0939745658667905 treat image : temp/1757607029_1843230_1383263856_0797a490a2d2363c47ad2e1e45659580_rle_crop_3955721621_0.png resize: (72, 162) 1383285128 -1.7586673378901894 treat image : temp/1757607029_1843230_1383263856_0797a490a2d2363c47ad2e1e45659580_rle_crop_3955721620_0.png resize: (87, 109) 1383285129 0.8522209050451629 treat image : temp/1757607029_1843230_1383263854_ce6ef54356ab729b921a678a2bf3f76c_rle_crop_3955721622_0.png resize: (134, 75) 1383285130 -2.4146501591825325 treat image : temp/1757607029_1843230_1383263854_ce6ef54356ab729b921a678a2bf3f76c_rle_crop_3955721623_0.png resize: (196, 58) 1383285131 -1.3250774943721235 treat image : temp/1757607029_1843230_1383263848_671655e1129159b39542c97f1a4a0bf5_rle_crop_3955721627_0.png resize: (135, 146) 1383285133 1.1451747467059192 treat image : temp/1757607029_1843230_1383263848_671655e1129159b39542c97f1a4a0bf5_rle_crop_3955721628_0.png resize: (116, 104) 1383285134 0.06804349242329562 treat image : temp/1757607029_1843230_1383263848_671655e1129159b39542c97f1a4a0bf5_rle_crop_3955721629_0.png resize: (122, 92) 1383285135 -0.5207531588327674 treat image : temp/1757607029_1843230_1383263991_182c85e7110cbb4416ca750051ae645b_rle_crop_3955721587_0.png resize: (887, 733) 1383285138 0.050572907478053965 treat image : temp/1757607029_1843230_1383263991_182c85e7110cbb4416ca750051ae645b_rle_crop_3955721589_0.png resize: (69, 69) 1383285139 8.344757244071994 treat image : temp/1757607029_1843230_1383263991_182c85e7110cbb4416ca750051ae645b_rle_crop_3955721588_0.png resize: (153, 147) 1383285140 -1.7961652073522785 treat image : temp/1757607029_1843230_1383263910_7f4ad3d7b561daa470741e40e1302320_rle_crop_3955721607_0.png resize: (102, 124) 1383285141 0.4036209687655481 treat image : temp/1757607029_1843230_1383263897_f5e4f5ff0d4b3369f7d8c173875bc080_rle_crop_3955721614_0.png resize: (95, 131) 1383285142 0.1855755558170731 treat image : temp/1757607029_1843230_1383263852_a6a71b4100a49d88c4c76ad3f6889187_rle_crop_3955721626_0.png resize: (126, 99) 1383285143 -1.236719990060662 treat image : temp/1757607029_1843230_1383263988_060be9bd84ec8717ea1bce3ce9c68d3a_rle_crop_3955721593_0.png resize: (88, 178) 1383285145 -4.124728952118774 treat image : temp/1757607029_1843230_1383263988_060be9bd84ec8717ea1bce3ce9c68d3a_rle_crop_3955721592_0.png resize: (171, 111) 1383285148 -1.1132495231529311 treat image : temp/1757607029_1843230_1383263988_060be9bd84ec8717ea1bce3ce9c68d3a_rle_crop_3955721591_0.png resize: (91, 232) 1383285149 0.5183775808112667 treat image : temp/1757607029_1843230_1383263939_5c8915f4cb68077aaebd17da410d533a_rle_crop_3955721594_0.png resize: (140, 128) 1383285150 -1.2033961266119093 treat image : temp/1757607029_1843230_1383263937_fff708d004c1e5327cbbeb17230e91f6_rle_crop_3955721600_0.png resize: (145, 149) 1383285151 -1.4968577683232775 treat image : temp/1757607029_1843230_1383263937_fff708d004c1e5327cbbeb17230e91f6_rle_crop_3955721598_0.png resize: (121, 120) 1383285152 -1.639933775379083 treat image : temp/1757607029_1843230_1383263910_7f4ad3d7b561daa470741e40e1302320_rle_crop_3955721606_0.png resize: (165, 98) 1383285154 0.3546103370676504 treat image : temp/1757607029_1843230_1383263897_f5e4f5ff0d4b3369f7d8c173875bc080_rle_crop_3955721616_0.png resize: (142, 86) 1383285155 -0.5430092471380584 treat image : temp/1757607029_1843230_1383263897_f5e4f5ff0d4b3369f7d8c173875bc080_rle_crop_3955721612_0.png resize: (268, 141) 1383285156 -0.514293468034349 treat image : temp/1757607029_1843230_1383263854_ce6ef54356ab729b921a678a2bf3f76c_rle_crop_3955721625_0.png resize: (116, 133) 1383285158 -0.9472595382746404 treat image : temp/1757607029_1843230_1383263991_182c85e7110cbb4416ca750051ae645b_rle_crop_3955721590_0.png resize: (175, 86) 1383285161 -0.2440071481125765 treat image : temp/1757607029_1843230_1383263934_0cf03a71ae0c9eb9dd42e607e83a6363_rle_crop_3955721601_0.png resize: (234, 165) 1383285162 -1.7861385005147201 treat image : temp/1757607029_1843230_1383263934_0cf03a71ae0c9eb9dd42e607e83a6363_rle_crop_3955721602_0.png resize: (108, 91) 1383285163 -1.0778997995927668 treat image : temp/1757607029_1843230_1383263934_0cf03a71ae0c9eb9dd42e607e83a6363_rle_crop_3955721604_0.png resize: (99, 145) 1383285164 -0.596126441206003 treat image : temp/1757607029_1843230_1383263854_ce6ef54356ab729b921a678a2bf3f76c_rle_crop_3955721624_0.png resize: (93, 181) 1383285165 -1.5180288526700565 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 62 time used for this insertion : 0.025995492935180664 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 62 time used for this insertion : 0.02562999725341797 save missing photos in datou_result : time spend for datou_step_exec : 15.3719482421875 time spend to save output : 0.062188148498535156 total time spend for step 6 : 15.434136390686035 step7:brightness Thu Sep 11 18:12:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1757607029_1843230_1383263994_0718ff376a914128b73403ffa1a29ac0.jpg treat image : temp/1757607029_1843230_1383263991_182c85e7110cbb4416ca750051ae645b.jpg treat image : temp/1757607029_1843230_1383263988_060be9bd84ec8717ea1bce3ce9c68d3a.jpg treat image : temp/1757607029_1843230_1383263939_5c8915f4cb68077aaebd17da410d533a.jpg treat image : temp/1757607029_1843230_1383263937_fff708d004c1e5327cbbeb17230e91f6.jpg treat image : temp/1757607029_1843230_1383263934_0cf03a71ae0c9eb9dd42e607e83a6363.jpg treat image : temp/1757607029_1843230_1383263931_f6be7ec11898f5012537aed51dd82b49.jpg treat image : temp/1757607029_1843230_1383263910_7f4ad3d7b561daa470741e40e1302320.jpg treat image : temp/1757607029_1843230_1383263906_64ad1c195f5cb465ca118f7bd73b1d3d.jpg treat image : temp/1757607029_1843230_1383263904_96c50c7a6779f6f863ebcab81401e835.jpg treat image : temp/1757607029_1843230_1383263900_8422df6d635da4c9767fc32992da7f3c.jpg treat image : temp/1757607029_1843230_1383263897_f5e4f5ff0d4b3369f7d8c173875bc080.jpg treat image : temp/1757607029_1843230_1383263894_fb67e6ad3345cf50e865c133f770833c.jpg treat image : temp/1757607029_1843230_1383263856_0797a490a2d2363c47ad2e1e45659580.jpg treat image : temp/1757607029_1843230_1383263854_ce6ef54356ab729b921a678a2bf3f76c.jpg treat image : temp/1757607029_1843230_1383263852_a6a71b4100a49d88c4c76ad3f6889187.jpg treat image : temp/1757607029_1843230_1383263848_671655e1129159b39542c97f1a4a0bf5.jpg treat image : temp/1757607029_1843230_1383263994_0718ff376a914128b73403ffa1a29ac0_rle_crop_3955721585_0.png treat image : temp/1757607029_1843230_1383263994_0718ff376a914128b73403ffa1a29ac0_rle_crop_3955721586_0.png treat image : temp/1757607029_1843230_1383263939_5c8915f4cb68077aaebd17da410d533a_rle_crop_3955721596_0.png treat image : temp/1757607029_1843230_1383263939_5c8915f4cb68077aaebd17da410d533a_rle_crop_3955721597_0.png treat image : temp/1757607029_1843230_1383263939_5c8915f4cb68077aaebd17da410d533a_rle_crop_3955721595_0.png treat image : temp/1757607029_1843230_1383263937_fff708d004c1e5327cbbeb17230e91f6_rle_crop_3955721599_0.png treat image : temp/1757607029_1843230_1383263934_0cf03a71ae0c9eb9dd42e607e83a6363_rle_crop_3955721603_0.png treat image : temp/1757607029_1843230_1383263931_f6be7ec11898f5012537aed51dd82b49_rle_crop_3955721605_0.png treat image : temp/1757607029_1843230_1383263904_96c50c7a6779f6f863ebcab81401e835_rle_crop_3955721610_0.png treat image : temp/1757607029_1843230_1383263904_96c50c7a6779f6f863ebcab81401e835_rle_crop_3955721608_0.png treat image : temp/1757607029_1843230_1383263904_96c50c7a6779f6f863ebcab81401e835_rle_crop_3955721609_0.png treat image : temp/1757607029_1843230_1383263900_8422df6d635da4c9767fc32992da7f3c_rle_crop_3955721611_0.png treat image : temp/1757607029_1843230_1383263897_f5e4f5ff0d4b3369f7d8c173875bc080_rle_crop_3955721615_0.png treat image : temp/1757607029_1843230_1383263897_f5e4f5ff0d4b3369f7d8c173875bc080_rle_crop_3955721613_0.png treat image : temp/1757607029_1843230_1383263894_fb67e6ad3345cf50e865c133f770833c_rle_crop_3955721619_0.png treat image : temp/1757607029_1843230_1383263894_fb67e6ad3345cf50e865c133f770833c_rle_crop_3955721618_0.png treat image : temp/1757607029_1843230_1383263894_fb67e6ad3345cf50e865c133f770833c_rle_crop_3955721617_0.png treat image : temp/1757607029_1843230_1383263856_0797a490a2d2363c47ad2e1e45659580_rle_crop_3955721621_0.png treat image : temp/1757607029_1843230_1383263856_0797a490a2d2363c47ad2e1e45659580_rle_crop_3955721620_0.png treat image : temp/1757607029_1843230_1383263854_ce6ef54356ab729b921a678a2bf3f76c_rle_crop_3955721622_0.png treat image : temp/1757607029_1843230_1383263854_ce6ef54356ab729b921a678a2bf3f76c_rle_crop_3955721623_0.png treat image : temp/1757607029_1843230_1383263848_671655e1129159b39542c97f1a4a0bf5_rle_crop_3955721627_0.png treat image : temp/1757607029_1843230_1383263848_671655e1129159b39542c97f1a4a0bf5_rle_crop_3955721628_0.png treat image : temp/1757607029_1843230_1383263848_671655e1129159b39542c97f1a4a0bf5_rle_crop_3955721629_0.png treat image : temp/1757607029_1843230_1383263991_182c85e7110cbb4416ca750051ae645b_rle_crop_3955721587_0.png treat image : temp/1757607029_1843230_1383263991_182c85e7110cbb4416ca750051ae645b_rle_crop_3955721589_0.png treat image : temp/1757607029_1843230_1383263991_182c85e7110cbb4416ca750051ae645b_rle_crop_3955721588_0.png treat image : temp/1757607029_1843230_1383263910_7f4ad3d7b561daa470741e40e1302320_rle_crop_3955721607_0.png treat image : temp/1757607029_1843230_1383263897_f5e4f5ff0d4b3369f7d8c173875bc080_rle_crop_3955721614_0.png treat image : temp/1757607029_1843230_1383263852_a6a71b4100a49d88c4c76ad3f6889187_rle_crop_3955721626_0.png treat image : temp/1757607029_1843230_1383263988_060be9bd84ec8717ea1bce3ce9c68d3a_rle_crop_3955721593_0.png treat image : temp/1757607029_1843230_1383263988_060be9bd84ec8717ea1bce3ce9c68d3a_rle_crop_3955721592_0.png treat image : temp/1757607029_1843230_1383263988_060be9bd84ec8717ea1bce3ce9c68d3a_rle_crop_3955721591_0.png treat image : temp/1757607029_1843230_1383263939_5c8915f4cb68077aaebd17da410d533a_rle_crop_3955721594_0.png treat image : temp/1757607029_1843230_1383263937_fff708d004c1e5327cbbeb17230e91f6_rle_crop_3955721600_0.png treat image : temp/1757607029_1843230_1383263937_fff708d004c1e5327cbbeb17230e91f6_rle_crop_3955721598_0.png treat image : temp/1757607029_1843230_1383263910_7f4ad3d7b561daa470741e40e1302320_rle_crop_3955721606_0.png treat image : temp/1757607029_1843230_1383263897_f5e4f5ff0d4b3369f7d8c173875bc080_rle_crop_3955721616_0.png treat image : temp/1757607029_1843230_1383263897_f5e4f5ff0d4b3369f7d8c173875bc080_rle_crop_3955721612_0.png treat image : temp/1757607029_1843230_1383263854_ce6ef54356ab729b921a678a2bf3f76c_rle_crop_3955721625_0.png treat image : temp/1757607029_1843230_1383263991_182c85e7110cbb4416ca750051ae645b_rle_crop_3955721590_0.png treat image : temp/1757607029_1843230_1383263934_0cf03a71ae0c9eb9dd42e607e83a6363_rle_crop_3955721601_0.png treat image : temp/1757607029_1843230_1383263934_0cf03a71ae0c9eb9dd42e607e83a6363_rle_crop_3955721602_0.png treat image : temp/1757607029_1843230_1383263934_0cf03a71ae0c9eb9dd42e607e83a6363_rle_crop_3955721604_0.png treat image : temp/1757607029_1843230_1383263854_ce6ef54356ab729b921a678a2bf3f76c_rle_crop_3955721624_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 62 time used for this insertion : 0.022631406784057617 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 62 time used for this insertion : 0.02129387855529785 save missing photos in datou_result : time spend for datou_step_exec : 4.586184978485107 time spend to save output : 0.05390167236328125 total time spend for step 7 : 4.640086650848389 step8:velours_tree Thu Sep 11 18:12:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.4831061363220215 time spend to save output : 3.9577484130859375e-05 total time spend for step 8 : 0.48314571380615234 step9:send_mail_cod Thu Sep 11 18:12:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26761139_11-09-2025_18_12_10.pdf 26761726 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267617261757607130 26761727 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267617271757607132 26761729 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267617291757607132 26761730 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267617301757607134 26761731 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267617311757607135 26761732 imagette267617321757607136 26761733 change filename to text .change filename to text .change filename to text .imagette267617331757607136 26761734 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267617341757607137 26761735 imagette267617351757607137 26761736 imagette267617361757607137 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26761139 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26761725,26761726,26761727,26761729,26761730,26761731,26761732,26761733,26761734,26761735,26761736?tags=environnement,pet_clair,pet_fonce,carton,autre,papier,flou,pehd,metal,mal_croppe,background args[1383263994] : ((1383263994, 0.22926671350384464, 492688767), (1383263994, 0.40517172487843295, 2107752395), '0.05953526877572015') We are sending mail with results at report@fotonower.com args[1383263991] : ((1383263991, 0.634687261487593, 492688767), (1383263991, 0.7147599012562132, 2107752395), '0.05953526877572015') We are sending mail with results at report@fotonower.com args[1383263988] : ((1383263988, 0.13544085104128253, 492688767), (1383263988, 0.5952519185158355, 2107752395), '0.05953526877572015') We are sending mail with results at report@fotonower.com args[1383263939] : ((1383263939, -0.2352519985733176, 492688767), (1383263939, 0.7976020752024615, 2107752395), '0.05953526877572015') We are sending mail with results at report@fotonower.com args[1383263937] : ((1383263937, 0.20442120126879346, 492688767), (1383263937, 0.6243514491203866, 2107752395), '0.05953526877572015') We are sending mail with results at report@fotonower.com args[1383263934] : ((1383263934, 2.2513349414374892, 492688767), (1383263934, 0.32258842621035216, 2107752395), '0.05953526877572015') We are sending mail with results at report@fotonower.com args[1383263931] : ((1383263931, 0.7271700776459782, 492688767), (1383263931, 0.41470913893339, 2107752395), '0.05953526877572015') We are sending mail with results at report@fotonower.com args[1383263910] : ((1383263910, 0.7781470096488222, 492688767), (1383263910, 0.5844540266815388, 2107752395), '0.05953526877572015') We are sending mail with results at report@fotonower.com args[1383263906] : ((1383263906, 0.7105937476328543, 492688767), (1383263906, 0.7598801966775959, 2107752395), '0.05953526877572015') We are sending mail with results at report@fotonower.com args[1383263904] : ((1383263904, 0.22817081737654657, 492688767), (1383263904, 0.8320480573045943, 2107752395), '0.05953526877572015') We are sending mail with results at report@fotonower.com args[1383263900] : ((1383263900, 0.43350782628484824, 492688767), (1383263900, 0.8498018731256738, 2107752395), '0.05953526877572015') We are sending mail with results at report@fotonower.com args[1383263897] : ((1383263897, 0.48570035687797275, 492688767), (1383263897, 0.9145932535274401, 2107752395), '0.05953526877572015') We are sending mail with results at report@fotonower.com args[1383263894] : ((1383263894, 0.3371427270533246, 492688767), (1383263894, 0.6594854279554443, 2107752395), '0.05953526877572015') We are sending mail with results at report@fotonower.com args[1383263856] : ((1383263856, 0.19773897312241986, 492688767), (1383263856, 0.6813678906570003, 2107752395), '0.05953526877572015') We are sending mail with results at report@fotonower.com args[1383263854] : ((1383263854, -0.655863544798674, 492688767), (1383263854, 0.4388418096962241, 2107752395), '0.05953526877572015') We are sending mail with results at report@fotonower.com args[1383263852] : ((1383263852, -0.151764227962281, 492688767), (1383263852, 0.45450469685140193, 2107752395), '0.05953526877572015') We are sending mail with results at report@fotonower.com args[1383263848] : ((1383263848, -0.4163650815687996, 492688767), (1383263848, 0.46787924081025895, 2107752395), '0.05953526877572015') We are sending mail with results at report@fotonower.com refus_total : 0.05953526877572015 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26761139 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26761139_11-09-2025_18_12_10.pdf results_Auto_P26761139_11-09-2025_18_12_10.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26761139_11-09-2025_18_12_10.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26761139','results_Auto_P26761139_11-09-2025_18_12_10.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26761139_11-09-2025_18_12_10.pdf','pdf','','0.51','0.05953526877572015') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26761139

https://www.fotonower.com/image?json=false&list_photos_id=1383263994
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383263991
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383263988
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383263939
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383263937
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383263934
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.2513349414374892)
https://www.fotonower.com/image?json=false&list_photos_id=1383263931
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383263910
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383263906
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383263904
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383263900
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383263897
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383263894
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383263856
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383263854
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383263852
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383263848
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 5.95%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/26761726?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/26761727?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26761729?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26761730?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26761731?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/26761733?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26761734?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26761139_11-09-2025_18_12_10.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26761725,26761726,26761727,26761729,26761730,26761731,26761732,26761733,26761734,26761735,26761736?tags=environnement,pet_clair,pet_fonce,carton,autre,papier,flou,pehd,metal,mal_croppe,background.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 11 Sep 2025 16:12:20 GMT Content-Length: 0 Connection: close X-Message-Id: Tc8rJWGQRvOoBgiBaVA39w Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1383263994, 1383263991, 1383263988, 1383263939, 1383263937, 1383263934, 1383263931, 1383263910, 1383263906, 1383263904, 1383263900, 1383263897, 1383263894, 1383263856, 1383263854, 1383263852, 1383263848] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263994', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263991', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263988', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263939', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263937', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263934', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263931', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263910', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263906', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263904', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263900', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263897', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263894', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263856', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263854', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263852', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263848', None, None, None, None, None, '3695524') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 17 time used for this insertion : 0.033217430114746094 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.984968900680542 time spend to save output : 0.03351759910583496 total time spend for step 9 : 10.018486499786377 step10:split_time_score Thu Sep 11 18:12:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 57),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 11092025 26761139 Nombre de photos uploadées : 57 / 23040 (0%) 11092025 26761139 Nombre de photos taguées (types de déchets): 0 / 57 (0%) 11092025 26761139 Nombre de photos taguées (volume) : 0 / 57 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 8.344650268554688e-06 ????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.002687215805053711 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.5502126216888428 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.05722602666323731 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26751062_11-09-2025_10_01_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26751062 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26751062 AND mptpi.`type`=3594 To do Qualite : 0.1438553942199775 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26751066_11-09-2025_11_01_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26751066 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26751066 AND mptpi.`type`=3594 To do Qualite : 0.06537318351337448 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26751071_11-09-2025_09_41_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26751071 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26751071 AND mptpi.`type`=3594 To do Qualite : 0.06314996999314128 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26751073_11-09-2025_09_31_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26751073 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26751073 AND mptpi.`type`=3594 To do Qualite : 0.07311159336419751 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26761139_11-09-2025_18_12_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26761139 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26761139 AND mptpi.`type`=3594 To do Qualite : 0.032763852719907414 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26761147_11-09-2025_12_51_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26761147 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26761147 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'11092025': {'nb_upload': 57, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1383263994, 1383263991, 1383263988, 1383263939, 1383263937, 1383263934, 1383263931, 1383263910, 1383263906, 1383263904, 1383263900, 1383263897, 1383263894, 1383263856, 1383263854, 1383263852, 1383263848] Looping around the photos to save general results len do output : 1 /26761139Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263994', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263991', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263988', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263939', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263937', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263934', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263931', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263910', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263906', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263904', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263900', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263897', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263894', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263856', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263854', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263852', None, None, None, None, None, '3695524') ('3318', None, None, None, None, None, None, None, '3695524') ('3318', None, '1383263848', None, None, None, None, None, '3695524') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.03531169891357422 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.1927409172058105 time spend to save output : 0.03566741943359375 total time spend for step 10 : 2.2284083366394043 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 17 set_done_treatment 50.40user 28.61system 1:58.46elapsed 66%CPU (0avgtext+0avgdata 2797348maxresident)k 787496inputs+25808outputs (9661major+2365036minor)pagefaults 0swaps