python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1827977 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3717914'] with mtr_portfolio_ids : ['26827350'] and first list_photo_ids : [] new path : /proc/1827977/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.6181907653808594 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Sat Sep 13 11:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10592 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-13 11:20:33.699272: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-13 11:20:33.707382: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-13 11:20:33.709041: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f552c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-13 11:20:33.709097: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-13 11:20:33.711582: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-13 11:20:33.852814: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x28ab6030 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-13 11:20:33.852864: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-13 11:20:33.854348: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-13 11:20:33.854759: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-13 11:20:33.858009: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-13 11:20:33.861058: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-13 11:20:33.861489: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-13 11:20:33.864305: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-13 11:20:33.865735: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-13 11:20:33.870879: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-13 11:20:33.872322: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-13 11:20:33.872416: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-13 11:20:33.873155: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-13 11:20:33.873171: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-13 11:20:33.873197: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-13 11:20:33.874466: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9643 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-13 11:20:34.130052: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-13 11:20:34.130179: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-13 11:20:34.130201: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-13 11:20:34.130216: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-13 11:20:34.130231: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-13 11:20:34.130246: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-13 11:20:34.130260: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-13 11:20:34.130275: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-13 11:20:34.131876: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-13 11:20:34.134956: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-13 11:20:34.135002: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-13 11:20:34.135018: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-13 11:20:34.135032: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-13 11:20:34.135045: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-13 11:20:34.135059: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-13 11:20:34.135073: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-13 11:20:34.135086: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-13 11:20:34.137364: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-13 11:20:34.137403: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-13 11:20:34.137411: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-13 11:20:34.137419: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-13 11:20:34.139275: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9643 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-13 11:20:43.597550: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-13 11:20:43.818958: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-13 11:20:45.446032: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.446539: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.446984: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.447609: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.448107: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.448575: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.449057: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.449093: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-13 11:20:45.449722: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.449740: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-13 11:20:45.486498: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.486526: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-13 11:20:45.487011: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.487028: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-13 11:20:45.515328: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.515365: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-13 11:20:45.515864: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.515881: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-13 11:20:45.605344: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.605376: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-13 11:20:45.605830: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.605844: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-13 11:20:45.616937: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.616958: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-13 11:20:45.617410: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.617425: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-13 11:20:45.743509: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.744021: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.749431: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.749919: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.863687: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.864192: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.869174: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.869680: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.954084: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.954555: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.958710: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.959159: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.979591: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.980045: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.984299: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:45.984800: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.000603: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.001053: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.005217: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.005702: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.117255: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.117727: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.118191: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.118672: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.132925: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.133377: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.232792: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.233299: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.233783: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.234264: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.268506: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.268968: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.269416: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.269863: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.288067: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.288540: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.318950: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.319405: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.380735: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.381190: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.399706: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.400160: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.400614: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.401064: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.401690: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.402143: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.434164: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.434618: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.435077: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.435520: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.435965: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.436424: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.436904: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.437398: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.464243: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.464860: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.471532: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.472208: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.527358: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.527869: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.535665: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.536132: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.554432: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.554917: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.555391: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.555872: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.559903: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.560418: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.560905: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.561385: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.562328: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.562345: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-09-13 11:20:46.572595: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.573082: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.581949: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.582420: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.582877: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.583357: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.583845: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-13 11:20:46.584324: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 20 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 10.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 22 Detection mask done ! Trying to reset tf kernel 1828693 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 8242 tf kernel not reseted sub process len(results) : 20 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 20 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9435 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0003211498260498047 nb_pixel_total : 9916 time to create 1 rle with old method : 0.01193380355834961 length of segment : 155 time for calcul the mask position with numpy : 0.00012540817260742188 nb_pixel_total : 5755 time to create 1 rle with old method : 0.007084846496582031 length of segment : 67 time for calcul the mask position with numpy : 0.00047397613525390625 nb_pixel_total : 23281 time to create 1 rle with old method : 0.027535200119018555 length of segment : 196 time for calcul the mask position with numpy : 0.00047707557678222656 nb_pixel_total : 29153 time to create 1 rle with old method : 0.03570127487182617 length of segment : 187 time for calcul the mask position with numpy : 0.00024080276489257812 nb_pixel_total : 10116 time to create 1 rle with old method : 0.012366056442260742 length of segment : 137 time for calcul the mask position with numpy : 0.0001857280731201172 nb_pixel_total : 11152 time to create 1 rle with old method : 0.012974977493286133 length of segment : 136 time for calcul the mask position with numpy : 0.0005478858947753906 nb_pixel_total : 33077 time to create 1 rle with old method : 0.03781890869140625 length of segment : 300 time for calcul the mask position with numpy : 0.00022649765014648438 nb_pixel_total : 10659 time to create 1 rle with old method : 0.012075424194335938 length of segment : 159 time for calcul the mask position with numpy : 0.00024175643920898438 nb_pixel_total : 16657 time to create 1 rle with old method : 0.019407033920288086 length of segment : 101 time for calcul the mask position with numpy : 0.00014638900756835938 nb_pixel_total : 6961 time to create 1 rle with old method : 0.008285045623779297 length of segment : 150 time for calcul the mask position with numpy : 9.226799011230469e-05 nb_pixel_total : 5067 time to create 1 rle with old method : 0.00586247444152832 length of segment : 54 time for calcul the mask position with numpy : 0.00018310546875 nb_pixel_total : 13593 time to create 1 rle with old method : 0.015605449676513672 length of segment : 101 time for calcul the mask position with numpy : 0.00011873245239257812 nb_pixel_total : 7062 time to create 1 rle with old method : 0.008514165878295898 length of segment : 87 time for calcul the mask position with numpy : 0.0003895759582519531 nb_pixel_total : 9238 time to create 1 rle with old method : 0.013505935668945312 length of segment : 300 time for calcul the mask position with numpy : 0.00030159950256347656 nb_pixel_total : 11125 time to create 1 rle with old method : 0.01866006851196289 length of segment : 140 time for calcul the mask position with numpy : 0.0005698204040527344 nb_pixel_total : 27089 time to create 1 rle with old method : 0.03243112564086914 length of segment : 152 time for calcul the mask position with numpy : 0.00040268898010253906 nb_pixel_total : 15395 time to create 1 rle with old method : 0.016826152801513672 length of segment : 310 time for calcul the mask position with numpy : 0.00017499923706054688 nb_pixel_total : 9702 time to create 1 rle with old method : 0.010918855667114258 length of segment : 148 time for calcul the mask position with numpy : 0.00011658668518066406 nb_pixel_total : 6138 time to create 1 rle with old method : 0.0071446895599365234 length of segment : 60 time for calcul the mask position with numpy : 0.00027251243591308594 nb_pixel_total : 14605 time to create 1 rle with old method : 0.017193078994750977 length of segment : 157 time for calcul the mask position with numpy : 0.0004146099090576172 nb_pixel_total : 20240 time to create 1 rle with old method : 0.02334761619567871 length of segment : 147 time for calcul the mask position with numpy : 0.00018715858459472656 nb_pixel_total : 8547 time to create 1 rle with old method : 0.010066509246826172 length of segment : 146 time for calcul the mask position with numpy : 0.00023794174194335938 nb_pixel_total : 9527 time to create 1 rle with old method : 0.010881423950195312 length of segment : 167 time for calcul the mask position with numpy : 0.0018770694732666016 nb_pixel_total : 107991 time to create 1 rle with old method : 0.12747788429260254 length of segment : 517 time for calcul the mask position with numpy : 0.0001461505889892578 nb_pixel_total : 5754 time to create 1 rle with old method : 0.006572723388671875 length of segment : 98 time for calcul the mask position with numpy : 0.0004932880401611328 nb_pixel_total : 26690 time to create 1 rle with old method : 0.030019283294677734 length of segment : 285 time for calcul the mask position with numpy : 0.00046253204345703125 nb_pixel_total : 31445 time to create 1 rle with old method : 0.036550045013427734 length of segment : 182 time for calcul the mask position with numpy : 0.0005843639373779297 nb_pixel_total : 40366 time to create 1 rle with old method : 0.04501843452453613 length of segment : 330 time for calcul the mask position with numpy : 0.00026679039001464844 nb_pixel_total : 21102 time to create 1 rle with old method : 0.024144649505615234 length of segment : 160 time for calcul the mask position with numpy : 0.0002186298370361328 nb_pixel_total : 11902 time to create 1 rle with old method : 0.014019012451171875 length of segment : 136 time for calcul the mask position with numpy : 0.0006785392761230469 nb_pixel_total : 29594 time to create 1 rle with old method : 0.03434872627258301 length of segment : 221 time for calcul the mask position with numpy : 0.0002582073211669922 nb_pixel_total : 6523 time to create 1 rle with old method : 0.007976770401000977 length of segment : 94 time for calcul the mask position with numpy : 0.00025653839111328125 nb_pixel_total : 4529 time to create 1 rle with old method : 0.005412101745605469 length of segment : 125 time for calcul the mask position with numpy : 0.00017309188842773438 nb_pixel_total : 3261 time to create 1 rle with old method : 0.00386810302734375 length of segment : 83 time for calcul the mask position with numpy : 0.0002894401550292969 nb_pixel_total : 5410 time to create 1 rle with old method : 0.006232023239135742 length of segment : 104 time for calcul the mask position with numpy : 0.0004336833953857422 nb_pixel_total : 6093 time to create 1 rle with old method : 0.0074846744537353516 length of segment : 172 time for calcul the mask position with numpy : 0.0004184246063232422 nb_pixel_total : 13044 time to create 1 rle with old method : 0.015236854553222656 length of segment : 143 time for calcul the mask position with numpy : 0.00026416778564453125 nb_pixel_total : 12051 time to create 1 rle with old method : 0.014150619506835938 length of segment : 89 time for calcul the mask position with numpy : 0.00013637542724609375 nb_pixel_total : 3415 time to create 1 rle with old method : 0.0041887760162353516 length of segment : 49 time for calcul the mask position with numpy : 0.00023412704467773438 nb_pixel_total : 6389 time to create 1 rle with old method : 0.0074367523193359375 length of segment : 91 time for calcul the mask position with numpy : 0.0006392002105712891 nb_pixel_total : 30570 time to create 1 rle with old method : 0.03447389602661133 length of segment : 166 time for calcul the mask position with numpy : 0.00018835067749023438 nb_pixel_total : 5900 time to create 1 rle with old method : 0.0071108341217041016 length of segment : 96 time for calcul the mask position with numpy : 0.000392913818359375 nb_pixel_total : 9372 time to create 1 rle with old method : 0.011240720748901367 length of segment : 176 time for calcul the mask position with numpy : 0.0003943443298339844 nb_pixel_total : 14560 time to create 1 rle with old method : 0.017147302627563477 length of segment : 173 time for calcul the mask position with numpy : 0.0002446174621582031 nb_pixel_total : 7386 time to create 1 rle with old method : 0.009341239929199219 length of segment : 83 time for calcul the mask position with numpy : 0.0003788471221923828 nb_pixel_total : 8994 time to create 1 rle with old method : 0.011033773422241211 length of segment : 140 time for calcul the mask position with numpy : 0.0004894733428955078 nb_pixel_total : 10235 time to create 1 rle with old method : 0.01510930061340332 length of segment : 176 time for calcul the mask position with numpy : 0.0002219676971435547 nb_pixel_total : 3363 time to create 1 rle with old method : 0.004294633865356445 length of segment : 69 time for calcul the mask position with numpy : 0.0004687309265136719 nb_pixel_total : 20665 time to create 1 rle with old method : 0.02471470832824707 length of segment : 208 time for calcul the mask position with numpy : 0.03364396095275879 nb_pixel_total : 1089242 time to create 1 rle with new method : 0.06477713584899902 length of segment : 1608 time for calcul the mask position with numpy : 0.0001354217529296875 nb_pixel_total : 4630 time to create 1 rle with old method : 0.005831241607666016 length of segment : 54 time for calcul the mask position with numpy : 0.0002779960632324219 nb_pixel_total : 8008 time to create 1 rle with old method : 0.009646415710449219 length of segment : 84 time for calcul the mask position with numpy : 0.0004220008850097656 nb_pixel_total : 9538 time to create 1 rle with old method : 0.011409759521484375 length of segment : 144 time for calcul the mask position with numpy : 0.0002658367156982422 nb_pixel_total : 6994 time to create 1 rle with old method : 0.008415699005126953 length of segment : 141 time for calcul the mask position with numpy : 0.0009219646453857422 nb_pixel_total : 36497 time to create 1 rle with old method : 0.042029380798339844 length of segment : 348 time for calcul the mask position with numpy : 0.0003161430358886719 nb_pixel_total : 7946 time to create 1 rle with old method : 0.009196758270263672 length of segment : 185 time for calcul the mask position with numpy : 0.002221345901489258 nb_pixel_total : 104732 time to create 1 rle with old method : 0.11989903450012207 length of segment : 540 time for calcul the mask position with numpy : 0.00019693374633789062 nb_pixel_total : 4209 time to create 1 rle with old method : 0.004940509796142578 length of segment : 75 time for calcul the mask position with numpy : 0.00017333030700683594 nb_pixel_total : 2472 time to create 1 rle with old method : 0.0030167102813720703 length of segment : 81 time for calcul the mask position with numpy : 0.0003018379211425781 nb_pixel_total : 8218 time to create 1 rle with old method : 0.009705305099487305 length of segment : 123 time for calcul the mask position with numpy : 0.00019598007202148438 nb_pixel_total : 4262 time to create 1 rle with old method : 0.005194187164306641 length of segment : 78 time for calcul the mask position with numpy : 0.0003497600555419922 nb_pixel_total : 10033 time to create 1 rle with old method : 0.011894702911376953 length of segment : 131 time for calcul the mask position with numpy : 0.00021719932556152344 nb_pixel_total : 5994 time to create 1 rle with old method : 0.007334709167480469 length of segment : 108 time for calcul the mask position with numpy : 0.0007224082946777344 nb_pixel_total : 23660 time to create 1 rle with old method : 0.02722620964050293 length of segment : 180 time for calcul the mask position with numpy : 0.0010387897491455078 nb_pixel_total : 17164 time to create 1 rle with old method : 0.020863771438598633 length of segment : 128 time for calcul the mask position with numpy : 0.00040411949157714844 nb_pixel_total : 11700 time to create 1 rle with old method : 0.013599157333374023 length of segment : 152 time for calcul the mask position with numpy : 0.0003235340118408203 nb_pixel_total : 2332 time to create 1 rle with old method : 0.0028667449951171875 length of segment : 194 time for calcul the mask position with numpy : 0.0016183853149414062 nb_pixel_total : 68073 time to create 1 rle with old method : 0.07813549041748047 length of segment : 273 time for calcul the mask position with numpy : 0.0003731250762939453 nb_pixel_total : 10434 time to create 1 rle with old method : 0.01222991943359375 length of segment : 112 time spent for convertir_results : 3.261383295059204 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 69 chid ids of type : 3594 Number RLEs to save : 12462 save missing photos in datou_result : time spend for datou_step_exec : 35.19509530067444 time spend to save output : 0.9150805473327637 total time spend for step 1 : 36.1101758480072 step2:crop_condition Sat Sep 13 11:21:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 20 ! batch 1 Loaded 69 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 30 About to insert : list_path_to_insert length 30 new photo from crops ! About to upload 30 photos upload in portfolio : 3736932 init cache_photo without model_param we have 30 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757755269_1827977 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 30 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.157578229904175 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757755278_1827977 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.190068483352661 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757755281_1827977 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6948130130767822 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 3736932 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757755289_1827977 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 24 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.550019264221191 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757755296_1827977 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.238978385925293 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757755298_1827977 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9735233783721924 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1383628586, 1383628553, 1383628552, 1383628537, 1383628512, 1383628442, 1383628441, 1383628440, 1383628437, 1383628434, 1383628423, 1383628359, 1383628354, 1383628339, 1383628334, 1383628333, 1383628330, 1383628273, 1383628248, 1383628223] Looping around the photos to save general results len do output : 69 /1383633477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383633588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628586', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628553', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628552', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628537', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628512', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628442', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628441', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628440', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628437', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628434', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628423', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628359', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628354', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628339', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628334', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628333', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628330', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628273', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628248', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628223', None, None, None, None, None, '3717914') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 227 time used for this insertion : 0.034803152084350586 save_final save missing photos in datou_result : time spend for datou_step_exec : 32.313984394073486 time spend to save output : 0.03825855255126953 total time spend for step 2 : 32.352242946624756 step3:rle_unique_nms_with_priority Sat Sep 13 11:21:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 69 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.45894312858581543 time for calcul the mask position with numpy : 0.06830978393554688 nb_pixel_total : 1984227 time to create 1 rle with new method : 0.09954619407653809 time for calcul the mask position with numpy : 0.007616281509399414 nb_pixel_total : 11152 time to create 1 rle with old method : 0.014309167861938477 time for calcul the mask position with numpy : 0.0071086883544921875 nb_pixel_total : 10116 time to create 1 rle with old method : 0.012493610382080078 time for calcul the mask position with numpy : 0.006991386413574219 nb_pixel_total : 29153 time to create 1 rle with old method : 0.037467002868652344 time for calcul the mask position with numpy : 0.0078105926513671875 nb_pixel_total : 23281 time to create 1 rle with old method : 0.028490781784057617 time for calcul the mask position with numpy : 0.009043455123901367 nb_pixel_total : 5755 time to create 1 rle with old method : 0.009105443954467773 time for calcul the mask position with numpy : 0.008871078491210938 nb_pixel_total : 9916 time to create 1 rle with old method : 0.012277603149414062 create new chi : 0.3411571979522705 time to delete rle : 0.017602205276489258 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 2836 TO DO : save crop sub photo not yet done ! save time : 0.22050738334655762 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.0662229061126709 time for calcul the mask position with numpy : 0.07534575462341309 nb_pixel_total : 2029864 time to create 1 rle with new method : 0.07703638076782227 time for calcul the mask position with numpy : 0.007196903228759766 nb_pixel_total : 10659 time to create 1 rle with old method : 0.013699531555175781 time for calcul the mask position with numpy : 0.0077686309814453125 nb_pixel_total : 33077 time to create 1 rle with old method : 0.03893327713012695 create new chi : 0.22038722038269043 time to delete rle : 0.0005171298980712891 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1998 TO DO : save crop sub photo not yet done ! save time : 0.15545296669006348 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.12224102020263672 time for calcul the mask position with numpy : 0.03928375244140625 nb_pixel_total : 2015022 time to create 1 rle with new method : 0.10200858116149902 time for calcul the mask position with numpy : 0.00784158706665039 nb_pixel_total : 9238 time to create 1 rle with old method : 0.01234889030456543 time for calcul the mask position with numpy : 0.007596492767333984 nb_pixel_total : 7062 time to create 1 rle with old method : 0.008936166763305664 time for calcul the mask position with numpy : 0.007401704788208008 nb_pixel_total : 13593 time to create 1 rle with old method : 0.015509366989135742 time for calcul the mask position with numpy : 0.0077593326568603516 nb_pixel_total : 5067 time to create 1 rle with old method : 0.0059549808502197266 time for calcul the mask position with numpy : 0.007964372634887695 nb_pixel_total : 6961 time to create 1 rle with old method : 0.00836634635925293 time for calcul the mask position with numpy : 0.007956743240356445 nb_pixel_total : 16657 time to create 1 rle with old method : 0.019652366638183594 create new chi : 0.268723726272583 time to delete rle : 0.0007534027099609375 batch 1 Loaded 13 chid ids of type : 3594 ++++++++++Number RLEs to save : 2666 TO DO : save crop sub photo not yet done ! save time : 0.2200932502746582 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 0.2548787593841553 time for calcul the mask position with numpy : 0.06883001327514648 nb_pixel_total : 1969306 time to create 1 rle with new method : 0.11561942100524902 time for calcul the mask position with numpy : 0.007481813430786133 nb_pixel_total : 20240 time to create 1 rle with old method : 0.02442336082458496 time for calcul the mask position with numpy : 0.0071866512298583984 nb_pixel_total : 14605 time to create 1 rle with old method : 0.017213106155395508 time for calcul the mask position with numpy : 0.007108449935913086 nb_pixel_total : 6138 time to create 1 rle with old method : 0.007114410400390625 time for calcul the mask position with numpy : 0.007254838943481445 nb_pixel_total : 9702 time to create 1 rle with old method : 0.011167526245117188 time for calcul the mask position with numpy : 0.0073528289794921875 nb_pixel_total : 15395 time to create 1 rle with old method : 0.01689934730529785 time for calcul the mask position with numpy : 0.0073337554931640625 nb_pixel_total : 27089 time to create 1 rle with old method : 0.030916690826416016 time for calcul the mask position with numpy : 0.007813692092895508 nb_pixel_total : 11125 time to create 1 rle with old method : 0.012392282485961914 create new chi : 0.3663523197174072 time to delete rle : 0.0008862018585205078 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++Number RLEs to save : 3308 TO DO : save crop sub photo not yet done ! save time : 0.24777603149414062 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 0.25684666633605957 time for calcul the mask position with numpy : 0.09277033805847168 nb_pixel_total : 1810862 time to create 1 rle with new method : 0.0968484878540039 time for calcul the mask position with numpy : 0.007508039474487305 nb_pixel_total : 11902 time to create 1 rle with old method : 0.013978004455566406 time for calcul the mask position with numpy : 0.007177114486694336 nb_pixel_total : 20516 time to create 1 rle with old method : 0.02270054817199707 time for calcul the mask position with numpy : 0.007688760757446289 nb_pixel_total : 40366 time to create 1 rle with old method : 0.045285940170288086 time for calcul the mask position with numpy : 0.007564067840576172 nb_pixel_total : 31445 time to create 1 rle with old method : 0.03472542762756348 time for calcul the mask position with numpy : 0.0076868534088134766 nb_pixel_total : 26690 time to create 1 rle with old method : 0.03138899803161621 time for calcul the mask position with numpy : 0.007385730743408203 nb_pixel_total : 5754 time to create 1 rle with old method : 0.006927967071533203 time for calcul the mask position with numpy : 0.008570432662963867 nb_pixel_total : 107991 time to create 1 rle with old method : 0.1223750114440918 time for calcul the mask position with numpy : 0.007319927215576172 nb_pixel_total : 9527 time to create 1 rle with old method : 0.011515617370605469 time for calcul the mask position with numpy : 0.0073871612548828125 nb_pixel_total : 8547 time to create 1 rle with old method : 0.009320735931396484 create new chi : 0.566176176071167 time to delete rle : 0.0011129379272460938 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 5050 TO DO : save crop sub photo not yet done ! save time : 0.37641310691833496 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.06154465675354004 time for calcul the mask position with numpy : 0.03029632568359375 nb_pixel_total : 2037483 time to create 1 rle with new method : 0.028861045837402344 time for calcul the mask position with numpy : 0.005934238433837891 nb_pixel_total : 6523 time to create 1 rle with old method : 0.00819706916809082 time for calcul the mask position with numpy : 0.006192207336425781 nb_pixel_total : 29594 time to create 1 rle with old method : 0.03918790817260742 create new chi : 0.11900806427001953 time to delete rle : 0.00028777122497558594 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1710 TO DO : save crop sub photo not yet done ! save time : 0.16266131401062012 No data in photo_id : 1383628441 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.059422969818115234 time for calcul the mask position with numpy : 0.02030014991760254 nb_pixel_total : 2054307 time to create 1 rle with new method : 0.028847694396972656 time for calcul the mask position with numpy : 0.0059452056884765625 nb_pixel_total : 6093 time to create 1 rle with old method : 0.007611513137817383 time for calcul the mask position with numpy : 0.0057294368743896484 nb_pixel_total : 5410 time to create 1 rle with old method : 0.006755352020263672 time for calcul the mask position with numpy : 0.005888938903808594 nb_pixel_total : 3261 time to create 1 rle with old method : 0.004051923751831055 time for calcul the mask position with numpy : 0.0059926509857177734 nb_pixel_total : 4529 time to create 1 rle with old method : 0.005397796630859375 create new chi : 0.09686493873596191 time to delete rle : 0.00035572052001953125 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 2048 TO DO : save crop sub photo not yet done ! save time : 0.1761946678161621 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.12296605110168457 time for calcul the mask position with numpy : 0.07066059112548828 nb_pixel_total : 2045090 time to create 1 rle with new method : 0.1008307933807373 time for calcul the mask position with numpy : 0.006490945816040039 nb_pixel_total : 3415 time to create 1 rle with old method : 0.004747867584228516 time for calcul the mask position with numpy : 0.006378173828125 nb_pixel_total : 12051 time to create 1 rle with old method : 0.01627039909362793 time for calcul the mask position with numpy : 0.006550312042236328 nb_pixel_total : 13044 time to create 1 rle with old method : 0.020559310913085938 create new chi : 0.2433161735534668 time to delete rle : 0.0004792213439941406 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1642 TO DO : save crop sub photo not yet done ! save time : 0.1533830165863037 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.0883028507232666 time for calcul the mask position with numpy : 0.09439754486083984 nb_pixel_total : 2021369 time to create 1 rle with new method : 0.07536506652832031 time for calcul the mask position with numpy : 0.006296873092651367 nb_pixel_total : 9372 time to create 1 rle with old method : 0.013347625732421875 time for calcul the mask position with numpy : 0.007190704345703125 nb_pixel_total : 5900 time to create 1 rle with old method : 0.010059833526611328 time for calcul the mask position with numpy : 0.006864309310913086 nb_pixel_total : 30570 time to create 1 rle with old method : 0.039114952087402344 time for calcul the mask position with numpy : 0.006501674652099609 nb_pixel_total : 6389 time to create 1 rle with old method : 0.007455348968505859 create new chi : 0.2779502868652344 time to delete rle : 0.0003657341003417969 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2138 TO DO : save crop sub photo not yet done ! save time : 0.17726922035217285 No data in photo_id : 1383628423 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.05473947525024414 time for calcul the mask position with numpy : 0.01985931396484375 nb_pixel_total : 2042660 time to create 1 rle with new method : 0.08438730239868164 time for calcul the mask position with numpy : 0.006208896636962891 nb_pixel_total : 8994 time to create 1 rle with old method : 0.009780406951904297 time for calcul the mask position with numpy : 0.005932331085205078 nb_pixel_total : 7386 time to create 1 rle with old method : 0.008276939392089844 time for calcul the mask position with numpy : 0.006312847137451172 nb_pixel_total : 14560 time to create 1 rle with old method : 0.01651906967163086 create new chi : 0.1637115478515625 time to delete rle : 0.0003135204315185547 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 1872 TO DO : save crop sub photo not yet done ! save time : 0.1538562774658203 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.12438821792602539 time for calcul the mask position with numpy : 0.0345611572265625 nb_pixel_total : 976632 time to create 1 rle with new method : 0.08556342124938965 time for calcul the mask position with numpy : 0.0066013336181640625 nb_pixel_total : 4630 time to create 1 rle with old method : 0.005742788314819336 time for calcul the mask position with numpy : 0.058759212493896484 nb_pixel_total : 1064836 time to create 1 rle with new method : 0.09173703193664551 time for calcul the mask position with numpy : 0.0074117183685302734 nb_pixel_total : 13904 time to create 1 rle with old method : 0.01603245735168457 time for calcul the mask position with numpy : 0.007368564605712891 nb_pixel_total : 3363 time to create 1 rle with old method : 0.0037713050842285156 time for calcul the mask position with numpy : 0.0074269771575927734 nb_pixel_total : 10235 time to create 1 rle with old method : 0.01125788688659668 create new chi : 0.34978699684143066 time to delete rle : 0.0010831356048583984 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 5141 TO DO : save crop sub photo not yet done ! save time : 0.37555980682373047 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.07271981239318848 time for calcul the mask position with numpy : 0.03251814842224121 nb_pixel_total : 2049060 time to create 1 rle with new method : 0.12421226501464844 time for calcul the mask position with numpy : 0.007727622985839844 nb_pixel_total : 6994 time to create 1 rle with old method : 0.008581876754760742 time for calcul the mask position with numpy : 0.0077397823333740234 nb_pixel_total : 9538 time to create 1 rle with old method : 0.01115560531616211 time for calcul the mask position with numpy : 0.0076482295989990234 nb_pixel_total : 8008 time to create 1 rle with old method : 0.009351253509521484 create new chi : 0.21748924255371094 time to delete rle : 0.0005438327789306641 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1818 TO DO : save crop sub photo not yet done ! save time : 0.3000173568725586 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.07092976570129395 time for calcul the mask position with numpy : 0.1274549961090088 nb_pixel_total : 2029157 time to create 1 rle with new method : 0.10244441032409668 time for calcul the mask position with numpy : 0.0074465274810791016 nb_pixel_total : 7946 time to create 1 rle with old method : 0.008765935897827148 time for calcul the mask position with numpy : 0.007580995559692383 nb_pixel_total : 36497 time to create 1 rle with old method : 0.04040694236755371 create new chi : 0.305722713470459 time to delete rle : 0.0005841255187988281 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 2146 TO DO : save crop sub photo not yet done ! save time : 0.16660237312316895 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.28536200523376465 time for calcul the mask position with numpy : 0.09060978889465332 nb_pixel_total : 1964659 time to create 1 rle with new method : 0.09770083427429199 time for calcul the mask position with numpy : 0.0073223114013671875 nb_pixel_total : 4209 time to create 1 rle with old method : 0.004722118377685547 time for calcul the mask position with numpy : 0.008012771606445312 nb_pixel_total : 104732 time to create 1 rle with old method : 0.12095308303833008 create new chi : 0.33992791175842285 time to delete rle : 0.0005030632019042969 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2310 TO DO : save crop sub photo not yet done ! save time : 0.19922566413879395 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.062381744384765625 time for calcul the mask position with numpy : 0.08738517761230469 nb_pixel_total : 2071128 time to create 1 rle with new method : 0.11603116989135742 time for calcul the mask position with numpy : 0.007547140121459961 nb_pixel_total : 2472 time to create 1 rle with old method : 0.002925872802734375 create new chi : 0.22541499137878418 time to delete rle : 0.00046133995056152344 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1242 TO DO : save crop sub photo not yet done ! save time : 0.12060666084289551 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.09559845924377441 time for calcul the mask position with numpy : 0.1172022819519043 nb_pixel_total : 2065382 time to create 1 rle with new method : 0.0974571704864502 time for calcul the mask position with numpy : 0.006215333938598633 nb_pixel_total : 8218 time to create 1 rle with old method : 0.009524822235107422 create new chi : 0.2406463623046875 time to delete rle : 0.00025463104248046875 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1326 TO DO : save crop sub photo not yet done ! save time : 0.12589359283447266 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.12887167930603027 time for calcul the mask position with numpy : 0.07122254371643066 nb_pixel_total : 2053311 time to create 1 rle with new method : 0.08952975273132324 time for calcul the mask position with numpy : 0.006370067596435547 nb_pixel_total : 5994 time to create 1 rle with old method : 0.006938457489013672 time for calcul the mask position with numpy : 0.006330966949462891 nb_pixel_total : 10033 time to create 1 rle with old method : 0.01186060905456543 time for calcul the mask position with numpy : 0.006156444549560547 nb_pixel_total : 4262 time to create 1 rle with old method : 0.004735469818115234 create new chi : 0.2124650478363037 time to delete rle : 0.000324249267578125 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1714 TO DO : save crop sub photo not yet done ! save time : 0.1462695598602295 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.2928745746612549 time for calcul the mask position with numpy : 0.07435441017150879 nb_pixel_total : 1941932 time to create 1 rle with new method : 0.11272644996643066 time for calcul the mask position with numpy : 0.006424903869628906 nb_pixel_total : 10434 time to create 1 rle with old method : 0.012070655822753906 time for calcul the mask position with numpy : 0.006952047348022461 nb_pixel_total : 66378 time to create 1 rle with old method : 0.07823348045349121 time for calcul the mask position with numpy : 0.006381511688232422 nb_pixel_total : 2332 time to create 1 rle with old method : 0.002821207046508789 time for calcul the mask position with numpy : 0.006688833236694336 nb_pixel_total : 11700 time to create 1 rle with old method : 0.014012336730957031 time for calcul the mask position with numpy : 0.006788492202758789 nb_pixel_total : 17164 time to create 1 rle with old method : 0.02026224136352539 time for calcul the mask position with numpy : 0.006751537322998047 nb_pixel_total : 23660 time to create 1 rle with old method : 0.02763509750366211 create new chi : 0.3921992778778076 time to delete rle : 0.0005900859832763672 batch 1 Loaded 13 chid ids of type : 3594 ++++++++++Number RLEs to save : 3092 TO DO : save crop sub photo not yet done ! save time : 0.27661633491516113 map_output_result : {1383628586: (0.0, 'Should be the crop_list due to order', 0), 1383628553: (0.0, 'Should be the crop_list due to order', 0), 1383628552: (0.0, 'Should be the crop_list due to order', 0), 1383628537: (0.0, 'Should be the crop_list due to order', 0), 1383628512: (0.0, 'Should be the crop_list due to order', 0), 1383628442: (0.0, 'Should be the crop_list due to order', 0), 1383628441: (0.0, 'Should be the crop_list due to order', 0.0), 1383628440: (0.0, 'Should be the crop_list due to order', 0), 1383628437: (0.0, 'Should be the crop_list due to order', 0), 1383628434: (0.0, 'Should be the crop_list due to order', 0), 1383628423: (0.0, 'Should be the crop_list due to order', 0.0), 1383628359: (0.0, 'Should be the crop_list due to order', 0), 1383628354: (0.0, 'Should be the crop_list due to order', 0), 1383628339: (0.0, 'Should be the crop_list due to order', 0), 1383628334: (0.0, 'Should be the crop_list due to order', 0), 1383628333: (0.0, 'Should be the crop_list due to order', 0), 1383628330: (0.0, 'Should be the crop_list due to order', 0), 1383628273: (0.0, 'Should be the crop_list due to order', 0), 1383628248: (0.0, 'Should be the crop_list due to order', 0), 1383628223: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1383628586, 1383628553, 1383628552, 1383628537, 1383628512, 1383628442, 1383628441, 1383628440, 1383628437, 1383628434, 1383628423, 1383628359, 1383628354, 1383628339, 1383628334, 1383628333, 1383628330, 1383628273, 1383628248, 1383628223] Looping around the photos to save general results len do output : 20 /1383628586.Didn't retrieve data . /1383628553.Didn't retrieve data . /1383628552.Didn't retrieve data . /1383628537.Didn't retrieve data . /1383628512.Didn't retrieve data . /1383628442.Didn't retrieve data . /1383628441.Didn't retrieve data . /1383628440.Didn't retrieve data . /1383628437.Didn't retrieve data . /1383628434.Didn't retrieve data . /1383628423.Didn't retrieve data . /1383628359.Didn't retrieve data . /1383628354.Didn't retrieve data . /1383628339.Didn't retrieve data . /1383628334.Didn't retrieve data . /1383628333.Didn't retrieve data . /1383628330.Didn't retrieve data . /1383628273.Didn't retrieve data . /1383628248.Didn't retrieve data . /1383628223.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628586', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628553', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628552', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628537', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628512', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628442', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628441', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628440', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628437', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628434', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628423', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628359', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628354', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628339', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628334', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628333', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628330', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628273', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628248', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628223', None, None, None, None, None, '3717914') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 60 time used for this insertion : 0.017557382583618164 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.07157564163208 time spend to save output : 0.018277406692504883 total time spend for step 3 : 12.089853048324585 step4:ventilate_hashtags_in_portfolio Sat Sep 13 11:21:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26827350 get user id for portfolio 26827350 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26827350 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pehd','autre','papier','flou','carton','pet_clair','metal','pet_fonce','background','environnement')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26827350 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pehd','autre','papier','flou','carton','pet_clair','metal','pet_fonce','background','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26827465,26827466,26827467,26827468,26827469,26827470,26827471,26827472,26827473,26827474,26827475?tags=environnement,mal_croppe,papier,flou,metal,pet_clair,background,autre,pehd,carton,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1383628586, 1383628553, 1383628552, 1383628537, 1383628512, 1383628442, 1383628441, 1383628440, 1383628437, 1383628434, 1383628423, 1383628359, 1383628354, 1383628339, 1383628334, 1383628333, 1383628330, 1383628273, 1383628248, 1383628223] Looping around the photos to save general results len do output : 1 /26827350. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628586', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628553', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628552', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628537', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628512', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628442', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628441', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628440', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628437', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628434', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628423', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628359', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628354', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628339', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628334', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628333', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628330', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628273', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628248', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628223', None, None, None, None, None, '3717914') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.018131017684936523 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.4316236972808838 time spend to save output : 0.018448591232299805 total time spend for step 4 : 0.4500722885131836 step5:final Sat Sep 13 11:21:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1383628586: ('0.05058750482253091',), 1383628553: ('0.05058750482253091',), 1383628552: ('0.05058750482253091',), 1383628537: ('0.05058750482253091',), 1383628512: ('0.05058750482253091',), 1383628442: ('0.05058750482253091',), 1383628441: ('0.05058750482253091',), 1383628440: ('0.05058750482253091',), 1383628437: ('0.05058750482253091',), 1383628434: ('0.05058750482253091',), 1383628423: ('0.05058750482253091',), 1383628359: ('0.05058750482253091',), 1383628354: ('0.05058750482253091',), 1383628339: ('0.05058750482253091',), 1383628334: ('0.05058750482253091',), 1383628333: ('0.05058750482253091',), 1383628330: ('0.05058750482253091',), 1383628273: ('0.05058750482253091',), 1383628248: ('0.05058750482253091',), 1383628223: ('0.05058750482253091',)} new output for save of step final : {1383628586: ('0.05058750482253091',), 1383628553: ('0.05058750482253091',), 1383628552: ('0.05058750482253091',), 1383628537: ('0.05058750482253091',), 1383628512: ('0.05058750482253091',), 1383628442: ('0.05058750482253091',), 1383628441: ('0.05058750482253091',), 1383628440: ('0.05058750482253091',), 1383628437: ('0.05058750482253091',), 1383628434: ('0.05058750482253091',), 1383628423: ('0.05058750482253091',), 1383628359: ('0.05058750482253091',), 1383628354: ('0.05058750482253091',), 1383628339: ('0.05058750482253091',), 1383628334: ('0.05058750482253091',), 1383628333: ('0.05058750482253091',), 1383628330: ('0.05058750482253091',), 1383628273: ('0.05058750482253091',), 1383628248: ('0.05058750482253091',), 1383628223: ('0.05058750482253091',)} [1383628586, 1383628553, 1383628552, 1383628537, 1383628512, 1383628442, 1383628441, 1383628440, 1383628437, 1383628434, 1383628423, 1383628359, 1383628354, 1383628339, 1383628334, 1383628333, 1383628330, 1383628273, 1383628248, 1383628223] Looping around the photos to save general results len do output : 20 /1383628586.Didn't retrieve data . /1383628553.Didn't retrieve data . /1383628552.Didn't retrieve data . /1383628537.Didn't retrieve data . /1383628512.Didn't retrieve data . /1383628442.Didn't retrieve data . /1383628441.Didn't retrieve data . /1383628440.Didn't retrieve data . /1383628437.Didn't retrieve data . /1383628434.Didn't retrieve data . /1383628423.Didn't retrieve data . /1383628359.Didn't retrieve data . /1383628354.Didn't retrieve data . /1383628339.Didn't retrieve data . /1383628334.Didn't retrieve data . /1383628333.Didn't retrieve data . /1383628330.Didn't retrieve data . /1383628273.Didn't retrieve data . /1383628248.Didn't retrieve data . /1383628223.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628586', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628553', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628552', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628537', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628512', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628442', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628441', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628440', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628437', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628434', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628423', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628359', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628354', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628339', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628334', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628333', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628330', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628273', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628248', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628223', None, None, None, None, None, '3717914') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 60 time used for this insertion : 0.04884791374206543 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12351131439208984 time spend to save output : 0.04985332489013672 total time spend for step 5 : 0.17336463928222656 step6:blur_detection Sat Sep 13 11:21:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1757755228_1827977_1383628586_66b1e5101d760a3e3d0c8c049ad485a1.jpg resize: (1080, 1920) 1383628586 1.2909098130707746 treat image : temp/1757755228_1827977_1383628553_121e7eb6b57c5252b423567fd9ad45b1.jpg resize: (1080, 1920) 1383628553 1.0571615622050838 treat image : temp/1757755228_1827977_1383628552_1ba71a2c8f8cc07c40250a34addcdcbf.jpg resize: (1080, 1920) 1383628552 0.9510375296422117 treat image : temp/1757755228_1827977_1383628537_e726df5f463ebb5b6997e4b991493710.jpg resize: (1080, 1920) 1383628537 -3.375934351722532 treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6.jpg resize: (1080, 1920) 1383628512 1.839279907939521 treat image : temp/1757755228_1827977_1383628442_614320b05e7f3579a52b64718e735049.jpg resize: (1080, 1920) 1383628442 -0.6074848088687491 treat image : temp/1757755228_1827977_1383628441_32a8a716776c95480b9634888a8bcbe2.jpg resize: (1080, 1920) 1383628441 -0.35243140842229637 treat image : temp/1757755228_1827977_1383628440_83988924dbb66942c1cebbba42f33377.jpg resize: (1080, 1920) 1383628440 0.32594162498538826 treat image : temp/1757755228_1827977_1383628437_200d69d2735a75ae38420e9e10fe01ad.jpg resize: (1080, 1920) 1383628437 0.11413196744559984 treat image : temp/1757755228_1827977_1383628434_544557add0c8b68a017abbc5d2bdac87.jpg resize: (1080, 1920) 1383628434 -0.37012891940576315 treat image : temp/1757755228_1827977_1383628423_c642bc18317d747d41471053111c607b.jpg resize: (1080, 1920) 1383628423 -0.29962539074505745 treat image : temp/1757755228_1827977_1383628359_138e578114c47d4f74ed6866b83834cb.jpg resize: (1080, 1920) 1383628359 -0.34133407705713825 treat image : temp/1757755228_1827977_1383628354_b6d8afccc1d8739f41e6fdb9a773e575.jpg resize: (1080, 1920) 1383628354 -0.38919723726407923 treat image : temp/1757755228_1827977_1383628339_362680fb10c2b69809db4a93bb747ef1.jpg resize: (1080, 1920) 1383628339 -0.19875079923085442 treat image : temp/1757755228_1827977_1383628334_0a542691de7df582f32953d5103ff1bc.jpg resize: (1080, 1920) 1383628334 0.1771139519434314 treat image : temp/1757755228_1827977_1383628333_f1c1a1243beb97b6b481e5f901e5c1ff.jpg resize: (1080, 1920) 1383628333 0.32303155550901436 treat image : temp/1757755228_1827977_1383628330_679329d0d1f769beac5bcd9311464738.jpg resize: (1080, 1920) 1383628330 0.015129998319315748 treat image : temp/1757755228_1827977_1383628273_d39ec61188618137cd6a772847f20fd8.jpg resize: (1080, 1920) 1383628273 0.8902873905388038 treat image : temp/1757755228_1827977_1383628248_36310862e34a17b4025786a96ffeb571.jpg resize: (1080, 1920) 1383628248 0.18972550345100253 treat image : temp/1757755228_1827977_1383628223_e23d64177597d90a122d2157bc53076a.jpg resize: (1080, 1920) 1383628223 -0.3534545264779241 treat image : temp/1757755228_1827977_1383628586_66b1e5101d760a3e3d0c8c049ad485a1_rle_crop_3958084430_0.png resize: (154, 105) 1383633477 -0.8352266623195433 treat image : temp/1757755228_1827977_1383628552_1ba71a2c8f8cc07c40250a34addcdcbf_rle_crop_3958084438_0.png resize: (100, 226) 1383633478 -1.331619277626282 treat image : temp/1757755228_1827977_1383628552_1ba71a2c8f8cc07c40250a34addcdcbf_rle_crop_3958084439_0.png resize: (112, 114) 1383633479 -1.642141781707724 treat image : temp/1757755228_1827977_1383628552_1ba71a2c8f8cc07c40250a34addcdcbf_rle_crop_3958084441_0.png resize: (98, 182) 1383633480 -2.537987417798038 treat image : temp/1757755228_1827977_1383628552_1ba71a2c8f8cc07c40250a34addcdcbf_rle_crop_3958084442_0.png resize: (87, 115) 1383633481 -0.1475951916586809 treat image : temp/1757755228_1827977_1383628552_1ba71a2c8f8cc07c40250a34addcdcbf_rle_crop_3958084443_0.png resize: (171, 241) 1383633482 -0.5373624140952756 treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6_rle_crop_3958084451_0.png resize: (146, 96) 1383633483 -0.5088515399946127 treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6_rle_crop_3958084452_0.png resize: (167, 108) 1383633484 -1.2516616449044233 treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6_rle_crop_3958084455_0.png resize: (242, 204) 1383633485 -1.058476260363876 treat image : temp/1757755228_1827977_1383628442_614320b05e7f3579a52b64718e735049_rle_crop_3958084461_0.png resize: (93, 107) 1383633486 -3.00634903402782 treat image : temp/1757755228_1827977_1383628440_83988924dbb66942c1cebbba42f33377_rle_crop_3958084463_0.png resize: (79, 67) 1383633487 -0.35075801644928295 treat image : temp/1757755228_1827977_1383628440_83988924dbb66942c1cebbba42f33377_rle_crop_3958084464_0.png resize: (104, 100) 1383633488 -2.6018102892917745 treat image : temp/1757755228_1827977_1383628440_83988924dbb66942c1cebbba42f33377_rle_crop_3958084465_0.png resize: (170, 102) 1383633489 -2.383491251791584 treat image : temp/1757755228_1827977_1383628437_200d69d2735a75ae38420e9e10fe01ad_rle_crop_3958084466_0.png resize: (143, 119) 1383633490 -0.8211824683938377 treat image : temp/1757755228_1827977_1383628437_200d69d2735a75ae38420e9e10fe01ad_rle_crop_3958084467_0.png resize: (74, 211) 1383633491 -0.3938344108167985 treat image : temp/1757755228_1827977_1383628434_544557add0c8b68a017abbc5d2bdac87_rle_crop_3958084469_0.png resize: (91, 94) 1383633492 -0.351155612021419 treat image : temp/1757755228_1827977_1383628434_544557add0c8b68a017abbc5d2bdac87_rle_crop_3958084471_0.png resize: (96, 82) 1383633493 0.5135552917602859 treat image : temp/1757755228_1827977_1383628434_544557add0c8b68a017abbc5d2bdac87_rle_crop_3958084472_0.png resize: (176, 104) 1383633494 -1.7566631424936663 treat image : temp/1757755228_1827977_1383628359_138e578114c47d4f74ed6866b83834cb_rle_crop_3958084473_0.png resize: (155, 132) 1383633495 -0.4920565694091527 treat image : temp/1757755228_1827977_1383628359_138e578114c47d4f74ed6866b83834cb_rle_crop_3958084474_0.png resize: (83, 139) 1383633496 -1.2526187509455096 treat image : temp/1757755228_1827977_1383628359_138e578114c47d4f74ed6866b83834cb_rle_crop_3958084475_0.png resize: (140, 110) 1383633497 -1.3041551422403859 treat image : temp/1757755228_1827977_1383628354_b6d8afccc1d8739f41e6fdb9a773e575_rle_crop_3958084477_0.png resize: (65, 83) 1383633498 0.8732070396488361 treat image : temp/1757755228_1827977_1383628339_362680fb10c2b69809db4a93bb747ef1_rle_crop_3958084482_0.png resize: (144, 133) 1383633499 -1.9095785956404303 treat image : temp/1757755228_1827977_1383628334_0a542691de7df582f32953d5103ff1bc_rle_crop_3958084485_0.png resize: (185, 57) 1383633500 -1.4607359254681571 treat image : temp/1757755228_1827977_1383628330_679329d0d1f769beac5bcd9311464738_rle_crop_3958084488_0.png resize: (81, 44) 1383633501 0.045310009896612505 treat image : temp/1757755228_1827977_1383628248_36310862e34a17b4025786a96ffeb571_rle_crop_3958084491_0.png resize: (131, 111) 1383633502 -0.14571696919388888 treat image : temp/1757755228_1827977_1383628248_36310862e34a17b4025786a96ffeb571_rle_crop_3958084492_0.png resize: (108, 114) 1383633503 -0.6862689058794733 treat image : temp/1757755228_1827977_1383628223_e23d64177597d90a122d2157bc53076a_rle_crop_3958084495_0.png resize: (147, 96) 1383633504 0.491830582091905 treat image : temp/1757755228_1827977_1383628223_e23d64177597d90a122d2157bc53076a_rle_crop_3958084496_0.png resize: (144, 63) 1383633505 -0.7409042048303612 treat image : temp/1757755228_1827977_1383628223_e23d64177597d90a122d2157bc53076a_rle_crop_3958084497_0.png resize: (248, 427) 1383633506 -1.3970843301578164 treat image : temp/1757755228_1827977_1383628553_121e7eb6b57c5252b423567fd9ad45b1_rle_crop_3958084437_0.png resize: (159, 145) 1383633516 -1.5826999566192304 treat image : temp/1757755228_1827977_1383628537_e726df5f463ebb5b6997e4b991493710_rle_crop_3958084444_0.png resize: (140, 113) 1383633517 -1.5771444917208852 treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6_rle_crop_3958084454_0.png resize: (98, 126) 1383633518 -2.0887437987819157 treat image : temp/1757755228_1827977_1383628440_83988924dbb66942c1cebbba42f33377_rle_crop_3958084462_0.png resize: (125, 47) 1383633519 -0.11120789538642184 treat image : temp/1757755228_1827977_1383628333_f1c1a1243beb97b6b481e5f901e5c1ff_rle_crop_3958084487_0.png resize: (75, 80) 1383633520 -1.0512883270306266 treat image : temp/1757755228_1827977_1383628273_d39ec61188618137cd6a772847f20fd8_rle_crop_3958084489_0.png resize: (123, 100) 1383633521 -0.786510793495753 treat image : temp/1757755228_1827977_1383628223_e23d64177597d90a122d2157bc53076a_rle_crop_3958084494_0.png resize: (117, 183) 1383633522 -0.5034484967809676 treat image : temp/1757755228_1827977_1383628223_e23d64177597d90a122d2157bc53076a_rle_crop_3958084498_0.png resize: (112, 108) 1383633523 2.9501473636730418 treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6_rle_crop_3958084459_0.png resize: (136, 106) 1383633525 0.7182193327243664 treat image : temp/1757755228_1827977_1383628354_b6d8afccc1d8739f41e6fdb9a773e575_rle_crop_3958084480_0.png resize: (54, 130) 1383633526 -2.622650925059352 treat image : temp/1757755228_1827977_1383628586_66b1e5101d760a3e3d0c8c049ad485a1_rle_crop_3958084431_0.png resize: (67, 108) 1383633553 -0.20923373207234527 treat image : temp/1757755228_1827977_1383628586_66b1e5101d760a3e3d0c8c049ad485a1_rle_crop_3958084432_0.png resize: (192, 161) 1383633554 -0.3774674818115178 treat image : temp/1757755228_1827977_1383628586_66b1e5101d760a3e3d0c8c049ad485a1_rle_crop_3958084433_0.png resize: (187, 201) 1383633556 -2.1555421415183256 treat image : temp/1757755228_1827977_1383628586_66b1e5101d760a3e3d0c8c049ad485a1_rle_crop_3958084434_0.png resize: (122, 161) 1383633557 -2.6934053720308944 treat image : temp/1757755228_1827977_1383628553_121e7eb6b57c5252b423567fd9ad45b1_rle_crop_3958084436_0.png resize: (299, 200) 1383633559 -0.3563305996607506 treat image : temp/1757755228_1827977_1383628552_1ba71a2c8f8cc07c40250a34addcdcbf_rle_crop_3958084440_0.png resize: (53, 119) 1383633560 -0.1244891023236813 treat image : temp/1757755228_1827977_1383628537_e726df5f463ebb5b6997e4b991493710_rle_crop_3958084445_0.png resize: (151, 243) 1383633561 -3.1782409815448487 treat image : temp/1757755228_1827977_1383628537_e726df5f463ebb5b6997e4b991493710_rle_crop_3958084447_0.png resize: (148, 90) 1383633562 -4.163207143486911 treat image : temp/1757755228_1827977_1383628537_e726df5f463ebb5b6997e4b991493710_rle_crop_3958084448_0.png resize: (45, 179) 1383633564 -1.778714884928342 treat image : temp/1757755228_1827977_1383628537_e726df5f463ebb5b6997e4b991493710_rle_crop_3958084449_0.png resize: (152, 136) 1383633565 -3.8759152950769793 treat image : temp/1757755228_1827977_1383628537_e726df5f463ebb5b6997e4b991493710_rle_crop_3958084450_0.png resize: (147, 196) 1383633566 -2.713729385048735 treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6_rle_crop_3958084453_0.png resize: (508, 326) 1383633568 -0.0346081003305042 treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6_rle_crop_3958084456_0.png resize: (175, 264) 1383633569 -0.9725982858381197 treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6_rle_crop_3958084457_0.png resize: (243, 226) 1383633570 -0.6088876797465319 treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6_rle_crop_3958084458_0.png resize: (159, 173) 1383633572 0.2723873156738602 treat image : temp/1757755228_1827977_1383628442_614320b05e7f3579a52b64718e735049_rle_crop_3958084460_0.png resize: (208, 223) 1383633573 -2.676757792846388 treat image : temp/1757755228_1827977_1383628437_200d69d2735a75ae38420e9e10fe01ad_rle_crop_3958084468_0.png resize: (49, 88) 1383633574 -2.7170876145388703 treat image : temp/1757755228_1827977_1383628434_544557add0c8b68a017abbc5d2bdac87_rle_crop_3958084470_0.png resize: (166, 243) 1383633575 -2.1435140168654137 treat image : temp/1757755228_1827977_1383628354_b6d8afccc1d8739f41e6fdb9a773e575_rle_crop_3958084476_0.png resize: (163, 78) 1383633576 -2.037631180427591 treat image : temp/1757755228_1827977_1383628354_b6d8afccc1d8739f41e6fdb9a773e575_rle_crop_3958084478_0.png resize: (187, 167) 1383633577 -2.1999681581513832 treat image : temp/1757755228_1827977_1383628354_b6d8afccc1d8739f41e6fdb9a773e575_rle_crop_3958084479_0.png resize: (1018, 1329) 1383633579 -0.9070979010996281 treat image : temp/1757755228_1827977_1383628334_0a542691de7df582f32953d5103ff1bc_rle_crop_3958084484_0.png resize: (272, 223) 1383633580 -1.6906107534631996 treat image : temp/1757755228_1827977_1383628333_f1c1a1243beb97b6b481e5f901e5c1ff_rle_crop_3958084486_0.png resize: (530, 340) 1383633581 -0.04633285414040214 treat image : temp/1757755228_1827977_1383628223_e23d64177597d90a122d2157bc53076a_rle_crop_3958084493_0.png resize: (180, 176) 1383633582 -0.024371716864925418 treat image : temp/1757755228_1827977_1383628537_e726df5f463ebb5b6997e4b991493710_rle_crop_3958084446_0.png resize: (246, 134) 1383633583 -2.412046200152501 treat image : temp/1757755228_1827977_1383628339_362680fb10c2b69809db4a93bb747ef1_rle_crop_3958084481_0.png resize: (84, 128) 1383633584 -0.90034362582069 treat image : temp/1757755228_1827977_1383628248_36310862e34a17b4025786a96ffeb571_rle_crop_3958084490_0.png resize: (78, 69) 1383633586 1.61543424225156 treat image : temp/1757755228_1827977_1383628586_66b1e5101d760a3e3d0c8c049ad485a1_rle_crop_3958084435_0.png resize: (136, 102) 1383633587 1.0278536741661195 treat image : temp/1757755228_1827977_1383628339_362680fb10c2b69809db4a93bb747ef1_rle_crop_3958084483_0.png resize: (141, 78) 1383633588 -3.442486164894721 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 89 time used for this insertion : 0.026204586029052734 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 89 time used for this insertion : 0.04510831832885742 save missing photos in datou_result : time spend for datou_step_exec : 16.970207929611206 time spend to save output : 0.08637404441833496 total time spend for step 6 : 17.05658197402954 step7:brightness Sat Sep 13 11:22:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1757755228_1827977_1383628586_66b1e5101d760a3e3d0c8c049ad485a1.jpg treat image : temp/1757755228_1827977_1383628553_121e7eb6b57c5252b423567fd9ad45b1.jpg treat image : temp/1757755228_1827977_1383628552_1ba71a2c8f8cc07c40250a34addcdcbf.jpg treat image : temp/1757755228_1827977_1383628537_e726df5f463ebb5b6997e4b991493710.jpg treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6.jpg treat image : temp/1757755228_1827977_1383628442_614320b05e7f3579a52b64718e735049.jpg treat image : temp/1757755228_1827977_1383628441_32a8a716776c95480b9634888a8bcbe2.jpg treat image : temp/1757755228_1827977_1383628440_83988924dbb66942c1cebbba42f33377.jpg treat image : temp/1757755228_1827977_1383628437_200d69d2735a75ae38420e9e10fe01ad.jpg treat image : temp/1757755228_1827977_1383628434_544557add0c8b68a017abbc5d2bdac87.jpg treat image : temp/1757755228_1827977_1383628423_c642bc18317d747d41471053111c607b.jpg treat image : temp/1757755228_1827977_1383628359_138e578114c47d4f74ed6866b83834cb.jpg treat image : temp/1757755228_1827977_1383628354_b6d8afccc1d8739f41e6fdb9a773e575.jpg treat image : temp/1757755228_1827977_1383628339_362680fb10c2b69809db4a93bb747ef1.jpg treat image : temp/1757755228_1827977_1383628334_0a542691de7df582f32953d5103ff1bc.jpg treat image : temp/1757755228_1827977_1383628333_f1c1a1243beb97b6b481e5f901e5c1ff.jpg treat image : temp/1757755228_1827977_1383628330_679329d0d1f769beac5bcd9311464738.jpg treat image : temp/1757755228_1827977_1383628273_d39ec61188618137cd6a772847f20fd8.jpg treat image : temp/1757755228_1827977_1383628248_36310862e34a17b4025786a96ffeb571.jpg treat image : temp/1757755228_1827977_1383628223_e23d64177597d90a122d2157bc53076a.jpg treat image : temp/1757755228_1827977_1383628586_66b1e5101d760a3e3d0c8c049ad485a1_rle_crop_3958084430_0.png treat image : temp/1757755228_1827977_1383628552_1ba71a2c8f8cc07c40250a34addcdcbf_rle_crop_3958084438_0.png treat image : temp/1757755228_1827977_1383628552_1ba71a2c8f8cc07c40250a34addcdcbf_rle_crop_3958084439_0.png treat image : temp/1757755228_1827977_1383628552_1ba71a2c8f8cc07c40250a34addcdcbf_rle_crop_3958084441_0.png treat image : temp/1757755228_1827977_1383628552_1ba71a2c8f8cc07c40250a34addcdcbf_rle_crop_3958084442_0.png treat image : temp/1757755228_1827977_1383628552_1ba71a2c8f8cc07c40250a34addcdcbf_rle_crop_3958084443_0.png treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6_rle_crop_3958084451_0.png treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6_rle_crop_3958084452_0.png treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6_rle_crop_3958084455_0.png treat image : temp/1757755228_1827977_1383628442_614320b05e7f3579a52b64718e735049_rle_crop_3958084461_0.png treat image : temp/1757755228_1827977_1383628440_83988924dbb66942c1cebbba42f33377_rle_crop_3958084463_0.png treat image : temp/1757755228_1827977_1383628440_83988924dbb66942c1cebbba42f33377_rle_crop_3958084464_0.png treat image : temp/1757755228_1827977_1383628440_83988924dbb66942c1cebbba42f33377_rle_crop_3958084465_0.png treat image : temp/1757755228_1827977_1383628437_200d69d2735a75ae38420e9e10fe01ad_rle_crop_3958084466_0.png treat image : temp/1757755228_1827977_1383628437_200d69d2735a75ae38420e9e10fe01ad_rle_crop_3958084467_0.png treat image : temp/1757755228_1827977_1383628434_544557add0c8b68a017abbc5d2bdac87_rle_crop_3958084469_0.png treat image : temp/1757755228_1827977_1383628434_544557add0c8b68a017abbc5d2bdac87_rle_crop_3958084471_0.png treat image : temp/1757755228_1827977_1383628434_544557add0c8b68a017abbc5d2bdac87_rle_crop_3958084472_0.png treat image : temp/1757755228_1827977_1383628359_138e578114c47d4f74ed6866b83834cb_rle_crop_3958084473_0.png treat image : temp/1757755228_1827977_1383628359_138e578114c47d4f74ed6866b83834cb_rle_crop_3958084474_0.png treat image : temp/1757755228_1827977_1383628359_138e578114c47d4f74ed6866b83834cb_rle_crop_3958084475_0.png treat image : temp/1757755228_1827977_1383628354_b6d8afccc1d8739f41e6fdb9a773e575_rle_crop_3958084477_0.png treat image : temp/1757755228_1827977_1383628339_362680fb10c2b69809db4a93bb747ef1_rle_crop_3958084482_0.png treat image : temp/1757755228_1827977_1383628334_0a542691de7df582f32953d5103ff1bc_rle_crop_3958084485_0.png treat image : temp/1757755228_1827977_1383628330_679329d0d1f769beac5bcd9311464738_rle_crop_3958084488_0.png treat image : temp/1757755228_1827977_1383628248_36310862e34a17b4025786a96ffeb571_rle_crop_3958084491_0.png treat image : temp/1757755228_1827977_1383628248_36310862e34a17b4025786a96ffeb571_rle_crop_3958084492_0.png treat image : temp/1757755228_1827977_1383628223_e23d64177597d90a122d2157bc53076a_rle_crop_3958084495_0.png treat image : temp/1757755228_1827977_1383628223_e23d64177597d90a122d2157bc53076a_rle_crop_3958084496_0.png treat image : temp/1757755228_1827977_1383628223_e23d64177597d90a122d2157bc53076a_rle_crop_3958084497_0.png treat image : temp/1757755228_1827977_1383628553_121e7eb6b57c5252b423567fd9ad45b1_rle_crop_3958084437_0.png treat image : temp/1757755228_1827977_1383628537_e726df5f463ebb5b6997e4b991493710_rle_crop_3958084444_0.png treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6_rle_crop_3958084454_0.png treat image : temp/1757755228_1827977_1383628440_83988924dbb66942c1cebbba42f33377_rle_crop_3958084462_0.png treat image : temp/1757755228_1827977_1383628333_f1c1a1243beb97b6b481e5f901e5c1ff_rle_crop_3958084487_0.png treat image : temp/1757755228_1827977_1383628273_d39ec61188618137cd6a772847f20fd8_rle_crop_3958084489_0.png treat image : temp/1757755228_1827977_1383628223_e23d64177597d90a122d2157bc53076a_rle_crop_3958084494_0.png treat image : temp/1757755228_1827977_1383628223_e23d64177597d90a122d2157bc53076a_rle_crop_3958084498_0.png treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6_rle_crop_3958084459_0.png treat image : temp/1757755228_1827977_1383628354_b6d8afccc1d8739f41e6fdb9a773e575_rle_crop_3958084480_0.png treat image : temp/1757755228_1827977_1383628586_66b1e5101d760a3e3d0c8c049ad485a1_rle_crop_3958084431_0.png treat image : temp/1757755228_1827977_1383628586_66b1e5101d760a3e3d0c8c049ad485a1_rle_crop_3958084432_0.png treat image : temp/1757755228_1827977_1383628586_66b1e5101d760a3e3d0c8c049ad485a1_rle_crop_3958084433_0.png treat image : temp/1757755228_1827977_1383628586_66b1e5101d760a3e3d0c8c049ad485a1_rle_crop_3958084434_0.png treat image : temp/1757755228_1827977_1383628553_121e7eb6b57c5252b423567fd9ad45b1_rle_crop_3958084436_0.png treat image : temp/1757755228_1827977_1383628552_1ba71a2c8f8cc07c40250a34addcdcbf_rle_crop_3958084440_0.png treat image : temp/1757755228_1827977_1383628537_e726df5f463ebb5b6997e4b991493710_rle_crop_3958084445_0.png treat image : temp/1757755228_1827977_1383628537_e726df5f463ebb5b6997e4b991493710_rle_crop_3958084447_0.png treat image : temp/1757755228_1827977_1383628537_e726df5f463ebb5b6997e4b991493710_rle_crop_3958084448_0.png treat image : temp/1757755228_1827977_1383628537_e726df5f463ebb5b6997e4b991493710_rle_crop_3958084449_0.png treat image : temp/1757755228_1827977_1383628537_e726df5f463ebb5b6997e4b991493710_rle_crop_3958084450_0.png treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6_rle_crop_3958084453_0.png treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6_rle_crop_3958084456_0.png treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6_rle_crop_3958084457_0.png treat image : temp/1757755228_1827977_1383628512_30ea54d0c768a1241d449fab13a565f6_rle_crop_3958084458_0.png treat image : temp/1757755228_1827977_1383628442_614320b05e7f3579a52b64718e735049_rle_crop_3958084460_0.png treat image : temp/1757755228_1827977_1383628437_200d69d2735a75ae38420e9e10fe01ad_rle_crop_3958084468_0.png treat image : temp/1757755228_1827977_1383628434_544557add0c8b68a017abbc5d2bdac87_rle_crop_3958084470_0.png treat image : temp/1757755228_1827977_1383628354_b6d8afccc1d8739f41e6fdb9a773e575_rle_crop_3958084476_0.png treat image : temp/1757755228_1827977_1383628354_b6d8afccc1d8739f41e6fdb9a773e575_rle_crop_3958084478_0.png treat image : temp/1757755228_1827977_1383628354_b6d8afccc1d8739f41e6fdb9a773e575_rle_crop_3958084479_0.png treat image : temp/1757755228_1827977_1383628334_0a542691de7df582f32953d5103ff1bc_rle_crop_3958084484_0.png treat image : temp/1757755228_1827977_1383628333_f1c1a1243beb97b6b481e5f901e5c1ff_rle_crop_3958084486_0.png treat image : temp/1757755228_1827977_1383628223_e23d64177597d90a122d2157bc53076a_rle_crop_3958084493_0.png treat image : temp/1757755228_1827977_1383628537_e726df5f463ebb5b6997e4b991493710_rle_crop_3958084446_0.png treat image : temp/1757755228_1827977_1383628339_362680fb10c2b69809db4a93bb747ef1_rle_crop_3958084481_0.png treat image : temp/1757755228_1827977_1383628248_36310862e34a17b4025786a96ffeb571_rle_crop_3958084490_0.png treat image : temp/1757755228_1827977_1383628586_66b1e5101d760a3e3d0c8c049ad485a1_rle_crop_3958084435_0.png treat image : temp/1757755228_1827977_1383628339_362680fb10c2b69809db4a93bb747ef1_rle_crop_3958084483_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 89 time used for this insertion : 0.01701045036315918 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 89 time used for this insertion : 0.01952362060546875 save missing photos in datou_result : time spend for datou_step_exec : 4.830710411071777 time spend to save output : 0.041683197021484375 total time spend for step 7 : 4.872393608093262 step8:velours_tree Sat Sep 13 11:22:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.43120622634887695 time spend to save output : 0.00019311904907226562 total time spend for step 8 : 0.4313993453979492 step9:send_mail_cod Sat Sep 13 11:22:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26827350_13-09-2025_11_22_14.pdf 26827466 imagette268274661757755334 26827467 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette268274671757755334 26827468 imagette268274681757755335 26827469 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette268274691757755335 26827470 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette268274701757755336 26827471 imagette268274711757755337 26827472 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette268274721757755337 26827473 change filename to text .change filename to text .change filename to text .change filename to text .imagette268274731757755338 26827474 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette268274741757755339 26827475 change filename to text .change filename to text .change filename to text .imagette268274751757755345 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26827350 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26827465,26827466,26827467,26827468,26827469,26827470,26827471,26827472,26827473,26827474,26827475?tags=environnement,mal_croppe,papier,flou,metal,pet_clair,background,autre,pehd,carton,pet_fonce args[1383628586] : ((1383628586, 1.2909098130707746, 492688767), (1383628586, 0.27171713325351177, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628553] : ((1383628553, 1.0571615622050838, 492688767), (1383628553, 0.736786935874683, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628552] : ((1383628552, 0.9510375296422117, 492688767), (1383628552, 0.5795584943383916, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628537] : ((1383628537, -3.375934351722532, 492609224), (1383628537, 0.31623299355690343, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628512] : ((1383628512, 1.839279907939521, 492688767), (1383628512, 0.36766914226349484, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628442] : ((1383628442, -0.6074848088687491, 492688767), (1383628442, 0.5895345905580425, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628441] : ((1383628441, -0.35243140842229637, 492688767), (1383628441, 0.5017873634879738, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628440] : ((1383628440, 0.32594162498538826, 492688767), (1383628440, 0.4291237977944948, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628437] : ((1383628437, 0.11413196744559984, 492688767), (1383628437, 0.549794201068751, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628434] : ((1383628434, -0.37012891940576315, 492688767), (1383628434, 0.37997158717538115, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628423] : ((1383628423, -0.29962539074505745, 492688767), (1383628423, 0.5100703336418284, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628359] : ((1383628359, -0.34133407705713825, 492688767), (1383628359, 0.7543848831050716, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628354] : ((1383628354, -0.38919723726407923, 492688767), (1383628354, 0.612227910853501, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628339] : ((1383628339, -0.19875079923085442, 492688767), (1383628339, 0.5768871444875773, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628334] : ((1383628334, 0.1771139519434314, 492688767), (1383628334, 0.522855262515152, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628333] : ((1383628333, 0.32303155550901436, 492688767), (1383628333, 0.6099487508825183, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628330] : ((1383628330, 0.015129998319315748, 492688767), (1383628330, 0.6232870475507994, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628273] : ((1383628273, 0.8902873905388038, 492688767), (1383628273, 0.8838168685463842, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628248] : ((1383628248, 0.18972550345100253, 492688767), (1383628248, 0.6577357816395136, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com args[1383628223] : ((1383628223, -0.3534545264779241, 492688767), (1383628223, 0.6652565322184946, 2107752395), '0.05058750482253091') We are sending mail with results at report@fotonower.com refus_total : 0.05058750482253091 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26827350 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26827350_13-09-2025_11_22_14.pdf results_Auto_P26827350_13-09-2025_11_22_14.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26827350_13-09-2025_11_22_14.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26827350','results_Auto_P26827350_13-09-2025_11_22_14.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26827350_13-09-2025_11_22_14.pdf','pdf','','0.48','0.05058750482253091') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26827350

https://www.fotonower.com/image?json=false&list_photos_id=1383628586
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.2909098130707746)
https://www.fotonower.com/image?json=false&list_photos_id=1383628553
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0571615622050838)
https://www.fotonower.com/image?json=false&list_photos_id=1383628552
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383628537
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383628512
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.839279907939521)
https://www.fotonower.com/image?json=false&list_photos_id=1383628442
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383628441
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383628440
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383628437
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383628434
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383628423
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383628359
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383628354
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383628339
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383628334
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383628333
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383628330
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383628273
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383628248
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383628223
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 5.06%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/26827467?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26827469?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26827470?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26827472?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/26827473?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26827474?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/26827475?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26827350_13-09-2025_11_22_14.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26827465,26827466,26827467,26827468,26827469,26827470,26827471,26827472,26827473,26827474,26827475?tags=environnement,mal_croppe,papier,flou,metal,pet_clair,background,autre,pehd,carton,pet_fonce.


L'équipe Fotonower 202 b'' Server: nginx Date: Sat, 13 Sep 2025 09:22:28 GMT Content-Length: 0 Connection: close X-Message-Id: gE815eeORgeZASFTezfNGg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1383628586, 1383628553, 1383628552, 1383628537, 1383628512, 1383628442, 1383628441, 1383628440, 1383628437, 1383628434, 1383628423, 1383628359, 1383628354, 1383628339, 1383628334, 1383628333, 1383628330, 1383628273, 1383628248, 1383628223] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628586', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628553', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628552', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628537', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628512', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628442', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628441', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628440', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628437', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628434', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628423', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628359', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628354', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628339', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628334', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628333', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628330', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628273', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628248', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628223', None, None, None, None, None, '3717914') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.058673858642578125 save_final save missing photos in datou_result : time spend for datou_step_exec : 13.630401611328125 time spend to save output : 0.059343814849853516 total time spend for step 9 : 13.689745426177979 step10:split_time_score Sat Sep 13 11:22:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 60),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 13092025 26827350 Nombre de photos uploadées : 60 / 23040 (0%) 13092025 26827350 Nombre de photos taguées (types de déchets): 0 / 60 (0%) 13092025 26827350 Nombre de photos taguées (volume) : 0 / 60 (0%) elapsed_time : load_data_split_time_score 8.344650268554688e-06 elapsed_time : order_list_meta_photo_and_scores 1.7404556274414062e-05 ???????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.007334232330322266 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.24531340599060059 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.05751060956790125 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26823681_13-09-2025_07_41_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26823681 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26823681 AND mptpi.`type`=3594 To do Qualite : 0.026640571416323734 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26824130_13-09-2025_09_01_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26824130 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26824130 AND mptpi.`type`=3594 To do Qualite : 0.013152548707561728 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26824132_13-09-2025_09_06_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26824132 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26824132 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26824133 order by id desc limit 1 Qualite : 0.2412280976723251 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26824839_13-09-2025_09_12_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26824839 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26824839 AND mptpi.`type`=3594 To do Qualite : 0.05267119984567902 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26826748_13-09-2025_10_41_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26826748 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26826748 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26827349 order by id desc limit 1 Qualite : 0.049799213927469145 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26827350_13-09-2025_11_22_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26827350 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26827350 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'13092025': {'nb_upload': 60, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1383628586, 1383628553, 1383628552, 1383628537, 1383628512, 1383628442, 1383628441, 1383628440, 1383628437, 1383628434, 1383628423, 1383628359, 1383628354, 1383628339, 1383628334, 1383628333, 1383628330, 1383628273, 1383628248, 1383628223] Looping around the photos to save general results len do output : 1 /26827350Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628586', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628553', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628552', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628537', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628512', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628442', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628441', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628440', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628437', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628434', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628423', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628359', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628354', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628339', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628334', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628333', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628330', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628273', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628248', None, None, None, None, None, '3717914') ('3318', None, None, None, None, None, None, None, '3717914') ('3318', None, '1383628223', None, None, None, None, None, '3717914') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.017452001571655273 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.1829562187194824 time spend to save output : 0.01787853240966797 total time spend for step 10 : 3.2008347511291504 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 20 set_done_treatment 60.74user 29.76system 2:06.70elapsed 71%CPU (0avgtext+0avgdata 3124916maxresident)k 677736inputs+32456outputs (8605major+2182669minor)pagefaults 0swaps