python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 898072 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2761800'] with mtr_portfolio_ids : ['22426955'] and first list_photo_ids : [] new path : /proc/898072/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.1711745262145996 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Apr 25 10:20:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3470 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-25 10:20:34.087014: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-25 10:20:34.115039: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-25 10:20:34.116811: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3744000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-25 10:20:34.116869: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-25 10:20:34.120825: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-25 10:20:34.366046: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1fc8b620 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-25 10:20:34.366093: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-25 10:20:34.367052: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-25 10:20:34.367395: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-25 10:20:34.369898: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-25 10:20:34.372351: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-25 10:20:34.372750: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-25 10:20:34.375484: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-25 10:20:34.376759: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-25 10:20:34.381859: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-25 10:20:34.382893: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-25 10:20:34.382983: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-25 10:20:34.383556: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-25 10:20:34.383572: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-25 10:20:34.383581: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-25 10:20:34.384538: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3018 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-25 10:20:34.641699: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-25 10:20:34.641818: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-25 10:20:34.641841: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-25 10:20:34.641860: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-25 10:20:34.641878: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-25 10:20:34.641897: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-25 10:20:34.641915: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-25 10:20:34.641934: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-25 10:20:34.642947: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-25 10:20:34.644021: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-25 10:20:34.644056: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-25 10:20:34.644075: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-25 10:20:34.644092: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-25 10:20:34.644109: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-25 10:20:34.644126: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-25 10:20:34.644143: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-25 10:20:34.644160: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-25 10:20:34.645144: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-25 10:20:34.645182: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-25 10:20:34.645193: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-25 10:20:34.645203: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-25 10:20:34.646249: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3018 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-25 10:20:45.953107: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-25 10:20:46.166433: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-25 10:20:47.648533: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.649125: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.20G (2366727680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.649160: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-25 10:20:47.649695: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.649711: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-25 10:20:47.656912: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.656942: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-25 10:20:47.657462: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.657478: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-25 10:20:47.664021: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.664046: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-25 10:20:47.664597: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.664613: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-25 10:20:47.698183: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.698310: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-25 10:20:47.699207: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.699235: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-25 10:20:47.705877: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.705925: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-25 10:20:47.706844: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.706869: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-25 10:20:47.745340: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.746346: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.748894: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.749816: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.795499: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.796106: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.798367: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.798941: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.829575: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.830179: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.831954: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.832525: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.839398: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.840009: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.841905: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.842466: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.849343: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.849922: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.851663: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.852222: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.884322: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.884927: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.885481: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.886031: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.890250: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.890825: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.908603: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.909212: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.909765: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.910315: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.923111: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.923746: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.924303: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.924856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.929408: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.929995: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.934980: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.935608: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.947960: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.948567: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.952824: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.953418: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.953974: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.954526: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.955471: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.956038: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.966762: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.967390: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.968083: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.968970: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.969855: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.970737: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.986671: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:47.987619: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.039647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.040599: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.041508: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.042395: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.050658: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.051322: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.067247: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.068047: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.068827: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.069523: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.073600: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.074157: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.074699: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.075272: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.076252: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.076269: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-04-25 10:20:48.086433: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.087002: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.095894: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.096452: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.097013: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.097564: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.098124: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-25 10:20:48.098664: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629697536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 28 Detection mask done ! Trying to reset tf kernel 898988 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2277 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3251 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.004601001739501953 nb_pixel_total : 94440 time to create 1 rle with old method : 0.1571063995361328 length of segment : 288 time for calcul the mask position with numpy : 0.006396293640136719 nb_pixel_total : 153714 time to create 1 rle with new method : 0.015049219131469727 length of segment : 527 time for calcul the mask position with numpy : 0.0007565021514892578 nb_pixel_total : 29909 time to create 1 rle with old method : 0.04697751998901367 length of segment : 210 time for calcul the mask position with numpy : 0.0009703636169433594 nb_pixel_total : 31535 time to create 1 rle with old method : 0.04410719871520996 length of segment : 224 time for calcul the mask position with numpy : 0.0010216236114501953 nb_pixel_total : 50501 time to create 1 rle with old method : 0.06356120109558105 length of segment : 282 time for calcul the mask position with numpy : 0.0005061626434326172 nb_pixel_total : 30162 time to create 1 rle with old method : 0.03824353218078613 length of segment : 195 time for calcul the mask position with numpy : 0.00025391578674316406 nb_pixel_total : 10313 time to create 1 rle with old method : 0.013188838958740234 length of segment : 139 time for calcul the mask position with numpy : 0.00040841102600097656 nb_pixel_total : 21961 time to create 1 rle with old method : 0.02853989601135254 length of segment : 152 time for calcul the mask position with numpy : 0.001375436782836914 nb_pixel_total : 80397 time to create 1 rle with old method : 0.10327029228210449 length of segment : 332 time for calcul the mask position with numpy : 0.0005645751953125 nb_pixel_total : 21168 time to create 1 rle with old method : 0.02934408187866211 length of segment : 128 time for calcul the mask position with numpy : 0.0006632804870605469 nb_pixel_total : 36311 time to create 1 rle with old method : 0.04792189598083496 length of segment : 307 time for calcul the mask position with numpy : 0.024152278900146484 nb_pixel_total : 342544 time to create 1 rle with new method : 0.02539539337158203 length of segment : 831 time for calcul the mask position with numpy : 0.0001723766326904297 nb_pixel_total : 6650 time to create 1 rle with old method : 0.008067846298217773 length of segment : 72 time for calcul the mask position with numpy : 0.0005064010620117188 nb_pixel_total : 28163 time to create 1 rle with old method : 0.032510995864868164 length of segment : 153 time for calcul the mask position with numpy : 0.0002665519714355469 nb_pixel_total : 11156 time to create 1 rle with old method : 0.015369892120361328 length of segment : 140 time for calcul the mask position with numpy : 0.0025415420532226562 nb_pixel_total : 229498 time to create 1 rle with new method : 0.008949041366577148 length of segment : 781 time for calcul the mask position with numpy : 0.002385377883911133 nb_pixel_total : 173592 time to create 1 rle with new method : 0.009638547897338867 length of segment : 676 time for calcul the mask position with numpy : 0.0014476776123046875 nb_pixel_total : 134827 time to create 1 rle with old method : 0.14919042587280273 length of segment : 594 time for calcul the mask position with numpy : 0.00019049644470214844 nb_pixel_total : 11759 time to create 1 rle with old method : 0.013370513916015625 length of segment : 183 time for calcul the mask position with numpy : 0.0007600784301757812 nb_pixel_total : 22289 time to create 1 rle with old method : 0.025861263275146484 length of segment : 333 time for calcul the mask position with numpy : 0.0012562274932861328 nb_pixel_total : 35907 time to create 1 rle with old method : 0.041803598403930664 length of segment : 289 time for calcul the mask position with numpy : 0.016788721084594727 nb_pixel_total : 508667 time to create 1 rle with new method : 0.0317225456237793 length of segment : 927 time for calcul the mask position with numpy : 0.0014061927795410156 nb_pixel_total : 37548 time to create 1 rle with old method : 0.04390716552734375 length of segment : 145 time for calcul the mask position with numpy : 0.008058547973632812 nb_pixel_total : 330241 time to create 1 rle with new method : 0.014955282211303711 length of segment : 631 time for calcul the mask position with numpy : 0.0038003921508789062 nb_pixel_total : 102122 time to create 1 rle with old method : 0.1154327392578125 length of segment : 468 time for calcul the mask position with numpy : 0.002145051956176758 nb_pixel_total : 68028 time to create 1 rle with old method : 0.07865309715270996 length of segment : 323 time for calcul the mask position with numpy : 0.006041288375854492 nb_pixel_total : 106254 time to create 1 rle with old method : 0.12511801719665527 length of segment : 499 time for calcul the mask position with numpy : 0.0003566741943359375 nb_pixel_total : 14294 time to create 1 rle with old method : 0.016978740692138672 length of segment : 157 time for calcul the mask position with numpy : 0.001898050308227539 nb_pixel_total : 53416 time to create 1 rle with old method : 0.06155657768249512 length of segment : 212 time for calcul the mask position with numpy : 0.001272439956665039 nb_pixel_total : 25931 time to create 1 rle with old method : 0.0298006534576416 length of segment : 252 time for calcul the mask position with numpy : 0.0003819465637207031 nb_pixel_total : 11187 time to create 1 rle with old method : 0.013770341873168945 length of segment : 116 time for calcul the mask position with numpy : 0.003243684768676758 nb_pixel_total : 86554 time to create 1 rle with old method : 0.09750509262084961 length of segment : 482 time for calcul the mask position with numpy : 0.0010421276092529297 nb_pixel_total : 25486 time to create 1 rle with old method : 0.029569625854492188 length of segment : 217 time for calcul the mask position with numpy : 0.004156351089477539 nb_pixel_total : 115911 time to create 1 rle with old method : 0.1325845718383789 length of segment : 862 time for calcul the mask position with numpy : 0.0010025501251220703 nb_pixel_total : 24278 time to create 1 rle with old method : 0.027677059173583984 length of segment : 218 time for calcul the mask position with numpy : 0.0006535053253173828 nb_pixel_total : 13351 time to create 1 rle with old method : 0.022470951080322266 length of segment : 100 time for calcul the mask position with numpy : 0.0019366741180419922 nb_pixel_total : 37108 time to create 1 rle with old method : 0.08436250686645508 length of segment : 305 time for calcul the mask position with numpy : 0.0031642913818359375 nb_pixel_total : 92051 time to create 1 rle with old method : 0.10396933555603027 length of segment : 370 time for calcul the mask position with numpy : 0.0017154216766357422 nb_pixel_total : 50854 time to create 1 rle with old method : 0.0581202507019043 length of segment : 282 time for calcul the mask position with numpy : 0.003738880157470703 nb_pixel_total : 113689 time to create 1 rle with old method : 0.12013912200927734 length of segment : 468 time for calcul the mask position with numpy : 0.0002830028533935547 nb_pixel_total : 6433 time to create 1 rle with old method : 0.007296562194824219 length of segment : 75 time for calcul the mask position with numpy : 0.0006706714630126953 nb_pixel_total : 18815 time to create 1 rle with old method : 0.020754337310791016 length of segment : 198 time for calcul the mask position with numpy : 0.0007045269012451172 nb_pixel_total : 21605 time to create 1 rle with old method : 0.024369478225708008 length of segment : 154 time for calcul the mask position with numpy : 0.0037245750427246094 nb_pixel_total : 146421 time to create 1 rle with old method : 0.1561129093170166 length of segment : 470 time for calcul the mask position with numpy : 0.010139703750610352 nb_pixel_total : 284727 time to create 1 rle with new method : 0.01580214500427246 length of segment : 1003 time for calcul the mask position with numpy : 0.005315065383911133 nb_pixel_total : 237683 time to create 1 rle with new method : 0.01186060905456543 length of segment : 473 time for calcul the mask position with numpy : 0.0032155513763427734 nb_pixel_total : 95659 time to create 1 rle with old method : 0.10199260711669922 length of segment : 732 time for calcul the mask position with numpy : 0.004968404769897461 nb_pixel_total : 186352 time to create 1 rle with new method : 0.006899118423461914 length of segment : 335 time for calcul the mask position with numpy : 0.0017313957214355469 nb_pixel_total : 74543 time to create 1 rle with old method : 0.0872809886932373 length of segment : 221 time for calcul the mask position with numpy : 0.0008935928344726562 nb_pixel_total : 23394 time to create 1 rle with old method : 0.02666306495666504 length of segment : 176 time for calcul the mask position with numpy : 0.001007080078125 nb_pixel_total : 27579 time to create 1 rle with old method : 0.031282901763916016 length of segment : 197 time for calcul the mask position with numpy : 0.004261016845703125 nb_pixel_total : 91190 time to create 1 rle with old method : 0.10241413116455078 length of segment : 531 time for calcul the mask position with numpy : 0.00016236305236816406 nb_pixel_total : 4705 time to create 1 rle with old method : 0.005547761917114258 length of segment : 87 time for calcul the mask position with numpy : 0.0036101341247558594 nb_pixel_total : 103921 time to create 1 rle with old method : 0.11490726470947266 length of segment : 468 time for calcul the mask position with numpy : 0.0009086132049560547 nb_pixel_total : 31832 time to create 1 rle with old method : 0.03435063362121582 length of segment : 257 time for calcul the mask position with numpy : 0.005380392074584961 nb_pixel_total : 225405 time to create 1 rle with new method : 0.009167194366455078 length of segment : 451 time for calcul the mask position with numpy : 0.002037525177001953 nb_pixel_total : 100936 time to create 1 rle with old method : 0.10743165016174316 length of segment : 566 time for calcul the mask position with numpy : 0.0005218982696533203 nb_pixel_total : 19942 time to create 1 rle with old method : 0.0222322940826416 length of segment : 139 time for calcul the mask position with numpy : 0.0006115436553955078 nb_pixel_total : 20404 time to create 1 rle with old method : 0.02233600616455078 length of segment : 208 time for calcul the mask position with numpy : 0.0010287761688232422 nb_pixel_total : 21460 time to create 1 rle with old method : 0.02325749397277832 length of segment : 282 time for calcul the mask position with numpy : 0.0027036666870117188 nb_pixel_total : 101464 time to create 1 rle with old method : 0.11055755615234375 length of segment : 346 time for calcul the mask position with numpy : 0.0021293163299560547 nb_pixel_total : 74625 time to create 1 rle with old method : 0.07888221740722656 length of segment : 376 time for calcul the mask position with numpy : 0.0007393360137939453 nb_pixel_total : 24253 time to create 1 rle with old method : 0.029592514038085938 length of segment : 188 time for calcul the mask position with numpy : 0.00372314453125 nb_pixel_total : 94492 time to create 1 rle with old method : 0.11566877365112305 length of segment : 572 time for calcul the mask position with numpy : 0.003475189208984375 nb_pixel_total : 134148 time to create 1 rle with old method : 0.14668703079223633 length of segment : 631 time for calcul the mask position with numpy : 0.0011324882507324219 nb_pixel_total : 41038 time to create 1 rle with old method : 0.05366182327270508 length of segment : 317 time for calcul the mask position with numpy : 0.004373073577880859 nb_pixel_total : 171023 time to create 1 rle with new method : 0.0093536376953125 length of segment : 479 time for calcul the mask position with numpy : 0.003688335418701172 nb_pixel_total : 130485 time to create 1 rle with old method : 0.1452651023864746 length of segment : 387 time for calcul the mask position with numpy : 0.0012736320495605469 nb_pixel_total : 67141 time to create 1 rle with old method : 0.08009123802185059 length of segment : 211 time for calcul the mask position with numpy : 0.0002777576446533203 nb_pixel_total : 5294 time to create 1 rle with old method : 0.006200075149536133 length of segment : 90 time for calcul the mask position with numpy : 0.002566814422607422 nb_pixel_total : 80047 time to create 1 rle with old method : 0.09060859680175781 length of segment : 467 time for calcul the mask position with numpy : 0.006355762481689453 nb_pixel_total : 217762 time to create 1 rle with new method : 0.010814189910888672 length of segment : 414 time for calcul the mask position with numpy : 0.0011386871337890625 nb_pixel_total : 24667 time to create 1 rle with old method : 0.0410764217376709 length of segment : 193 time for calcul the mask position with numpy : 0.002837657928466797 nb_pixel_total : 76341 time to create 1 rle with old method : 0.09137582778930664 length of segment : 383 time for calcul the mask position with numpy : 0.0018916130065917969 nb_pixel_total : 40186 time to create 1 rle with old method : 0.045653343200683594 length of segment : 286 time for calcul the mask position with numpy : 0.003008604049682617 nb_pixel_total : 88586 time to create 1 rle with old method : 0.09910964965820312 length of segment : 506 time for calcul the mask position with numpy : 0.00213623046875 nb_pixel_total : 71455 time to create 1 rle with old method : 0.08028221130371094 length of segment : 222 time for calcul the mask position with numpy : 0.0002930164337158203 nb_pixel_total : 6146 time to create 1 rle with old method : 0.007397651672363281 length of segment : 77 time for calcul the mask position with numpy : 0.0040395259857177734 nb_pixel_total : 144193 time to create 1 rle with old method : 0.160963773727417 length of segment : 550 time for calcul the mask position with numpy : 0.006431102752685547 nb_pixel_total : 234150 time to create 1 rle with new method : 0.013756990432739258 length of segment : 864 time for calcul the mask position with numpy : 0.0035943984985351562 nb_pixel_total : 129687 time to create 1 rle with old method : 0.14790081977844238 length of segment : 360 time for calcul the mask position with numpy : 0.005077362060546875 nb_pixel_total : 216501 time to create 1 rle with new method : 0.007371664047241211 length of segment : 428 time for calcul the mask position with numpy : 0.0003476142883300781 nb_pixel_total : 5246 time to create 1 rle with old method : 0.006257534027099609 length of segment : 89 time for calcul the mask position with numpy : 0.003515481948852539 nb_pixel_total : 91897 time to create 1 rle with old method : 0.11389470100402832 length of segment : 458 time for calcul the mask position with numpy : 0.0042111873626708984 nb_pixel_total : 170084 time to create 1 rle with new method : 0.005930423736572266 length of segment : 370 time for calcul the mask position with numpy : 0.0007886886596679688 nb_pixel_total : 24613 time to create 1 rle with old method : 0.028744220733642578 length of segment : 147 time for calcul the mask position with numpy : 0.0004901885986328125 nb_pixel_total : 14167 time to create 1 rle with old method : 0.016629695892333984 length of segment : 133 time for calcul the mask position with numpy : 0.0005846023559570312 nb_pixel_total : 15542 time to create 1 rle with old method : 0.01824474334716797 length of segment : 116 time spent for convertir_results : 9.971328258514404 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 88 chid ids of type : 3594 Number RLEs to save : 30553 save missing photos in datou_result : time spend for datou_step_exec : 63.69905638694763 time spend to save output : 1.8272511959075928 total time spend for step 1 : 65.52630758285522 step2:crop_condition Fri Apr 25 10:21:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 88 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 55 About to insert : list_path_to_insert length 55 new photo from crops ! About to upload 55 photos upload in portfolio : 3736932 init cache_photo without model_param we have 55 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745569314_898072 we have uploaded 55 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.809042930603027 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745569329_898072 we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.334268569946289 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745569331_898072 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6619510650634766 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 25 About to insert : list_path_to_insert length 25 new photo from crops ! About to upload 25 photos upload in portfolio : 3736932 init cache_photo without model_param we have 25 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745569349_898072 we have uploaded 25 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.803225040435791 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745569357_898072 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5650589466094971 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745569359_898072 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6740648746490479 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1353652323, 1353652290, 1353652213, 1353651878, 1353651819, 1353651779, 1353651718, 1353651683] Looping around the photos to save general results len do output : 88 /1353662171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353662286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353652323', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353652290', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353652213', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651878', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651819', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651779', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651718', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651683', None, None, None, None, None, '2761800') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 272 time used for this insertion : 0.03876447677612305 save_final save missing photos in datou_result : time spend for datou_step_exec : 63.252015829086304 time spend to save output : 0.04149031639099121 total time spend for step 2 : 63.293506145477295 step3:rle_unique_nms_with_priority Fri Apr 25 10:22:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 88 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 3.8380722999572754 time for calcul the mask position with numpy : 0.4066007137298584 nb_pixel_total : 6526228 time to create 1 rle with new method : 0.7085189819335938 time for calcul the mask position with numpy : 0.021640300750732422 nb_pixel_total : 21168 time to create 1 rle with old method : 0.023539304733276367 time for calcul the mask position with numpy : 0.022425174713134766 nb_pixel_total : 80309 time to create 1 rle with old method : 0.08654141426086426 time for calcul the mask position with numpy : 0.020810604095458984 nb_pixel_total : 21961 time to create 1 rle with old method : 0.024354219436645508 time for calcul the mask position with numpy : 0.025415420532226562 nb_pixel_total : 10313 time to create 1 rle with old method : 0.012715816497802734 time for calcul the mask position with numpy : 0.025937318801879883 nb_pixel_total : 30162 time to create 1 rle with old method : 0.037186384201049805 time for calcul the mask position with numpy : 0.02669072151184082 nb_pixel_total : 50501 time to create 1 rle with old method : 0.06684374809265137 time for calcul the mask position with numpy : 0.024787425994873047 nb_pixel_total : 31535 time to create 1 rle with old method : 0.03463029861450195 time for calcul the mask position with numpy : 0.022213220596313477 nb_pixel_total : 29909 time to create 1 rle with old method : 0.04917407035827637 time for calcul the mask position with numpy : 0.025075912475585938 nb_pixel_total : 153714 time to create 1 rle with new method : 0.7193663120269775 time for calcul the mask position with numpy : 0.02221059799194336 nb_pixel_total : 94440 time to create 1 rle with old method : 0.10437989234924316 create new chi : 2.5704615116119385 time to delete rle : 0.017462491989135742 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++Number RLEs to save : 7114 TO DO : save crop sub photo not yet done ! save time : 0.4535696506500244 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 2.08720064163208 time for calcul the mask position with numpy : 0.584341287612915 nb_pixel_total : 6625416 time to create 1 rle with new method : 0.6277866363525391 time for calcul the mask position with numpy : 0.03454732894897461 nb_pixel_total : 11156 time to create 1 rle with old method : 0.012511730194091797 time for calcul the mask position with numpy : 0.02375006675720215 nb_pixel_total : 28163 time to create 1 rle with old method : 0.03154778480529785 time for calcul the mask position with numpy : 0.021098852157592773 nb_pixel_total : 6650 time to create 1 rle with old method : 0.007367372512817383 time for calcul the mask position with numpy : 0.023252487182617188 nb_pixel_total : 342544 time to create 1 rle with new method : 0.6116166114807129 time for calcul the mask position with numpy : 0.02014613151550293 nb_pixel_total : 36311 time to create 1 rle with old method : 0.03841900825500488 create new chi : 2.0984721183776855 time to delete rle : 0.0006971359252929688 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 5166 TO DO : save crop sub photo not yet done ! save time : 0.3287689685821533 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 1.625988483428955 time for calcul the mask position with numpy : 0.7082996368408203 nb_pixel_total : 6500564 time to create 1 rle with new method : 0.5383687019348145 time for calcul the mask position with numpy : 0.0262148380279541 nb_pixel_total : 11759 time to create 1 rle with old method : 0.013464927673339844 time for calcul the mask position with numpy : 0.02078533172607422 nb_pixel_total : 134827 time to create 1 rle with old method : 0.14499711990356445 time for calcul the mask position with numpy : 0.021681785583496094 nb_pixel_total : 173592 time to create 1 rle with new method : 0.3773636817932129 time for calcul the mask position with numpy : 0.02097630500793457 nb_pixel_total : 229498 time to create 1 rle with new method : 0.6719076633453369 create new chi : 2.625070571899414 time to delete rle : 0.001104116439819336 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 6628 TO DO : save crop sub photo not yet done ! save time : 0.43430376052856445 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 4.230128526687622 time for calcul the mask position with numpy : 0.45265841484069824 nb_pixel_total : 5734398 time to create 1 rle with new method : 0.49245262145996094 time for calcul the mask position with numpy : 0.021252870559692383 nb_pixel_total : 11187 time to create 1 rle with old method : 0.012395143508911133 time for calcul the mask position with numpy : 0.02077174186706543 nb_pixel_total : 25931 time to create 1 rle with old method : 0.029213428497314453 time for calcul the mask position with numpy : 0.0214536190032959 nb_pixel_total : 53416 time to create 1 rle with old method : 0.05922889709472656 time for calcul the mask position with numpy : 0.020911693572998047 nb_pixel_total : 14294 time to create 1 rle with old method : 0.015524625778198242 time for calcul the mask position with numpy : 0.021770477294921875 nb_pixel_total : 106212 time to create 1 rle with old method : 0.11484026908874512 time for calcul the mask position with numpy : 0.021721839904785156 nb_pixel_total : 68028 time to create 1 rle with old method : 0.07259321212768555 time for calcul the mask position with numpy : 0.021722078323364258 nb_pixel_total : 102122 time to create 1 rle with old method : 0.11521053314208984 time for calcul the mask position with numpy : 0.02395153045654297 nb_pixel_total : 330241 time to create 1 rle with new method : 0.595733642578125 time for calcul the mask position with numpy : 0.02152109146118164 nb_pixel_total : 37548 time to create 1 rle with old method : 0.041510581970214844 time for calcul the mask position with numpy : 0.025281190872192383 nb_pixel_total : 508667 time to create 1 rle with new method : 0.6447241306304932 time for calcul the mask position with numpy : 0.021604061126708984 nb_pixel_total : 35907 time to create 1 rle with old method : 0.03963518142700195 time for calcul the mask position with numpy : 0.020540952682495117 nb_pixel_total : 22289 time to create 1 rle with old method : 0.02502155303955078 create new chi : 3.0557687282562256 time to delete rle : 0.0015778541564941406 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 10844 TO DO : save crop sub photo not yet done ! save time : 2.1410768032073975 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 4.815195560455322 time for calcul the mask position with numpy : 0.47393298149108887 nb_pixel_total : 5775274 time to create 1 rle with new method : 0.7683169841766357 time for calcul the mask position with numpy : 0.024643659591674805 nb_pixel_total : 237683 time to create 1 rle with new method : 0.5601992607116699 time for calcul the mask position with numpy : 0.03641390800476074 nb_pixel_total : 284727 time to create 1 rle with new method : 0.4212651252746582 time for calcul the mask position with numpy : 0.040082454681396484 nb_pixel_total : 146421 time to create 1 rle with old method : 0.17210030555725098 time for calcul the mask position with numpy : 0.034154653549194336 nb_pixel_total : 21605 time to create 1 rle with old method : 0.023471355438232422 time for calcul the mask position with numpy : 0.033440351486206055 nb_pixel_total : 18815 time to create 1 rle with old method : 0.020696401596069336 time for calcul the mask position with numpy : 0.03397369384765625 nb_pixel_total : 6433 time to create 1 rle with old method : 0.007407188415527344 time for calcul the mask position with numpy : 0.03589916229248047 nb_pixel_total : 113689 time to create 1 rle with old method : 0.15257763862609863 time for calcul the mask position with numpy : 0.0331110954284668 nb_pixel_total : 50854 time to create 1 rle with old method : 0.053914785385131836 time for calcul the mask position with numpy : 0.034422874450683594 nb_pixel_total : 92051 time to create 1 rle with old method : 0.10068535804748535 time for calcul the mask position with numpy : 0.0348660945892334 nb_pixel_total : 37108 time to create 1 rle with old method : 0.04088020324707031 time for calcul the mask position with numpy : 0.03250002861022949 nb_pixel_total : 13351 time to create 1 rle with old method : 0.014861583709716797 time for calcul the mask position with numpy : 0.03621840476989746 nb_pixel_total : 24278 time to create 1 rle with old method : 0.039586544036865234 time for calcul the mask position with numpy : 0.03586602210998535 nb_pixel_total : 115911 time to create 1 rle with old method : 0.12680578231811523 time for calcul the mask position with numpy : 0.03351473808288574 nb_pixel_total : 25486 time to create 1 rle with old method : 0.027922630310058594 time for calcul the mask position with numpy : 0.03817439079284668 nb_pixel_total : 86554 time to create 1 rle with old method : 0.09764313697814941 create new chi : 3.7111473083496094 time to delete rle : 0.0028905868530273438 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 13514 TO DO : save crop sub photo not yet done ! save time : 0.8425955772399902 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 4.804936408996582 time for calcul the mask position with numpy : 0.49899792671203613 nb_pixel_total : 5927510 time to create 1 rle with new method : 0.533501148223877 time for calcul the mask position with numpy : 0.025884151458740234 nb_pixel_total : 101464 time to create 1 rle with old method : 0.14228296279907227 time for calcul the mask position with numpy : 0.021304845809936523 nb_pixel_total : 21460 time to create 1 rle with old method : 0.02400970458984375 time for calcul the mask position with numpy : 0.03508925437927246 nb_pixel_total : 20404 time to create 1 rle with old method : 0.022612333297729492 time for calcul the mask position with numpy : 0.03654170036315918 nb_pixel_total : 14653 time to create 1 rle with old method : 0.01656508445739746 time for calcul the mask position with numpy : 0.036003828048706055 nb_pixel_total : 100936 time to create 1 rle with old method : 0.1183927059173584 time for calcul the mask position with numpy : 0.04124879837036133 nb_pixel_total : 225405 time to create 1 rle with new method : 0.8546299934387207 time for calcul the mask position with numpy : 0.03381824493408203 nb_pixel_total : 31832 time to create 1 rle with old method : 0.03533649444580078 time for calcul the mask position with numpy : 0.03309941291809082 nb_pixel_total : 103921 time to create 1 rle with old method : 0.11446619033813477 time for calcul the mask position with numpy : 0.0336606502532959 nb_pixel_total : 3938 time to create 1 rle with old method : 0.00452423095703125 time for calcul the mask position with numpy : 0.03398537635803223 nb_pixel_total : 91190 time to create 1 rle with old method : 0.1013340950012207 time for calcul the mask position with numpy : 0.03662991523742676 nb_pixel_total : 27579 time to create 1 rle with old method : 0.044072628021240234 time for calcul the mask position with numpy : 0.02305746078491211 nb_pixel_total : 23394 time to create 1 rle with old method : 0.027582645416259766 time for calcul the mask position with numpy : 0.020978927612304688 nb_pixel_total : 74543 time to create 1 rle with old method : 0.08207893371582031 time for calcul the mask position with numpy : 0.021813392639160156 nb_pixel_total : 186352 time to create 1 rle with new method : 0.5216407775878906 time for calcul the mask position with numpy : 0.021093368530273438 nb_pixel_total : 95659 time to create 1 rle with old method : 0.10682868957519531 create new chi : 3.7853810787200928 time to delete rle : 0.0020246505737304688 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 12021 TO DO : save crop sub photo not yet done ! save time : 0.7281978130340576 nb_obj : 11 nb_hashtags : 2 time to prepare the origin masks : 3.137667417526245 time for calcul the mask position with numpy : 0.5894396305084229 nb_pixel_total : 6009932 time to create 1 rle with new method : 0.38596224784851074 time for calcul the mask position with numpy : 0.03530716896057129 nb_pixel_total : 217762 time to create 1 rle with new method : 0.5866320133209229 time for calcul the mask position with numpy : 0.021579265594482422 nb_pixel_total : 80047 time to create 1 rle with old method : 0.08825445175170898 time for calcul the mask position with numpy : 0.019798755645751953 nb_pixel_total : 5294 time to create 1 rle with old method : 0.005964517593383789 time for calcul the mask position with numpy : 0.020532846450805664 nb_pixel_total : 67141 time to create 1 rle with old method : 0.07423877716064453 time for calcul the mask position with numpy : 0.02073836326599121 nb_pixel_total : 130485 time to create 1 rle with old method : 0.13637614250183105 time for calcul the mask position with numpy : 0.02053380012512207 nb_pixel_total : 171023 time to create 1 rle with new method : 0.49897003173828125 time for calcul the mask position with numpy : 0.02699112892150879 nb_pixel_total : 41038 time to create 1 rle with old method : 0.04290366172790527 time for calcul the mask position with numpy : 0.03380179405212402 nb_pixel_total : 134148 time to create 1 rle with old method : 0.14479446411132812 time for calcul the mask position with numpy : 0.03502821922302246 nb_pixel_total : 94492 time to create 1 rle with old method : 0.10334539413452148 time for calcul the mask position with numpy : 0.03465867042541504 nb_pixel_total : 24253 time to create 1 rle with old method : 0.0272369384765625 time for calcul the mask position with numpy : 0.03498220443725586 nb_pixel_total : 74625 time to create 1 rle with old method : 0.08094286918640137 create new chi : 3.1663825511932373 time to delete rle : 0.001725912094116211 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 10424 TO DO : save crop sub photo not yet done ! save time : 0.6739542484283447 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 5.7913572788238525 time for calcul the mask position with numpy : 0.5165519714355469 nb_pixel_total : 5696779 time to create 1 rle with new method : 0.6803832054138184 time for calcul the mask position with numpy : 0.03444027900695801 nb_pixel_total : 15542 time to create 1 rle with old method : 0.01691579818725586 time for calcul the mask position with numpy : 0.027866363525390625 nb_pixel_total : 14167 time to create 1 rle with old method : 0.015845060348510742 time for calcul the mask position with numpy : 0.02232527732849121 nb_pixel_total : 24613 time to create 1 rle with old method : 0.02747178077697754 time for calcul the mask position with numpy : 0.02428269386291504 nb_pixel_total : 170084 time to create 1 rle with new method : 0.5926055908203125 time for calcul the mask position with numpy : 0.02149796485900879 nb_pixel_total : 91897 time to create 1 rle with old method : 0.10216093063354492 time for calcul the mask position with numpy : 0.02161264419555664 nb_pixel_total : 5246 time to create 1 rle with old method : 0.005935192108154297 time for calcul the mask position with numpy : 0.02277064323425293 nb_pixel_total : 216501 time to create 1 rle with new method : 0.650507926940918 time for calcul the mask position with numpy : 0.021945476531982422 nb_pixel_total : 129687 time to create 1 rle with old method : 0.1417989730834961 time for calcul the mask position with numpy : 0.02273869514465332 nb_pixel_total : 234150 time to create 1 rle with new method : 0.4707810878753662 time for calcul the mask position with numpy : 0.021898269653320312 nb_pixel_total : 144193 time to create 1 rle with old method : 0.18488097190856934 time for calcul the mask position with numpy : 0.022946834564208984 nb_pixel_total : 6146 time to create 1 rle with old method : 0.006793975830078125 time for calcul the mask position with numpy : 0.022099971771240234 nb_pixel_total : 71455 time to create 1 rle with old method : 0.07971787452697754 time for calcul the mask position with numpy : 0.023512840270996094 nb_pixel_total : 88586 time to create 1 rle with old method : 0.10095834732055664 time for calcul the mask position with numpy : 0.021971940994262695 nb_pixel_total : 40186 time to create 1 rle with old method : 0.04499626159667969 time for calcul the mask position with numpy : 0.021430015563964844 nb_pixel_total : 76341 time to create 1 rle with old method : 0.08360600471496582 time for calcul the mask position with numpy : 0.02203059196472168 nb_pixel_total : 24667 time to create 1 rle with old method : 0.027662992477416992 create new chi : 4.230057716369629 time to delete rle : 0.001708984375 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 12524 TO DO : save crop sub photo not yet done ! save time : 0.7486209869384766 map_output_result : {1353652323: (0.0, 'Should be the crop_list due to order', 0), 1353652290: (0.0, 'Should be the crop_list due to order', 0), 1353652213: (0.0, 'Should be the crop_list due to order', 0), 1353651878: (0.0, 'Should be the crop_list due to order', 0), 1353651819: (0.0, 'Should be the crop_list due to order', 0), 1353651779: (0.0, 'Should be the crop_list due to order', 0), 1353651718: (0.0, 'Should be the crop_list due to order', 0), 1353651683: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1353652323, 1353652290, 1353652213, 1353651878, 1353651819, 1353651779, 1353651718, 1353651683] Looping around the photos to save general results len do output : 8 /1353652323.Didn't retrieve data . /1353652290.Didn't retrieve data . /1353652213.Didn't retrieve data . /1353651878.Didn't retrieve data . /1353651819.Didn't retrieve data . /1353651779.Didn't retrieve data . /1353651718.Didn't retrieve data . /1353651683.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353652323', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353652290', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353652213', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651878', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651819', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651779', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651718', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651683', None, None, None, None, None, '2761800') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.013684988021850586 save_final save missing photos in datou_result : time spend for datou_step_exec : 63.2890362739563 time spend to save output : 0.014060735702514648 total time spend for step 3 : 63.30309700965881 step4:ventilate_hashtags_in_portfolio Fri Apr 25 10:23:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22426955 get user id for portfolio 22426955 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22426955 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','mal_croppe','pet_fonce','carton','background','pet_clair','papier','metal','environnement','pehd','flou')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22426955 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','mal_croppe','pet_fonce','carton','background','pet_clair','papier','metal','environnement','pehd','flou')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22426955 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','mal_croppe','pet_fonce','carton','background','pet_clair','papier','metal','environnement','pehd','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22427487,22427488,22427489,22427490,22427491,22427492,22427493,22427494,22427495,22427496,22427497?tags=autre,mal_croppe,pet_fonce,carton,background,pet_clair,papier,metal,environnement,pehd,flou Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1353652323, 1353652290, 1353652213, 1353651878, 1353651819, 1353651779, 1353651718, 1353651683] Looping around the photos to save general results len do output : 1 /22426955. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353652323', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353652290', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353652213', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651878', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651819', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651779', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651718', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651683', None, None, None, None, None, '2761800') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.015017509460449219 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.592057466506958 time spend to save output : 0.01524806022644043 total time spend for step 4 : 1.6073055267333984 step5:final Fri Apr 25 10:23:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1353652323: ('0.13485035615808824',), 1353652290: ('0.13485035615808824',), 1353652213: ('0.13485035615808824',), 1353651878: ('0.13485035615808824',), 1353651819: ('0.13485035615808824',), 1353651779: ('0.13485035615808824',), 1353651718: ('0.13485035615808824',), 1353651683: ('0.13485035615808824',)} new output for save of step final : {1353652323: ('0.13485035615808824',), 1353652290: ('0.13485035615808824',), 1353652213: ('0.13485035615808824',), 1353651878: ('0.13485035615808824',), 1353651819: ('0.13485035615808824',), 1353651779: ('0.13485035615808824',), 1353651718: ('0.13485035615808824',), 1353651683: ('0.13485035615808824',)} [1353652323, 1353652290, 1353652213, 1353651878, 1353651819, 1353651779, 1353651718, 1353651683] Looping around the photos to save general results len do output : 8 /1353652323.Didn't retrieve data . /1353652290.Didn't retrieve data . /1353652213.Didn't retrieve data . /1353651878.Didn't retrieve data . /1353651819.Didn't retrieve data . /1353651779.Didn't retrieve data . /1353651718.Didn't retrieve data . /1353651683.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353652323', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353652290', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353652213', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651878', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651819', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651779', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651718', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651683', None, None, None, None, None, '2761800') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.013451337814331055 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11784482002258301 time spend to save output : 0.013878822326660156 total time spend for step 5 : 0.13172364234924316 step6:blur_detection Fri Apr 25 10:23:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b.jpg resize: (2160, 3264) 1353652323 -5.757766866433142 treat image : temp/1745569230_898072_1353652290_ebe3cc7fb27ba9a42a25ad444d924c25.jpg resize: (2160, 3264) 1353652290 -1.478989897976966 treat image : temp/1745569230_898072_1353652213_147499b65130ad02c506ce747d204539.jpg resize: (2160, 3264) 1353652213 -4.808665101695922 treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277.jpg resize: (2160, 3264) 1353651878 -1.0612593238847876 treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829.jpg resize: (2160, 3264) 1353651819 -5.471342650458184 treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de.jpg resize: (2160, 3264) 1353651779 -5.5618881860436336 treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25.jpg resize: (2160, 3264) 1353651718 -5.546246724862041 treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc.jpg resize: (2160, 3264) 1353651683 -5.5818699081089305 treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404436_0.png resize: (475, 585) 1353662171 -2.495905752154861 treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404437_0.png resize: (173, 288) 1353662172 -2.2181746656440273 treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404438_0.png resize: (222, 252) 1353662173 -2.5492327049275483 treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404441_0.png resize: (135, 141) 1353662174 -2.5742932938521195 treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404442_0.png resize: (126, 258) 1353662175 -2.771272655531215 treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404444_0.png resize: (122, 269) 1353662176 -2.8318270656071505 treat image : temp/1745569230_898072_1353652290_ebe3cc7fb27ba9a42a25ad444d924c25_rle_crop_3769404445_0.png resize: (307, 180) 1353662177 -1.8918310415641566 treat image : temp/1745569230_898072_1353652290_ebe3cc7fb27ba9a42a25ad444d924c25_rle_crop_3769404447_0.png resize: (72, 127) 1353662178 -1.6334404435941534 treat image : temp/1745569230_898072_1353652290_ebe3cc7fb27ba9a42a25ad444d924c25_rle_crop_3769404449_0.png resize: (140, 132) 1353662179 0.5512627588039106 treat image : temp/1745569230_898072_1353652213_147499b65130ad02c506ce747d204539_rle_crop_3769404450_0.png resize: (763, 395) 1353662180 -1.8236605551806762 treat image : temp/1745569230_898072_1353652213_147499b65130ad02c506ce747d204539_rle_crop_3769404451_0.png resize: (615, 492) 1353662181 -4.138753481620777 treat image : temp/1745569230_898072_1353652213_147499b65130ad02c506ce747d204539_rle_crop_3769404453_0.png resize: (183, 83) 1353662182 -3.8022982410140185 treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404455_0.png resize: (288, 186) 1353662183 -0.9362212946136874 treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404457_0.png resize: (141, 406) 1353662184 -1.015148411852642 treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404459_0.png resize: (468, 339) 1353662185 -0.04770165807969175 treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404461_0.png resize: (464, 575) 1353662186 -0.25650145960626414 treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404462_0.png resize: (115, 187) 1353662187 -1.8500374917719904 treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404463_0.png resize: (167, 542) 1353662188 -1.2253807174094309 treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404464_0.png resize: (252, 160) 1353662189 -1.953929852380965 treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404466_0.png resize: (469, 343) 1353662190 -1.7550418116611528 treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404467_0.png resize: (210, 227) 1353662191 -1.7381226851783145 treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404468_0.png resize: (520, 386) 1353662192 -4.7207917957116035 treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404470_0.png resize: (100, 216) 1353662193 -2.2569785993157865 treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404471_0.png resize: (289, 250) 1353662194 -3.3867393896209537 treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404473_0.png resize: (238, 312) 1353662195 -2.0519109509769695 treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404474_0.png resize: (460, 320) 1353662196 -4.360201404265478 treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404476_0.png resize: (193, 155) 1353662197 -5.272878887217353 treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404480_0.png resize: (447, 739) 1353662198 -3.263064682810845 treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404481_0.png resize: (480, 359) 1353662199 -4.289022151292654 treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404484_0.png resize: (171, 231) 1353662200 -1.5622216877472266 treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404486_0.png resize: (469, 377) 1353662201 -1.9067527989088502 treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404487_0.png resize: (87, 82) 1353662202 -1.8697759377699246 treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404488_0.png resize: (468, 329) 1353662203 -4.4338844044407075 treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404489_0.png resize: (255, 255) 1353662204 -3.2048595107440887 treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404492_0.png resize: (138, 208) 1353662205 -1.847377280771589 treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404493_0.png resize: (197, 160) 1353662206 -5.428299267776171 treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404494_0.png resize: (242, 198) 1353662207 -2.5586702020518426 treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404496_0.png resize: (376, 350) 1353662208 -4.617542151522497 treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404497_0.png resize: (183, 220) 1353662209 -1.6762230261202733 treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404498_0.png resize: (463, 343) 1353662210 -2.2241008230198274 treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404499_0.png resize: (498, 428) 1353662211 -3.9903335951076246 treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404500_0.png resize: (295, 272) 1353662212 -3.6399078154174656 treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404504_0.png resize: (90, 91) 1353662213 -2.215563047986993 treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404505_0.png resize: (441, 256) 1353662214 -4.319559574687997 treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404506_0.png resize: (411, 746) 1353662215 -3.0653914616417364 treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404507_0.png resize: (187, 222) 1353662216 -1.7087054128563381 treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404508_0.png resize: (383, 365) 1353662217 -4.645465460100103 treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404509_0.png resize: (276, 271) 1353662218 -3.6792217227288067 treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404510_0.png resize: (457, 354) 1353662219 -1.8980336446085926 treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404512_0.png resize: (75, 117) 1353662220 -1.9858622487321824 treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404513_0.png resize: (506, 427) 1353662221 -3.9546022069306392 treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404517_0.png resize: (89, 93) 1353662222 -2.2898340759232867 treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404518_0.png resize: (458, 291) 1353662223 -4.239754299125909 treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404521_0.png resize: (133, 160) 1353662224 -3.6373445316236097 treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404522_0.png resize: (116, 179) 1353662225 -2.93863195017204 treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404469_0.png resize: (195, 178) 1353662227 -3.0194054338298124 treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404472_0.png resize: (324, 390) 1353662228 -3.9280938414537236 treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404475_0.png resize: (75, 108) 1353662229 -0.43815635952856974 treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404485_0.png resize: (185, 192) 1353662230 -2.9720226961720058 treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404520_0.png resize: (146, 189) 1353662231 -5.35850054233222 treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404465_0.png resize: (68, 261) 1353662232 -2.7578713192885718 treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404435_0.png resize: (213, 585) 1353662255 -3.40325756250796 treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404439_0.png resize: (201, 343) 1353662256 -3.153245755339055 treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404440_0.png resize: (195, 185) 1353662257 -4.153911121992526 treat image : temp/1745569230_898072_1353652290_ebe3cc7fb27ba9a42a25ad444d924c25_rle_crop_3769404446_0.png resize: (830, 577) 1353662258 -1.5681193245284148 treat image : temp/1745569230_898072_1353652290_ebe3cc7fb27ba9a42a25ad444d924c25_rle_crop_3769404448_0.png resize: (146, 308) 1353662259 -2.3273681203696768 treat image : temp/1745569230_898072_1353652213_147499b65130ad02c506ce747d204539_rle_crop_3769404452_0.png resize: (590, 263) 1353662260 -4.883880807929138 treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404456_0.png resize: (824, 831) 1353662261 -1.7599120225458076 treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404458_0.png resize: (621, 682) 1353662262 -2.0523354972897354 treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404460_0.png resize: (322, 303) 1353662263 -0.26283461598138574 treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404477_0.png resize: (147, 195) 1353662264 -3.9814676832459113 treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404478_0.png resize: (441, 502) 1353662265 -4.903702532187292 treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404479_0.png resize: (911, 447) 1353662266 -4.457646205635224 treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404482_0.png resize: (333, 929) 1353662267 -3.4570960974332055 treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404483_0.png resize: (216, 479) 1353662268 -3.857868591379841 treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404490_0.png resize: (449, 743) 1353662269 -3.326853213000632 treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404491_0.png resize: (383, 370) 1353662270 -4.624188332953145 treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404495_0.png resize: (333, 424) 1353662271 -1.3006678922220336 treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404501_0.png resize: (337, 782) 1353662272 -3.753261312023919 treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404502_0.png resize: (382, 510) 1353662273 -4.7533572050863615 treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404503_0.png resize: (205, 448) 1353662274 -3.6559103693337582 treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404511_0.png resize: (213, 468) 1353662275 -3.5852253663265734 treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404514_0.png resize: (789, 441) 1353662276 -4.281285210989716 treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404515_0.png resize: (359, 534) 1353662277 -4.843437848622832 treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404516_0.png resize: (427, 730) 1353662278 -3.114193473481032 treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404519_0.png resize: (337, 757) 1353662279 -3.5643840220271654 treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404454_0.png resize: (311, 252) 1353662284 -1.8832536461539742 treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404443_0.png resize: (324, 307) 1353662286 -4.480512211798094 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 96 time used for this insertion : 0.01628565788269043 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 96 time used for this insertion : 0.015995264053344727 save missing photos in datou_result : time spend for datou_step_exec : 30.28496026992798 time spend to save output : 0.037003278732299805 total time spend for step 6 : 30.32196354866028 step7:brightness Fri Apr 25 10:24:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b.jpg treat image : temp/1745569230_898072_1353652290_ebe3cc7fb27ba9a42a25ad444d924c25.jpg treat image : temp/1745569230_898072_1353652213_147499b65130ad02c506ce747d204539.jpg treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277.jpg treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829.jpg treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de.jpg treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25.jpg treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc.jpg treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404436_0.png treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404437_0.png treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404438_0.png treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404441_0.png treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404442_0.png treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404444_0.png treat image : temp/1745569230_898072_1353652290_ebe3cc7fb27ba9a42a25ad444d924c25_rle_crop_3769404445_0.png treat image : temp/1745569230_898072_1353652290_ebe3cc7fb27ba9a42a25ad444d924c25_rle_crop_3769404447_0.png treat image : temp/1745569230_898072_1353652290_ebe3cc7fb27ba9a42a25ad444d924c25_rle_crop_3769404449_0.png treat image : temp/1745569230_898072_1353652213_147499b65130ad02c506ce747d204539_rle_crop_3769404450_0.png treat image : temp/1745569230_898072_1353652213_147499b65130ad02c506ce747d204539_rle_crop_3769404451_0.png treat image : temp/1745569230_898072_1353652213_147499b65130ad02c506ce747d204539_rle_crop_3769404453_0.png treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404455_0.png treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404457_0.png treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404459_0.png treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404461_0.png treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404462_0.png treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404463_0.png treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404464_0.png treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404466_0.png treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404467_0.png treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404468_0.png treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404470_0.png treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404471_0.png treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404473_0.png treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404474_0.png treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404476_0.png treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404480_0.png treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404481_0.png treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404484_0.png treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404486_0.png treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404487_0.png treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404488_0.png treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404489_0.png treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404492_0.png treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404493_0.png treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404494_0.png treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404496_0.png treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404497_0.png treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404498_0.png treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404499_0.png treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404500_0.png treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404504_0.png treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404505_0.png treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404506_0.png treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404507_0.png treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404508_0.png treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404509_0.png treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404510_0.png treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404512_0.png treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404513_0.png treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404517_0.png treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404518_0.png treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404521_0.png treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404522_0.png treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404469_0.png treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404472_0.png treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404475_0.png treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404485_0.png treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404520_0.png treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404465_0.png treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404435_0.png treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404439_0.png treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404440_0.png treat image : temp/1745569230_898072_1353652290_ebe3cc7fb27ba9a42a25ad444d924c25_rle_crop_3769404446_0.png treat image : temp/1745569230_898072_1353652290_ebe3cc7fb27ba9a42a25ad444d924c25_rle_crop_3769404448_0.png treat image : temp/1745569230_898072_1353652213_147499b65130ad02c506ce747d204539_rle_crop_3769404452_0.png treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404456_0.png treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404458_0.png treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404460_0.png treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404477_0.png treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404478_0.png treat image : temp/1745569230_898072_1353651819_854be62fe2efead402b9be32b4a83829_rle_crop_3769404479_0.png treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404482_0.png treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404483_0.png treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404490_0.png treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404491_0.png treat image : temp/1745569230_898072_1353651779_73a81efe777cd7bf6e1d2b80dbbbd7de_rle_crop_3769404495_0.png treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404501_0.png treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404502_0.png treat image : temp/1745569230_898072_1353651718_f84d59be1b01953c9b430a0bb857dc25_rle_crop_3769404503_0.png treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404511_0.png treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404514_0.png treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404515_0.png treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404516_0.png treat image : temp/1745569230_898072_1353651683_dbe5ec4f131691f6eb148787695930dc_rle_crop_3769404519_0.png treat image : temp/1745569230_898072_1353651878_cae0fd1bdf9f99ceaf670f17960ed277_rle_crop_3769404454_0.png treat image : temp/1745569230_898072_1353652323_1268deaf6429f9a0c89d7d993f3bce3b_rle_crop_3769404443_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 96 time used for this insertion : 0.016892194747924805 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 96 time used for this insertion : 0.014101982116699219 save missing photos in datou_result : time spend for datou_step_exec : 8.294750690460205 time spend to save output : 0.0360407829284668 total time spend for step 7 : 8.330791473388672 step8:velours_tree Fri Apr 25 10:24:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.12454652786254883 time spend to save output : 3.5762786865234375e-05 total time spend for step 8 : 0.12458229064941406 step9:send_mail_cod Fri Apr 25 10:24:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22426955_25-04-2025_10_24_23.pdf 22427487 change filename to text .imagette224274871745569463 22427488 imagette224274881745569464 22427489 change filename to text .imagette224274891745569464 22427490 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette224274901745569464 22427491 imagette224274911745569464 22427492 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette224274921745569464 22427493 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette224274931745569466 22427494 change filename to text .imagette224274941745569467 22427496 imagette224274961745569467 22427497 imagette224274971745569467 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22426955 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22427487,22427488,22427489,22427490,22427491,22427492,22427493,22427494,22427495,22427496,22427497?tags=autre,mal_croppe,pet_fonce,carton,background,pet_clair,papier,metal,environnement,pehd,flou args[1353652323] : ((1353652323, -5.757766866433142, 492609224), (1353652323, 0.03835322750572129, 2107752395), '0.13485035615808824') We are sending mail with results at report@fotonower.com args[1353652290] : ((1353652290, -1.478989897976966, 492688767), (1353652290, -0.007446343526545519, 2107752395), '0.13485035615808824') We are sending mail with results at report@fotonower.com args[1353652213] : ((1353652213, -4.808665101695922, 492609224), (1353652213, 0.11432221455315163, 2107752395), '0.13485035615808824') We are sending mail with results at report@fotonower.com args[1353651878] : ((1353651878, -1.0612593238847876, 492688767), (1353651878, -0.010436150193972807, 2107752395), '0.13485035615808824') We are sending mail with results at report@fotonower.com args[1353651819] : ((1353651819, -5.471342650458184, 492609224), (1353651819, 0.09741514420343808, 2107752395), '0.13485035615808824') We are sending mail with results at report@fotonower.com args[1353651779] : ((1353651779, -5.5618881860436336, 492609224), (1353651779, 0.13758491768216896, 2107752395), '0.13485035615808824') We are sending mail with results at report@fotonower.com args[1353651718] : ((1353651718, -5.546246724862041, 492609224), (1353651718, 0.12106844806987674, 2107752395), '0.13485035615808824') We are sending mail with results at report@fotonower.com args[1353651683] : ((1353651683, -5.5818699081089305, 492609224), (1353651683, 0.10567391639628872, 2107752395), '0.13485035615808824') We are sending mail with results at report@fotonower.com refus_total : 0.13485035615808824 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22426955 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22426955_25-04-2025_10_24_23.pdf results_Auto_P22426955_25-04-2025_10_24_23.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22426955_25-04-2025_10_24_23.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22426955','results_Auto_P22426955_25-04-2025_10_24_23.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22426955_25-04-2025_10_24_23.pdf','pdf','','0.84','0.13485035615808824') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22426955

https://www.fotonower.com/image?json=false&list_photos_id=1353652323
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353652290
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353652213
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353651878
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353651819
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353651779
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353651718
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353651683
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 13.49%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/22427487?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/22427489?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22427490?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22427492?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22427493?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/22427494?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22426955_25-04-2025_10_24_23.pdf.

Lien vers velours :https://www.fotonower.com/velours/22427487,22427488,22427489,22427490,22427491,22427492,22427493,22427494,22427495,22427496,22427497?tags=autre,mal_croppe,pet_fonce,carton,background,pet_clair,papier,metal,environnement,pehd,flou.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 25 Apr 2025 08:24:31 GMT Content-Length: 0 Connection: close X-Message-Id: iEVrPsm7Sy6DQqtvwCS9VQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1353652323, 1353652290, 1353652213, 1353651878, 1353651819, 1353651779, 1353651718, 1353651683] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353652323', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353652290', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353652213', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651878', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651819', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651779', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651718', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651683', None, None, None, None, None, '2761800') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.011904239654541016 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.11433482170105 time spend to save output : 0.012092351913452148 total time spend for step 9 : 7.126427173614502 step10:split_time_score Fri Apr 25 10:24:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('09', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 25042025 22426955 Nombre de photos uploadées : 8 / 23040 (0%) 25042025 22426955 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 25042025 22426955 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 3.0994415283203125e-06 elapsed_time : order_list_meta_photo_and_scores 7.3909759521484375e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.00041413307189941406 elapsed_time : insert_dashboard_record_day_entry 0.025015592575073242 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22426953 order by id desc limit 1 Qualite : 0.13485035615808824 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22426955_25-04-2025_10_24_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22426955 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22426955 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'25042025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1353652323, 1353652290, 1353652213, 1353651878, 1353651819, 1353651779, 1353651718, 1353651683] Looping around the photos to save general results len do output : 1 /22426955Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353652323', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353652290', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353652213', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651878', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651819', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651779', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651718', None, None, None, None, None, '2761800') ('3318', None, None, None, None, None, None, None, '2761800') ('3318', '22426955', '1353651683', None, None, None, None, None, '2761800') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013504505157470703 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.1001267433166504 time spend to save output : 0.013730764389038086 total time spend for step 10 : 1.1138575077056885 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 115.69user 97.18system 4:06.92elapsed 86%CPU (0avgtext+0avgdata 4309868maxresident)k 514536inputs+116920outputs (98major+9679191minor)pagefaults 0swaps