python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 676568 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3234695'] with mtr_portfolio_ids : ['24581421'] and first list_photo_ids : [] new path : /proc/676568/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.9639542102813721 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Jul 4 08:50:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 7177 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-07-04 08:50:33.494279: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-07-04 08:50:33.519315: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-07-04 08:50:33.521475: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f2ea8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-07-04 08:50:33.521536: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-07-04 08:50:33.525552: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-07-04 08:50:33.646187: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x23c6c6b0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-07-04 08:50:33.646226: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-07-04 08:50:33.646979: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-04 08:50:33.647287: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-04 08:50:33.653443: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-04 08:50:33.655613: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-04 08:50:33.655958: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-04 08:50:33.659329: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-04 08:50:33.660450: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-04 08:50:33.665800: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-04 08:50:33.667056: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-04 08:50:33.667138: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-04 08:50:33.667865: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-04 08:50:33.667883: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-04 08:50:33.667893: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-04 08:50:33.669396: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6604 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-07-04 08:50:34.055405: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-04 08:50:34.055519: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-04 08:50:34.055537: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-04 08:50:34.055552: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-04 08:50:34.055566: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-04 08:50:34.055580: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-04 08:50:34.055593: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-04 08:50:34.055607: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-04 08:50:34.056603: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-04 08:50:34.057804: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-04 08:50:34.057847: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-04 08:50:34.057863: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-04 08:50:34.057876: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-04 08:50:34.057890: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-04 08:50:34.057904: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-04 08:50:34.057918: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-04 08:50:34.057932: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-04 08:50:34.058972: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-04 08:50:34.059023: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-04 08:50:34.059034: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-04 08:50:34.059042: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-04 08:50:34.060199: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6604 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-07-04 08:50:44.473038: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-04 08:50:44.659559: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-04 08:50:46.200667: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.201290: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.201897: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.202535: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.203113: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.203734: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.529955: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.82G (4107036672 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.530065: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-07-04 08:50:46.581147: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.581202: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-04 08:50:46.581809: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.581825: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-04 08:50:46.584066: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.584086: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.08GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-04 08:50:46.584655: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.584669: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.08GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-04 08:50:46.610140: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.610173: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 564.38MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-04 08:50:46.610723: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.610738: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 564.38MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-04 08:50:46.612232: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.612255: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 290.15MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-04 08:50:46.612799: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.612813: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 290.15MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-04 08:50:46.618204: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.618223: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.08GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-04 08:50:46.618753: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.618768: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.08GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-04 08:50:46.620421: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.620979: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.626546: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.627109: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.628600: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.629136: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.660945: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.661541: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.662091: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.662650: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.666285: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.666849: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.686919: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.687511: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.688063: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.688627: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.701718: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.702306: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.702877: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.703457: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.707910: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.708466: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.713143: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.713713: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.726093: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.726658: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.730888: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.731533: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.732104: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.732668: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.733474: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.734035: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.744786: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.745369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.745945: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.746513: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.747079: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.747660: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.748233: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.748796: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.758128: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.758699: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.764990: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.765553: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.797208: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.797291: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-07-04 08:50:46.798419: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.799580: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.806940: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.807775: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.808575: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.809410: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.817484: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.818045: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.841139: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.841718: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.842269: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.842806: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.846864: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.847482: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.848089: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.848694: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.850068: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.859984: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.860529: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.869489: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.870057: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.870629: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.871207: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.871773: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-04 08:50:46.872343: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 47 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 Detection mask done ! Trying to reset tf kernel 677096 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6764 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7957 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0010290145874023438 nb_pixel_total : 23088 time to create 1 rle with old method : 0.024997234344482422 length of segment : 208 time for calcul the mask position with numpy : 0.0005228519439697266 nb_pixel_total : 14768 time to create 1 rle with old method : 0.01650547981262207 length of segment : 98 time for calcul the mask position with numpy : 0.002758502960205078 nb_pixel_total : 53341 time to create 1 rle with old method : 0.05999135971069336 length of segment : 481 time for calcul the mask position with numpy : 0.0024192333221435547 nb_pixel_total : 82066 time to create 1 rle with old method : 0.08956074714660645 length of segment : 422 time for calcul the mask position with numpy : 0.00083160400390625 nb_pixel_total : 31446 time to create 1 rle with old method : 0.03311324119567871 length of segment : 271 time for calcul the mask position with numpy : 0.0012798309326171875 nb_pixel_total : 45923 time to create 1 rle with old method : 0.05097365379333496 length of segment : 258 time for calcul the mask position with numpy : 0.000492095947265625 nb_pixel_total : 15967 time to create 1 rle with old method : 0.02434706687927246 length of segment : 183 time for calcul the mask position with numpy : 0.0006842613220214844 nb_pixel_total : 20768 time to create 1 rle with old method : 0.028620243072509766 length of segment : 170 time for calcul the mask position with numpy : 0.00024962425231933594 nb_pixel_total : 10068 time to create 1 rle with old method : 0.015261650085449219 length of segment : 89 time for calcul the mask position with numpy : 0.04115796089172363 nb_pixel_total : 176839 time to create 1 rle with new method : 0.026307106018066406 length of segment : 572 time for calcul the mask position with numpy : 0.003643512725830078 nb_pixel_total : 108779 time to create 1 rle with old method : 0.20513677597045898 length of segment : 596 time for calcul the mask position with numpy : 0.0008265972137451172 nb_pixel_total : 30271 time to create 1 rle with old method : 0.06653738021850586 length of segment : 153 time for calcul the mask position with numpy : 0.0027322769165039062 nb_pixel_total : 116603 time to create 1 rle with old method : 0.14989113807678223 length of segment : 442 time for calcul the mask position with numpy : 0.0014715194702148438 nb_pixel_total : 62970 time to create 1 rle with old method : 0.08201861381530762 length of segment : 322 time for calcul the mask position with numpy : 0.0006372928619384766 nb_pixel_total : 42723 time to create 1 rle with old method : 0.052015066146850586 length of segment : 234 time for calcul the mask position with numpy : 0.0007970333099365234 nb_pixel_total : 31975 time to create 1 rle with old method : 0.03814554214477539 length of segment : 346 time for calcul the mask position with numpy : 0.0023088455200195312 nb_pixel_total : 90282 time to create 1 rle with old method : 0.10518360137939453 length of segment : 366 time for calcul the mask position with numpy : 0.0023605823516845703 nb_pixel_total : 126401 time to create 1 rle with old method : 0.14725995063781738 length of segment : 673 time for calcul the mask position with numpy : 0.0009512901306152344 nb_pixel_total : 42254 time to create 1 rle with old method : 0.050251007080078125 length of segment : 272 time for calcul the mask position with numpy : 0.001405954360961914 nb_pixel_total : 54081 time to create 1 rle with old method : 0.07573199272155762 length of segment : 690 time for calcul the mask position with numpy : 0.00029754638671875 nb_pixel_total : 13320 time to create 1 rle with old method : 0.016044139862060547 length of segment : 157 time for calcul the mask position with numpy : 0.0016841888427734375 nb_pixel_total : 64369 time to create 1 rle with old method : 0.07419300079345703 length of segment : 351 time for calcul the mask position with numpy : 0.0012083053588867188 nb_pixel_total : 60462 time to create 1 rle with old method : 0.07219433784484863 length of segment : 252 time for calcul the mask position with numpy : 0.0006487369537353516 nb_pixel_total : 31787 time to create 1 rle with old method : 0.03652763366699219 length of segment : 306 time for calcul the mask position with numpy : 0.0013234615325927734 nb_pixel_total : 29177 time to create 1 rle with old method : 0.04524803161621094 length of segment : 223 time for calcul the mask position with numpy : 0.0012879371643066406 nb_pixel_total : 39401 time to create 1 rle with old method : 0.0442662239074707 length of segment : 415 time for calcul the mask position with numpy : 0.0016067028045654297 nb_pixel_total : 23729 time to create 1 rle with old method : 0.02776622772216797 length of segment : 254 time for calcul the mask position with numpy : 0.0037384033203125 nb_pixel_total : 69452 time to create 1 rle with old method : 0.09850287437438965 length of segment : 315 time for calcul the mask position with numpy : 0.0025224685668945312 nb_pixel_total : 61892 time to create 1 rle with old method : 0.07028746604919434 length of segment : 322 time for calcul the mask position with numpy : 0.0021371841430664062 nb_pixel_total : 34611 time to create 1 rle with old method : 0.05620861053466797 length of segment : 312 time for calcul the mask position with numpy : 0.0013852119445800781 nb_pixel_total : 20110 time to create 1 rle with old method : 0.024289608001708984 length of segment : 153 time for calcul the mask position with numpy : 0.004008054733276367 nb_pixel_total : 56505 time to create 1 rle with old method : 0.06703639030456543 length of segment : 426 time for calcul the mask position with numpy : 0.004555702209472656 nb_pixel_total : 97983 time to create 1 rle with old method : 0.12162566184997559 length of segment : 367 time for calcul the mask position with numpy : 0.0010826587677001953 nb_pixel_total : 25764 time to create 1 rle with old method : 0.030390024185180664 length of segment : 222 time for calcul the mask position with numpy : 0.0014269351959228516 nb_pixel_total : 28740 time to create 1 rle with old method : 0.03344297409057617 length of segment : 216 time for calcul the mask position with numpy : 0.002996206283569336 nb_pixel_total : 59212 time to create 1 rle with old method : 0.06953644752502441 length of segment : 476 time for calcul the mask position with numpy : 0.0009133815765380859 nb_pixel_total : 20737 time to create 1 rle with old method : 0.026288509368896484 length of segment : 138 time for calcul the mask position with numpy : 0.004225015640258789 nb_pixel_total : 96986 time to create 1 rle with old method : 0.11036062240600586 length of segment : 796 time for calcul the mask position with numpy : 0.00482630729675293 nb_pixel_total : 108889 time to create 1 rle with old method : 0.1440739631652832 length of segment : 562 time for calcul the mask position with numpy : 0.004207134246826172 nb_pixel_total : 49736 time to create 1 rle with old method : 0.05828428268432617 length of segment : 276 time for calcul the mask position with numpy : 0.0012171268463134766 nb_pixel_total : 35816 time to create 1 rle with old method : 0.04281210899353027 length of segment : 179 time for calcul the mask position with numpy : 0.0011644363403320312 nb_pixel_total : 25522 time to create 1 rle with old method : 0.03610110282897949 length of segment : 119 time for calcul the mask position with numpy : 0.0031723976135253906 nb_pixel_total : 76611 time to create 1 rle with old method : 0.08915448188781738 length of segment : 374 time for calcul the mask position with numpy : 0.002502918243408203 nb_pixel_total : 56432 time to create 1 rle with old method : 0.06290888786315918 length of segment : 340 time for calcul the mask position with numpy : 0.0018608570098876953 nb_pixel_total : 23631 time to create 1 rle with old method : 0.027474403381347656 length of segment : 376 time for calcul the mask position with numpy : 0.0052525997161865234 nb_pixel_total : 115593 time to create 1 rle with old method : 0.13460063934326172 length of segment : 330 time for calcul the mask position with numpy : 0.0021016597747802734 nb_pixel_total : 22705 time to create 1 rle with old method : 0.036267757415771484 length of segment : 214 time for calcul the mask position with numpy : 0.003338336944580078 nb_pixel_total : 62179 time to create 1 rle with old method : 0.0735783576965332 length of segment : 353 time for calcul the mask position with numpy : 0.001087188720703125 nb_pixel_total : 17432 time to create 1 rle with old method : 0.0226287841796875 length of segment : 95 time for calcul the mask position with numpy : 0.006432294845581055 nb_pixel_total : 133084 time to create 1 rle with old method : 0.15207767486572266 length of segment : 382 time for calcul the mask position with numpy : 0.0015766620635986328 nb_pixel_total : 26022 time to create 1 rle with old method : 0.030182600021362305 length of segment : 221 time for calcul the mask position with numpy : 0.0061914920806884766 nb_pixel_total : 79027 time to create 1 rle with old method : 0.09083414077758789 length of segment : 508 time for calcul the mask position with numpy : 0.001996278762817383 nb_pixel_total : 36838 time to create 1 rle with old method : 0.04207491874694824 length of segment : 278 time for calcul the mask position with numpy : 0.0010917186737060547 nb_pixel_total : 22030 time to create 1 rle with old method : 0.02594137191772461 length of segment : 188 time for calcul the mask position with numpy : 0.0067026615142822266 nb_pixel_total : 137289 time to create 1 rle with old method : 0.15447282791137695 length of segment : 573 time for calcul the mask position with numpy : 0.002486705780029297 nb_pixel_total : 68721 time to create 1 rle with old method : 0.07753396034240723 length of segment : 501 time for calcul the mask position with numpy : 0.0011470317840576172 nb_pixel_total : 15546 time to create 1 rle with old method : 0.0182802677154541 length of segment : 291 time for calcul the mask position with numpy : 0.002390146255493164 nb_pixel_total : 38962 time to create 1 rle with old method : 0.04583334922790527 length of segment : 250 time for calcul the mask position with numpy : 0.002571582794189453 nb_pixel_total : 60617 time to create 1 rle with old method : 0.06925749778747559 length of segment : 401 time for calcul the mask position with numpy : 0.0008378028869628906 nb_pixel_total : 17599 time to create 1 rle with old method : 0.020357847213745117 length of segment : 169 time for calcul the mask position with numpy : 0.00673985481262207 nb_pixel_total : 122015 time to create 1 rle with old method : 0.1389768123626709 length of segment : 611 time for calcul the mask position with numpy : 0.0028650760650634766 nb_pixel_total : 75937 time to create 1 rle with old method : 0.08934426307678223 length of segment : 399 time for calcul the mask position with numpy : 0.0024743080139160156 nb_pixel_total : 55633 time to create 1 rle with old method : 0.06378912925720215 length of segment : 371 time for calcul the mask position with numpy : 0.0019450187683105469 nb_pixel_total : 38405 time to create 1 rle with old method : 0.04505181312561035 length of segment : 132 time for calcul the mask position with numpy : 0.002307891845703125 nb_pixel_total : 54175 time to create 1 rle with old method : 0.06264376640319824 length of segment : 312 time for calcul the mask position with numpy : 0.002519369125366211 nb_pixel_total : 56769 time to create 1 rle with old method : 0.0650331974029541 length of segment : 225 time for calcul the mask position with numpy : 0.0018069744110107422 nb_pixel_total : 24150 time to create 1 rle with old method : 0.031211137771606445 length of segment : 169 time for calcul the mask position with numpy : 0.0018024444580078125 nb_pixel_total : 18695 time to create 1 rle with old method : 0.023991823196411133 length of segment : 273 time for calcul the mask position with numpy : 0.0016295909881591797 nb_pixel_total : 31697 time to create 1 rle with old method : 0.037859201431274414 length of segment : 160 time for calcul the mask position with numpy : 0.00193023681640625 nb_pixel_total : 38164 time to create 1 rle with old method : 0.044034481048583984 length of segment : 314 time for calcul the mask position with numpy : 0.0008096694946289062 nb_pixel_total : 28329 time to create 1 rle with old method : 0.036156415939331055 length of segment : 208 time for calcul the mask position with numpy : 0.0022733211517333984 nb_pixel_total : 58035 time to create 1 rle with old method : 0.06650662422180176 length of segment : 314 time for calcul the mask position with numpy : 0.0012693405151367188 nb_pixel_total : 48799 time to create 1 rle with old method : 0.05781745910644531 length of segment : 272 time for calcul the mask position with numpy : 0.0016841888427734375 nb_pixel_total : 49133 time to create 1 rle with old method : 0.05717658996582031 length of segment : 199 time for calcul the mask position with numpy : 0.0032825469970703125 nb_pixel_total : 64526 time to create 1 rle with old method : 0.07210206985473633 length of segment : 390 time for calcul the mask position with numpy : 0.00209808349609375 nb_pixel_total : 42400 time to create 1 rle with old method : 0.04590582847595215 length of segment : 508 time for calcul the mask position with numpy : 0.0004909038543701172 nb_pixel_total : 15027 time to create 1 rle with old method : 0.016963958740234375 length of segment : 141 time for calcul the mask position with numpy : 0.0037124156951904297 nb_pixel_total : 87003 time to create 1 rle with old method : 0.09676051139831543 length of segment : 515 time for calcul the mask position with numpy : 0.0003223419189453125 nb_pixel_total : 8640 time to create 1 rle with old method : 0.010346651077270508 length of segment : 143 time for calcul the mask position with numpy : 0.0071315765380859375 nb_pixel_total : 228177 time to create 1 rle with new method : 0.015598297119140625 length of segment : 646 time for calcul the mask position with numpy : 0.0005862712860107422 nb_pixel_total : 21616 time to create 1 rle with old method : 0.024143457412719727 length of segment : 86 time for calcul the mask position with numpy : 0.0013508796691894531 nb_pixel_total : 41372 time to create 1 rle with old method : 0.05191445350646973 length of segment : 266 time for calcul the mask position with numpy : 0.0014231204986572266 nb_pixel_total : 37861 time to create 1 rle with old method : 0.04306316375732422 length of segment : 307 time for calcul the mask position with numpy : 0.0021359920501708984 nb_pixel_total : 58559 time to create 1 rle with old method : 0.06551384925842285 length of segment : 387 time for calcul the mask position with numpy : 0.0032243728637695312 nb_pixel_total : 86952 time to create 1 rle with old method : 0.09237504005432129 length of segment : 295 time for calcul the mask position with numpy : 0.0007696151733398438 nb_pixel_total : 17558 time to create 1 rle with old method : 0.01977396011352539 length of segment : 166 time for calcul the mask position with numpy : 0.002273082733154297 nb_pixel_total : 54072 time to create 1 rle with old method : 0.05925703048706055 length of segment : 484 time for calcul the mask position with numpy : 0.002331972122192383 nb_pixel_total : 25781 time to create 1 rle with old method : 0.027782440185546875 length of segment : 217 time for calcul the mask position with numpy : 0.0008597373962402344 nb_pixel_total : 18152 time to create 1 rle with old method : 0.0203092098236084 length of segment : 252 time for calcul the mask position with numpy : 0.0008301734924316406 nb_pixel_total : 20338 time to create 1 rle with old method : 0.022993087768554688 length of segment : 177 time for calcul the mask position with numpy : 0.0010106563568115234 nb_pixel_total : 23023 time to create 1 rle with old method : 0.02652597427368164 length of segment : 163 time for calcul the mask position with numpy : 0.0027489662170410156 nb_pixel_total : 42719 time to create 1 rle with old method : 0.04884934425354004 length of segment : 197 time for calcul the mask position with numpy : 0.00041747093200683594 nb_pixel_total : 15677 time to create 1 rle with old method : 0.0177457332611084 length of segment : 170 time for calcul the mask position with numpy : 0.0019774436950683594 nb_pixel_total : 56629 time to create 1 rle with old method : 0.0630807876586914 length of segment : 282 time for calcul the mask position with numpy : 0.0023365020751953125 nb_pixel_total : 46407 time to create 1 rle with old method : 0.05211496353149414 length of segment : 362 time for calcul the mask position with numpy : 0.0024383068084716797 nb_pixel_total : 57646 time to create 1 rle with old method : 0.06657648086547852 length of segment : 401 time for calcul the mask position with numpy : 0.0029125213623046875 nb_pixel_total : 76876 time to create 1 rle with old method : 0.08565878868103027 length of segment : 327 time for calcul the mask position with numpy : 0.0013003349304199219 nb_pixel_total : 31173 time to create 1 rle with old method : 0.03443765640258789 length of segment : 258 time for calcul the mask position with numpy : 0.0018024444580078125 nb_pixel_total : 48724 time to create 1 rle with old method : 0.05275416374206543 length of segment : 282 time for calcul the mask position with numpy : 0.0024785995483398438 nb_pixel_total : 72580 time to create 1 rle with old method : 0.07993340492248535 length of segment : 295 time for calcul the mask position with numpy : 0.0034568309783935547 nb_pixel_total : 87512 time to create 1 rle with old method : 0.09688830375671387 length of segment : 497 time for calcul the mask position with numpy : 0.001623392105102539 nb_pixel_total : 30604 time to create 1 rle with old method : 0.0371248722076416 length of segment : 296 time for calcul the mask position with numpy : 0.0039522647857666016 nb_pixel_total : 138916 time to create 1 rle with old method : 0.15082788467407227 length of segment : 755 time for calcul the mask position with numpy : 0.005396366119384766 nb_pixel_total : 149958 time to create 1 rle with old method : 0.16622614860534668 length of segment : 500 time for calcul the mask position with numpy : 0.0004749298095703125 nb_pixel_total : 27384 time to create 1 rle with old method : 0.030287504196166992 length of segment : 269 time for calcul the mask position with numpy : 0.019602060317993164 nb_pixel_total : 306344 time to create 1 rle with new method : 0.034281253814697266 length of segment : 758 time for calcul the mask position with numpy : 0.0006487369537353516 nb_pixel_total : 20708 time to create 1 rle with old method : 0.02333998680114746 length of segment : 184 time for calcul the mask position with numpy : 0.0020868778228759766 nb_pixel_total : 55273 time to create 1 rle with old method : 0.0644066333770752 length of segment : 559 time for calcul the mask position with numpy : 0.0006253719329833984 nb_pixel_total : 18581 time to create 1 rle with old method : 0.022152423858642578 length of segment : 124 time for calcul the mask position with numpy : 0.0003190040588378906 nb_pixel_total : 13905 time to create 1 rle with old method : 0.01648402214050293 length of segment : 188 time for calcul the mask position with numpy : 0.0011556148529052734 nb_pixel_total : 49580 time to create 1 rle with old method : 0.05638885498046875 length of segment : 225 time for calcul the mask position with numpy : 0.001386880874633789 nb_pixel_total : 43218 time to create 1 rle with old method : 0.053392887115478516 length of segment : 247 time for calcul the mask position with numpy : 0.005259037017822266 nb_pixel_total : 178440 time to create 1 rle with new method : 0.011209964752197266 length of segment : 549 time for calcul the mask position with numpy : 0.009206056594848633 nb_pixel_total : 302043 time to create 1 rle with new method : 0.03459572792053223 length of segment : 976 time for calcul the mask position with numpy : 0.001565694808959961 nb_pixel_total : 31480 time to create 1 rle with old method : 0.03592991828918457 length of segment : 270 time for calcul the mask position with numpy : 0.0008599758148193359 nb_pixel_total : 34145 time to create 1 rle with old method : 0.0382540225982666 length of segment : 228 time for calcul the mask position with numpy : 0.0009279251098632812 nb_pixel_total : 23783 time to create 1 rle with old method : 0.027828693389892578 length of segment : 227 time spent for convertir_results : 12.738042116165161 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 117 chid ids of type : 3594 Number RLEs to save : 38055 save missing photos in datou_result : time spend for datou_step_exec : 65.82902002334595 time spend to save output : 16.58060312271118 total time spend for step 1 : 82.40962314605713 step2:crop_condition Fri Jul 4 08:51:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 117 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 100 About to insert : list_path_to_insert length 100 new photo from crops ! About to upload 100 photos upload in portfolio : 3736932 init cache_photo without model_param we have 100 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1751611942_676568 we have uploaded 100 photos in the portfolio 3736932 time of upload the photos Elapsed time : 27.272679090499878 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1751611972_676568 we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.446820020675659 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1751611975_676568 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1112053394317627 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1751611979_676568 we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.5628142356872559 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1751611982_676568 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8076491355895996 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1370467540, 1370467539, 1370467537, 1370467536, 1370467535] Looping around the photos to save general results len do output : 117 /1370501980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370501999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370502152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467540', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467539', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467537', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467536', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467535', None, None, None, None, None, '3234695') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 356 time used for this insertion : 0.19758820533752441 save_final save missing photos in datou_result : time spend for datou_step_exec : 70.35069823265076 time spend to save output : 0.20229411125183105 total time spend for step 2 : 70.55299234390259 step3:rle_unique_nms_with_priority Fri Jul 4 08:53:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 117 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 21 nb_hashtags : 2 time to prepare the origin masks : 10.191815853118896 time for calcul the mask position with numpy : 0.417086124420166 nb_pixel_total : 7126321 time to create 1 rle with new method : 1.4571735858917236 time for calcul the mask position with numpy : 0.034484148025512695 nb_pixel_total : 13320 time to create 1 rle with old method : 0.015135526657104492 time for calcul the mask position with numpy : 0.02562713623046875 nb_pixel_total : 54081 time to create 1 rle with old method : 0.06184029579162598 time for calcul the mask position with numpy : 0.026022672653198242 nb_pixel_total : 42254 time to create 1 rle with old method : 0.051641225814819336 time for calcul the mask position with numpy : 0.026426076889038086 nb_pixel_total : 126401 time to create 1 rle with old method : 0.14167094230651855 time for calcul the mask position with numpy : 0.02594280242919922 nb_pixel_total : 90282 time to create 1 rle with old method : 0.10740542411804199 time for calcul the mask position with numpy : 0.02539205551147461 nb_pixel_total : 31975 time to create 1 rle with old method : 0.03606367111206055 time for calcul the mask position with numpy : 0.026131391525268555 nb_pixel_total : 42723 time to create 1 rle with old method : 0.04836845397949219 time for calcul the mask position with numpy : 0.0248262882232666 nb_pixel_total : 62970 time to create 1 rle with old method : 0.07062125205993652 time for calcul the mask position with numpy : 0.025041818618774414 nb_pixel_total : 116514 time to create 1 rle with old method : 0.1333174705505371 time for calcul the mask position with numpy : 0.02481389045715332 nb_pixel_total : 30271 time to create 1 rle with old method : 0.03436279296875 time for calcul the mask position with numpy : 0.02539539337158203 nb_pixel_total : 83014 time to create 1 rle with old method : 0.09380745887756348 time for calcul the mask position with numpy : 0.02602839469909668 nb_pixel_total : 176839 time to create 1 rle with new method : 0.6713297367095947 time for calcul the mask position with numpy : 0.02435898780822754 nb_pixel_total : 10068 time to create 1 rle with old method : 0.011442899703979492 time for calcul the mask position with numpy : 0.025385379791259766 nb_pixel_total : 20768 time to create 1 rle with old method : 0.02324080467224121 time for calcul the mask position with numpy : 0.024531126022338867 nb_pixel_total : 15967 time to create 1 rle with old method : 0.018184423446655273 time for calcul the mask position with numpy : 0.024492979049682617 nb_pixel_total : 45923 time to create 1 rle with old method : 0.05206727981567383 time for calcul the mask position with numpy : 0.02480483055114746 nb_pixel_total : 31446 time to create 1 rle with old method : 0.03573179244995117 time for calcul the mask position with numpy : 0.025064706802368164 nb_pixel_total : 82066 time to create 1 rle with old method : 0.11332488059997559 time for calcul the mask position with numpy : 0.02597975730895996 nb_pixel_total : 53341 time to create 1 rle with old method : 0.061415910720825195 time for calcul the mask position with numpy : 0.025156497955322266 nb_pixel_total : 14768 time to create 1 rle with old method : 0.020553112030029297 time for calcul the mask position with numpy : 0.02727532386779785 nb_pixel_total : 23088 time to create 1 rle with old method : 0.03727912902832031 create new chi : 4.328305959701538 time to delete rle : 0.025638103485107422 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++Number RLEs to save : 15858 TO DO : save crop sub photo not yet done ! save time : 2.0661885738372803 nb_obj : 24 nb_hashtags : 4 time to prepare the origin masks : 10.242080926895142 time for calcul the mask position with numpy : 0.5483522415161133 nb_pixel_total : 7134391 time to create 1 rle with new method : 1.2729873657226562 time for calcul the mask position with numpy : 0.04580545425415039 nb_pixel_total : 23631 time to create 1 rle with old method : 0.02709507942199707 time for calcul the mask position with numpy : 0.030306577682495117 nb_pixel_total : 56432 time to create 1 rle with old method : 0.06451606750488281 time for calcul the mask position with numpy : 0.02980661392211914 nb_pixel_total : 76611 time to create 1 rle with old method : 0.10527586936950684 time for calcul the mask position with numpy : 0.02683401107788086 nb_pixel_total : 25522 time to create 1 rle with old method : 0.030900001525878906 time for calcul the mask position with numpy : 0.027670860290527344 nb_pixel_total : 35816 time to create 1 rle with old method : 0.0458216667175293 time for calcul the mask position with numpy : 0.025766849517822266 nb_pixel_total : 49736 time to create 1 rle with old method : 0.058858633041381836 time for calcul the mask position with numpy : 0.02823019027709961 nb_pixel_total : 108889 time to create 1 rle with old method : 0.12282800674438477 time for calcul the mask position with numpy : 0.025739669799804688 nb_pixel_total : 59441 time to create 1 rle with old method : 0.07443857192993164 time for calcul the mask position with numpy : 0.027186870574951172 nb_pixel_total : 20737 time to create 1 rle with old method : 0.024826526641845703 time for calcul the mask position with numpy : 0.027776718139648438 nb_pixel_total : 59212 time to create 1 rle with old method : 0.06640768051147461 time for calcul the mask position with numpy : 0.0258328914642334 nb_pixel_total : 28740 time to create 1 rle with old method : 0.031435489654541016 time for calcul the mask position with numpy : 0.02811717987060547 nb_pixel_total : 25764 time to create 1 rle with old method : 0.03346061706542969 time for calcul the mask position with numpy : 0.0298459529876709 nb_pixel_total : 97983 time to create 1 rle with old method : 0.11628293991088867 time for calcul the mask position with numpy : 0.028271913528442383 nb_pixel_total : 56505 time to create 1 rle with old method : 0.06556344032287598 time for calcul the mask position with numpy : 0.025223493576049805 nb_pixel_total : 20110 time to create 1 rle with old method : 0.023146629333496094 time for calcul the mask position with numpy : 0.02570343017578125 nb_pixel_total : 34611 time to create 1 rle with old method : 0.03948473930358887 time for calcul the mask position with numpy : 0.025497913360595703 nb_pixel_total : 61892 time to create 1 rle with old method : 0.1458275318145752 time for calcul the mask position with numpy : 0.025458335876464844 nb_pixel_total : 69452 time to create 1 rle with old method : 0.07827067375183105 time for calcul the mask position with numpy : 0.02441692352294922 nb_pixel_total : 23729 time to create 1 rle with old method : 0.025974273681640625 time for calcul the mask position with numpy : 0.027834653854370117 nb_pixel_total : 39401 time to create 1 rle with old method : 0.04308032989501953 time for calcul the mask position with numpy : 0.024756669998168945 nb_pixel_total : 29177 time to create 1 rle with old method : 0.031159400939941406 time for calcul the mask position with numpy : 0.024377822875976562 nb_pixel_total : 31787 time to create 1 rle with old method : 0.0345609188079834 time for calcul the mask position with numpy : 0.028798818588256836 nb_pixel_total : 60462 time to create 1 rle with old method : 0.07066726684570312 time for calcul the mask position with numpy : 0.024633407592773438 nb_pixel_total : 64369 time to create 1 rle with old method : 0.0707852840423584 create new chi : 3.9745569229125977 time to delete rle : 0.0020246505737304688 batch 1 Loaded 49 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 17226 TO DO : save crop sub photo not yet done ! save time : 3.5247440338134766 nb_obj : 29 nb_hashtags : 4 time to prepare the origin masks : 5.060680389404297 time for calcul the mask position with numpy : 0.44644927978515625 nb_pixel_total : 6742727 time to create 1 rle with new method : 0.6286768913269043 time for calcul the mask position with numpy : 0.03303790092468262 nb_pixel_total : 38405 time to create 1 rle with old method : 0.04114985466003418 time for calcul the mask position with numpy : 0.0340578556060791 nb_pixel_total : 18695 time to create 1 rle with old method : 0.021277189254760742 time for calcul the mask position with numpy : 0.03400564193725586 nb_pixel_total : 22705 time to create 1 rle with old method : 0.02550029754638672 time for calcul the mask position with numpy : 0.03585386276245117 nb_pixel_total : 31697 time to create 1 rle with old method : 0.03558683395385742 time for calcul the mask position with numpy : 0.03428173065185547 nb_pixel_total : 17599 time to create 1 rle with old method : 0.019896507263183594 time for calcul the mask position with numpy : 0.03416728973388672 nb_pixel_total : 24150 time to create 1 rle with old method : 0.027146339416503906 time for calcul the mask position with numpy : 0.03436732292175293 nb_pixel_total : 62179 time to create 1 rle with old method : 0.06992435455322266 time for calcul the mask position with numpy : 0.0343778133392334 nb_pixel_total : 56769 time to create 1 rle with old method : 0.06394839286804199 time for calcul the mask position with numpy : 0.036150217056274414 nb_pixel_total : 122015 time to create 1 rle with old method : 0.135756254196167 time for calcul the mask position with numpy : 0.03699493408203125 nb_pixel_total : 115593 time to create 1 rle with old method : 0.1393439769744873 time for calcul the mask position with numpy : 0.03438162803649902 nb_pixel_total : 28329 time to create 1 rle with old method : 0.03204965591430664 time for calcul the mask position with numpy : 0.03452420234680176 nb_pixel_total : 49133 time to create 1 rle with old method : 0.05552077293395996 time for calcul the mask position with numpy : 0.03426194190979004 nb_pixel_total : 54175 time to create 1 rle with old method : 0.06085062026977539 time for calcul the mask position with numpy : 0.034374237060546875 nb_pixel_total : 75937 time to create 1 rle with old method : 0.08571243286132812 time for calcul the mask position with numpy : 0.03432607650756836 nb_pixel_total : 68721 time to create 1 rle with old method : 0.07707548141479492 time for calcul the mask position with numpy : 0.034708499908447266 nb_pixel_total : 137289 time to create 1 rle with old method : 0.15438175201416016 time for calcul the mask position with numpy : 0.03374075889587402 nb_pixel_total : 36838 time to create 1 rle with old method : 0.0413358211517334 time for calcul the mask position with numpy : 0.03449058532714844 nb_pixel_total : 79027 time to create 1 rle with old method : 0.08919477462768555 time for calcul the mask position with numpy : 0.03436994552612305 nb_pixel_total : 60617 time to create 1 rle with old method : 0.06772041320800781 time for calcul the mask position with numpy : 0.03427314758300781 nb_pixel_total : 46892 time to create 1 rle with old method : 0.05257844924926758 time for calcul the mask position with numpy : 0.034479618072509766 nb_pixel_total : 58035 time to create 1 rle with old method : 0.06525468826293945 time for calcul the mask position with numpy : 0.034493446350097656 nb_pixel_total : 38962 time to create 1 rle with old method : 0.04370570182800293 time for calcul the mask position with numpy : 0.034520864486694336 nb_pixel_total : 38164 time to create 1 rle with old method : 0.04246664047241211 time for calcul the mask position with numpy : 0.03426837921142578 nb_pixel_total : 26022 time to create 1 rle with old method : 0.02934718132019043 time for calcul the mask position with numpy : 0.03388094902038574 nb_pixel_total : 55633 time to create 1 rle with old method : 0.061800479888916016 time for calcul the mask position with numpy : 0.034758806228637695 nb_pixel_total : 133084 time to create 1 rle with old method : 0.16655397415161133 time for calcul the mask position with numpy : 0.03308272361755371 nb_pixel_total : 22030 time to create 1 rle with old method : 0.02400660514831543 time for calcul the mask position with numpy : 0.03341341018676758 nb_pixel_total : 17432 time to create 1 rle with old method : 0.0192718505859375 time for calcul the mask position with numpy : 0.0330812931060791 nb_pixel_total : 15546 time to create 1 rle with old method : 0.017187833786010742 create new chi : 3.8803789615631104 time to delete rle : 0.002336740493774414 batch 1 Loaded 59 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 19446 TO DO : save crop sub photo not yet done ! save time : 3.749410390853882 nb_obj : 21 nb_hashtags : 1 time to prepare the origin masks : 5.772277593612671 time for calcul the mask position with numpy : 0.455150842666626 nb_pixel_total : 7297049 time to create 1 rle with new method : 0.502061128616333 time for calcul the mask position with numpy : 0.026316165924072266 nb_pixel_total : 46407 time to create 1 rle with old method : 0.05244851112365723 time for calcul the mask position with numpy : 0.025602340698242188 nb_pixel_total : 56629 time to create 1 rle with old method : 0.06411385536193848 time for calcul the mask position with numpy : 0.025183916091918945 nb_pixel_total : 539 time to create 1 rle with old method : 0.0006496906280517578 time for calcul the mask position with numpy : 0.025448322296142578 nb_pixel_total : 42719 time to create 1 rle with old method : 0.04878830909729004 time for calcul the mask position with numpy : 0.025275230407714844 nb_pixel_total : 23023 time to create 1 rle with old method : 0.025905132293701172 time for calcul the mask position with numpy : 0.025049924850463867 nb_pixel_total : 20338 time to create 1 rle with old method : 0.023072004318237305 time for calcul the mask position with numpy : 0.02593827247619629 nb_pixel_total : 18152 time to create 1 rle with old method : 0.020780324935913086 time for calcul the mask position with numpy : 0.02929544448852539 nb_pixel_total : 25781 time to create 1 rle with old method : 0.02923893928527832 time for calcul the mask position with numpy : 0.024749040603637695 nb_pixel_total : 54072 time to create 1 rle with old method : 0.061258792877197266 time for calcul the mask position with numpy : 0.0271148681640625 nb_pixel_total : 17558 time to create 1 rle with old method : 0.020129919052124023 time for calcul the mask position with numpy : 0.02617669105529785 nb_pixel_total : 86952 time to create 1 rle with old method : 0.0967864990234375 time for calcul the mask position with numpy : 0.025968313217163086 nb_pixel_total : 58559 time to create 1 rle with old method : 0.08521699905395508 time for calcul the mask position with numpy : 0.028818368911743164 nb_pixel_total : 37861 time to create 1 rle with old method : 0.04261612892150879 time for calcul the mask position with numpy : 0.02337956428527832 nb_pixel_total : 41372 time to create 1 rle with old method : 0.04611468315124512 time for calcul the mask position with numpy : 0.024967432022094727 nb_pixel_total : 21616 time to create 1 rle with old method : 0.02431511878967285 time for calcul the mask position with numpy : 0.025374174118041992 nb_pixel_total : 228177 time to create 1 rle with new method : 1.0141117572784424 time for calcul the mask position with numpy : 0.02436208724975586 nb_pixel_total : 8640 time to create 1 rle with old method : 0.00979161262512207 time for calcul the mask position with numpy : 0.024981021881103516 nb_pixel_total : 87003 time to create 1 rle with old method : 0.09721899032592773 time for calcul the mask position with numpy : 0.02604842185974121 nb_pixel_total : 15027 time to create 1 rle with old method : 0.017388582229614258 time for calcul the mask position with numpy : 0.026743412017822266 nb_pixel_total : 42400 time to create 1 rle with old method : 0.04710578918457031 time for calcul the mask position with numpy : 0.025077342987060547 nb_pixel_total : 64526 time to create 1 rle with old method : 0.07981610298156738 create new chi : 3.470682382583618 time to delete rle : 0.0022263526916503906 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++Number RLEs to save : 14172 TO DO : save crop sub photo not yet done ! save time : 2.9577221870422363 nb_obj : 22 nb_hashtags : 3 time to prepare the origin masks : 8.133917093276978 time for calcul the mask position with numpy : 0.49764204025268555 nb_pixel_total : 6523678 time to create 1 rle with new method : 0.9822657108306885 time for calcul the mask position with numpy : 0.025460004806518555 nb_pixel_total : 23783 time to create 1 rle with old method : 0.02704644203186035 time for calcul the mask position with numpy : 0.04541444778442383 nb_pixel_total : 25809 time to create 1 rle with old method : 0.02947998046875 time for calcul the mask position with numpy : 0.04020380973815918 nb_pixel_total : 31480 time to create 1 rle with old method : 0.03468060493469238 time for calcul the mask position with numpy : 0.04285144805908203 nb_pixel_total : 302043 time to create 1 rle with new method : 0.47394609451293945 time for calcul the mask position with numpy : 0.04175996780395508 nb_pixel_total : 178440 time to create 1 rle with new method : 1.7933387756347656 time for calcul the mask position with numpy : 0.03635454177856445 nb_pixel_total : 43218 time to create 1 rle with old method : 0.049388885498046875 time for calcul the mask position with numpy : 0.03418993949890137 nb_pixel_total : 49580 time to create 1 rle with old method : 0.05813264846801758 time for calcul the mask position with numpy : 0.0323636531829834 nb_pixel_total : 13905 time to create 1 rle with old method : 0.018504619598388672 time for calcul the mask position with numpy : 0.028430461883544922 nb_pixel_total : 18581 time to create 1 rle with old method : 0.023495197296142578 time for calcul the mask position with numpy : 0.034975290298461914 nb_pixel_total : 55273 time to create 1 rle with old method : 0.06853246688842773 time for calcul the mask position with numpy : 0.0336911678314209 nb_pixel_total : 20708 time to create 1 rle with old method : 0.02323317527770996 time for calcul the mask position with numpy : 0.03889870643615723 nb_pixel_total : 306344 time to create 1 rle with new method : 2.871859312057495 time for calcul the mask position with numpy : 0.03688240051269531 nb_pixel_total : 7569 time to create 1 rle with old method : 0.009686470031738281 time for calcul the mask position with numpy : 0.04983878135681152 nb_pixel_total : 149958 time to create 1 rle with old method : 0.17240118980407715 time for calcul the mask position with numpy : 0.04289960861206055 nb_pixel_total : 138916 time to create 1 rle with old method : 0.15770268440246582 time for calcul the mask position with numpy : 0.03358054161071777 nb_pixel_total : 30604 time to create 1 rle with old method : 0.03492927551269531 time for calcul the mask position with numpy : 0.032506465911865234 nb_pixel_total : 87512 time to create 1 rle with old method : 0.11546683311462402 time for calcul the mask position with numpy : 0.029354572296142578 nb_pixel_total : 72580 time to create 1 rle with old method : 0.08709836006164551 time for calcul the mask position with numpy : 0.028466224670410156 nb_pixel_total : 48724 time to create 1 rle with old method : 0.05517578125 time for calcul the mask position with numpy : 0.0322415828704834 nb_pixel_total : 31173 time to create 1 rle with old method : 0.0352475643157959 time for calcul the mask position with numpy : 0.03691554069519043 nb_pixel_total : 76876 time to create 1 rle with old method : 0.08754444122314453 time for calcul the mask position with numpy : 0.0376739501953125 nb_pixel_total : 57646 time to create 1 rle with old method : 0.06498336791992188 create new chi : 8.70351767539978 time to delete rle : 0.0030815601348876953 batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 18645 TO DO : save crop sub photo not yet done ! save time : 3.9261646270751953 map_output_result : {1370467540: (0.0, 'Should be the crop_list due to order', 0), 1370467539: (0.0, 'Should be the crop_list due to order', 0), 1370467537: (0.0, 'Should be the crop_list due to order', 0), 1370467536: (0.0, 'Should be the crop_list due to order', 0), 1370467535: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1370467540, 1370467539, 1370467537, 1370467536, 1370467535] Looping around the photos to save general results len do output : 5 /1370467540.Didn't retrieve data . /1370467539.Didn't retrieve data . /1370467537.Didn't retrieve data . /1370467536.Didn't retrieve data . /1370467535.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467540', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467539', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467537', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467536', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467535', None, None, None, None, None, '3234695') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.019342899322509766 save_final save missing photos in datou_result : time spend for datou_step_exec : 81.45477533340454 time spend to save output : 0.2892494201660156 total time spend for step 3 : 81.74402475357056 step4:ventilate_hashtags_in_portfolio Fri Jul 4 08:54:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 24581421 get user id for portfolio 24581421 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24581421 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pehd','mal_croppe','background','flou','carton','metal','papier','pet_fonce','pet_clair','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24581421 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pehd','mal_croppe','background','flou','carton','metal','papier','pet_fonce','pet_clair','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24581421 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pehd','mal_croppe','background','flou','carton','metal','papier','pet_fonce','pet_clair','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/24581959,24581960,24581961,24581962,24581963,24581964,24581965,24581967,24581968,24581969,24581970?tags=autre,pehd,mal_croppe,background,flou,carton,metal,papier,pet_fonce,pet_clair,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1370467540, 1370467539, 1370467537, 1370467536, 1370467535] Looping around the photos to save general results len do output : 1 /24581421. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467540', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467539', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467537', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467536', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467535', None, None, None, None, None, '3234695') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.023308515548706055 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.8200068473815918 time spend to save output : 0.023552656173706055 total time spend for step 4 : 1.8435595035552979 step5:final Fri Jul 4 08:54:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1370467540: ('0.16029692322530867',), 1370467539: ('0.16029692322530867',), 1370467537: ('0.16029692322530867',), 1370467536: ('0.16029692322530867',), 1370467535: ('0.16029692322530867',)} new output for save of step final : {1370467540: ('0.16029692322530867',), 1370467539: ('0.16029692322530867',), 1370467537: ('0.16029692322530867',), 1370467536: ('0.16029692322530867',), 1370467535: ('0.16029692322530867',)} [1370467540, 1370467539, 1370467537, 1370467536, 1370467535] Looping around the photos to save general results len do output : 5 /1370467540.Didn't retrieve data . /1370467539.Didn't retrieve data . /1370467537.Didn't retrieve data . /1370467536.Didn't retrieve data . /1370467535.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467540', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467539', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467537', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467536', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467535', None, None, None, None, None, '3234695') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.019287109375 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.15338349342346191 time spend to save output : 0.020072460174560547 total time spend for step 5 : 0.17345595359802246 step6:blur_detection Fri Jul 4 08:54:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255.jpg resize: (2160, 3840) 1370467540 -7.5333350007507365 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757.jpg resize: (2160, 3840) 1370467539 -7.592730778897116 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423.jpg resize: (2160, 3840) 1370467537 -7.696778235462466 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520.jpg resize: (2160, 3840) 1370467536 -7.696660759508716 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380.jpg resize: (2160, 3840) 1370467535 -7.472684458365527 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512166_0.png resize: (395, 314) 1370501980 -3.540865796317532 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512181_0.png resize: (615, 308) 1370501981 -4.361913148495509 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512183_0.png resize: (356, 246) 1370501982 -3.8170137254960546 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512177_0.png resize: (314, 296) 1370501983 -3.713205427734179 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512171_0.png resize: (167, 172) 1370501984 -5.361060831875353 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512172_0.png resize: (88, 161) 1370501985 -4.02142894635782 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512182_0.png resize: (227, 314) 1370501986 -4.774409355847924 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512174_0.png resize: (508, 418) 1370501987 -4.122602365689903 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512169_0.png resize: (258, 300) 1370501988 -2.7444946442215894 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512178_0.png resize: (234, 208) 1370501989 -4.370969844150484 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512176_0.png resize: (399, 486) 1370501990 -5.191982232709882 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512173_0.png resize: (572, 442) 1370501991 -3.569737347802354 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512170_0.png resize: (183, 173) 1370501992 -3.256696505020121 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512167_0.png resize: (348, 362) 1370501993 -4.4870801797552895 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512184_0.png resize: (116, 196) 1370501994 -3.8835462859157936 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512175_0.png resize: (148, 352) 1370501995 -4.8880269580447635 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512168_0.png resize: (271, 145) 1370501996 -4.872745364989837 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512180_0.png resize: (355, 545) 1370501997 -4.111532768479059 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512165_0.png resize: (97, 208) 1370501998 -2.560525554059341 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512187_0.png resize: (306, 138) 1370501999 -3.554533006040357 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512202_0.png resize: (378, 534) 1370502000 -1.838857118649432 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512198_0.png resize: (216, 259) 1370502001 -0.9209411512058628 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512188_0.png resize: (223, 207) 1370502002 -3.3871153547404784 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512195_0.png resize: (387, 262) 1370502003 -3.413503414509011 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512204_0.png resize: (150, 339) 1370502004 -4.678982148627907 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512193_0.png resize: (311, 220) 1370502005 -3.9682233318038804 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512208_0.png resize: (300, 173) 1370502006 -3.8118424339112518 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512196_0.png resize: (261, 527) 1370502007 -4.923956591039708 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512190_0.png resize: (242, 157) 1370502008 -3.0463060704651017 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512191_0.png resize: (304, 380) 1370502009 -4.160171155489258 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512203_0.png resize: (275, 308) 1370502010 -3.995364778540237 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512192_0.png resize: (261, 390) 1370502011 -4.076193672317484 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512206_0.png resize: (318, 378) 1370502012 -2.3452782063126905 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512201_0.png resize: (560, 349) 1370502013 -4.700581942886419 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512189_0.png resize: (360, 140) 1370502014 -4.866950246028042 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512186_0.png resize: (239, 364) 1370502016 -1.4824050784885425 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512194_0.png resize: (142, 237) 1370502017 -3.8030541001930995 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512185_0.png resize: (349, 278) 1370502018 -4.104701346083534 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512199_0.png resize: (385, 210) 1370502019 -5.1115800383666885 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512223_0.png resize: (169, 124) 1370502020 -3.5257135427309225 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512233_0.png resize: (314, 165) 1370502021 -3.7146218697212183 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512212_0.png resize: (91, 239) 1370502022 -3.0526322711506917 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512216_0.png resize: (275, 177) 1370502023 -4.601742561253809 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512225_0.png resize: (288, 450) 1370502025 -2.51084228416058 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512237_0.png resize: (191, 396) 1370502026 -2.216803219888717 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512211_0.png resize: (320, 272) 1370502027 -4.033056535157417 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512222_0.png resize: (394, 233) 1370502029 -4.669135702093739 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512234_0.png resize: (208, 186) 1370502030 -0.8773180106452066 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512210_0.png resize: (204, 177) 1370502031 -2.0275364540731693 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512224_0.png resize: (609, 349) 1370502032 -4.854552477386069 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512214_0.png resize: (215, 218) 1370502033 -4.128120572512955 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512217_0.png resize: (188, 178) 1370502034 -4.0396933839536615 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512226_0.png resize: (341, 287) 1370502035 -1.7190564535637267 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512218_0.png resize: (573, 391) 1370502036 -2.589885022076891 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512209_0.png resize: (330, 592) 1370502037 -3.9007771738108095 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512236_0.png resize: (261, 312) 1370502038 -3.650874327845844 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512220_0.png resize: (237, 147) 1370502039 -4.46442868329254 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512231_0.png resize: (251, 119) 1370502040 -3.909376954373378 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512221_0.png resize: (248, 324) 1370502041 -4.978780745425452 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512219_0.png resize: (437, 277) 1370502042 -5.199159834703815 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512215_0.png resize: (336, 536) 1370502043 -3.7392923834080096 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512249_0.png resize: (166, 122) 1370502044 -3.959838318836941 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512250_0.png resize: (248, 326) 1370502045 -4.23940620102039 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512254_0.png resize: (163, 203) 1370502046 -3.0103562365125933 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512253_0.png resize: (177, 159) 1370502047 -4.452709077307515 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512257_0.png resize: (282, 286) 1370502048 -3.982006650028635 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512244_0.png resize: (84, 335) 1370502049 -3.7361972665619545 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512246_0.png resize: (305, 181) 1370502050 -4.84588353319752 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512248_0.png resize: (292, 476) 1370502051 -2.221242147018432 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512239_0.png resize: (313, 289) 1370502052 -4.882351004058099 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512240_0.png resize: (123, 185) 1370502053 -3.43192652526662 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512252_0.png resize: (205, 188) 1370502054 -4.294112506430158 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512242_0.png resize: (121, 124) 1370502055 -4.003117619416642 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512247_0.png resize: (263, 349) 1370502056 -3.0877455962105103 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512245_0.png resize: (264, 189) 1370502057 -4.191331694284652 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512238_0.png resize: (336, 403) 1370502058 -4.130939291717268 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512258_0.png resize: (349, 386) 1370502059 -4.461655751195763 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512241_0.png resize: (515, 303) 1370502060 -5.325864818397382 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512243_0.png resize: (620, 585) 1370502061 -4.631710449485638 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512255_0.png resize: (171, 514) 1370502062 -4.360182751415787 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512256_0.png resize: (122, 206) 1370502063 -3.7189153037890534 treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512251_0.png resize: (203, 302) 1370502064 -4.8395637434262175 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512266_0.png resize: (749, 232) 1370502066 -4.979630563796951 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512268_0.png resize: (268, 132) 1370502067 -0.369956220480064 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512263_0.png resize: (275, 399) 1370502068 0.7312268683807709 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512277_0.png resize: (694, 679) 1370502069 -5.002845334267367 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512272_0.png resize: (120, 225) 1370502070 -1.232201972643236 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512276_0.png resize: (407, 735) 1370502071 -4.656265421014933 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512269_0.png resize: (758, 667) 1370502072 -5.8406689854405895 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512260_0.png resize: (274, 540) 1370502074 -1.986400656854719 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512262_0.png resize: (279, 276) 1370502075 -4.2250604687352675 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512270_0.png resize: (174, 177) 1370502077 -3.530310348965631 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512261_0.png resize: (258, 175) 1370502080 0.24636514091181133 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512273_0.png resize: (188, 104) 1370502081 2.951137267410533 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512271_0.png resize: (325, 397) 1370502082 -3.3192691573097193 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512275_0.png resize: (246, 252) 1370502083 -1.1287882052987337 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512259_0.png resize: (367, 331) 1370502084 0.5939061615849159 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512267_0.png resize: (490, 490) 1370502085 -3.754375944473902 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512264_0.png resize: (434, 362) 1370502086 -5.282982023825727 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512265_0.png resize: (296, 161) 1370502087 -4.897576604495001 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512179_0.png resize: (324, 145) 1370502093 -4.963293450778083 treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512164_0.png resize: (205, 184) 1370502095 -2.7154392149179385 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512197_0.png resize: (174, 230) 1370502096 -3.3695151677025614 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512230_0.png resize: (169, 218) 1370502098 -3.894376330073985 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512235_0.png resize: (314, 266) 1370502099 -3.664576396136475 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512232_0.png resize: (156, 261) 1370502100 -4.580668081638389 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512274_0.png resize: (208, 333) 1370502101 -3.923358491553461 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512279_0.png resize: (186, 335) 1370502102 -3.702570287587697 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512278_0.png resize: (270, 167) 1370502103 -4.960777331381049 treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512280_0.png resize: (223, 188) 1370502107 -4.744481713913312 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512200_0.png resize: (138, 198) 1370502125 -4.430683518922759 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512205_0.png resize: (118, 257) 1370502126 -4.11997895326001 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512227_0.png resize: (116, 416) 1370502128 -2.83033154399108 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512229_0.png resize: (210, 478) 1370502129 -4.603275268121501 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512213_0.png resize: (375, 474) 1370502130 -5.720095865141127 treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512207_0.png resize: (330, 244) 1370502151 -4.515606138641572 treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512228_0.png resize: (312, 275) 1370502152 -5.66549184381898 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 122 time used for this insertion : 0.026006698608398438 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 122 time used for this insertion : 0.15928959846496582 save missing photos in datou_result : time spend for datou_step_exec : 24.833415269851685 time spend to save output : 0.1914384365081787 total time spend for step 6 : 25.024853706359863 step7:brightness Fri Jul 4 08:54:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255.jpg treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757.jpg treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423.jpg treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520.jpg treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380.jpg treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512166_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512181_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512183_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512177_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512171_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512172_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512182_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512174_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512169_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512178_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512176_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512173_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512170_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512167_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512184_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512175_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512168_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512180_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512165_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512187_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512202_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512198_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512188_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512195_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512204_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512193_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512208_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512196_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512190_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512191_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512203_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512192_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512206_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512201_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512189_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512186_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512194_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512185_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512199_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512223_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512233_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512212_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512216_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512225_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512237_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512211_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512222_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512234_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512210_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512224_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512214_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512217_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512226_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512218_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512209_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512236_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512220_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512231_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512221_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512219_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512215_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512249_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512250_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512254_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512253_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512257_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512244_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512246_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512248_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512239_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512240_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512252_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512242_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512247_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512245_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512238_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512258_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512241_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512243_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512255_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512256_0.png treat image : temp/1751611829_676568_1370467536_1bdbe70dc57507f26ed134516eba4779_53458520_rle_crop_3871512251_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512266_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512268_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512263_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512277_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512272_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512276_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512269_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512260_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512262_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512270_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512261_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512273_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512271_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512275_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512259_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512267_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512264_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512265_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512179_0.png treat image : temp/1751611829_676568_1370467540_59f6b24e36b8b5e0b89524afc5633e2d_21264255_rle_crop_3871512164_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512197_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512230_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512235_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512232_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512274_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512279_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512278_0.png treat image : temp/1751611829_676568_1370467535_e17e55aa1bf1e60fe0ef276debc70470_95057380_rle_crop_3871512280_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512200_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512205_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512227_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512229_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512213_0.png treat image : temp/1751611829_676568_1370467539_8a0063faa7bdc677b6a20b4e0e18ee35_28954757_rle_crop_3871512207_0.png treat image : temp/1751611829_676568_1370467537_2256d648db8fc5ecf0e1e0a93e6973a4_25020423_rle_crop_3871512228_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 122 time used for this insertion : 0.018862247467041016 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 122 time used for this insertion : 0.034070730209350586 save missing photos in datou_result : time spend for datou_step_exec : 6.397779941558838 time spend to save output : 0.05818581581115723 total time spend for step 7 : 6.455965757369995 step8:velours_tree Fri Jul 4 08:54:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.49158787727355957 time spend to save output : 4.601478576660156e-05 total time spend for step 8 : 0.49163389205932617 step9:send_mail_cod Fri Jul 4 08:54:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P24581421_04-07-2025_08_54_59.pdf 24581959 imagette245819591751612099 24581960 imagette245819601751612099 24581961 imagette245819611751612099 24581962 imagette245819621751612099 24581963 imagette245819631751612099 24581964 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette245819641751612099 24581965 change filename to text .imagette245819651751612100 24581967 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette245819671751612100 24581968 change filename to text .change filename to text .imagette245819681751612101 24581969 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette245819691751612101 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=24581421 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/24581959,24581960,24581961,24581962,24581963,24581964,24581965,24581967,24581968,24581969,24581970?tags=autre,pehd,mal_croppe,background,flou,carton,metal,papier,pet_fonce,pet_clair,environnement args[1370467540] : ((1370467540, -7.5333350007507365, 492609224), (1370467540, 0.5692585653289314, 2107752395), '0.16029692322530867') We are sending mail with results at report@fotonower.com args[1370467539] : ((1370467539, -7.592730778897116, 492609224), (1370467539, 1.024754277705492, 2107752395), '0.16029692322530867') We are sending mail with results at report@fotonower.com args[1370467537] : ((1370467537, -7.696778235462466, 492609224), (1370467537, 0.8910601957004239, 2107752395), '0.16029692322530867') We are sending mail with results at report@fotonower.com args[1370467536] : ((1370467536, -7.696660759508716, 492609224), (1370467536, 0.8703137887982626, 2107752395), '0.16029692322530867') We are sending mail with results at report@fotonower.com args[1370467535] : ((1370467535, -7.472684458365527, 492609224), (1370467535, 1.0315494372176714, 2107752395), '0.16029692322530867') We are sending mail with results at report@fotonower.com refus_total : 0.16029692322530867 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=24581421 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24581421_04-07-2025_08_54_59.pdf results_Auto_P24581421_04-07-2025_08_54_59.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24581421_04-07-2025_08_54_59.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','24581421','results_Auto_P24581421_04-07-2025_08_54_59.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24581421_04-07-2025_08_54_59.pdf','pdf','','0.41','0.16029692322530867') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/24581421

https://www.fotonower.com/image?json=false&list_photos_id=1370467540
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1370467539
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1370467537
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1370467536
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1370467535
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 16.03%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/24581964?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/24581965?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/24581967?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/24581968?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/24581969?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24581421_04-07-2025_08_54_59.pdf.

Lien vers velours :https://www.fotonower.com/velours/24581959,24581960,24581961,24581962,24581963,24581964,24581965,24581967,24581968,24581969,24581970?tags=autre,pehd,mal_croppe,background,flou,carton,metal,papier,pet_fonce,pet_clair,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 04 Jul 2025 06:55:05 GMT Content-Length: 0 Connection: close X-Message-Id: FL8Pya0eRmSurEr4PdAQsA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1370467540, 1370467539, 1370467537, 1370467536, 1370467535] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467540', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467539', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467537', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467536', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467535', None, None, None, None, None, '3234695') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.022931814193725586 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.745991945266724 time spend to save output : 0.023205995559692383 total time spend for step 9 : 5.769197940826416 step10:split_time_score Fri Jul 4 08:55:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 5),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 03072025 24581421 Nombre de photos uploadées : 5 / 23040 (0%) 03072025 24581421 Nombre de photos taguées (types de déchets): 0 / 5 (0%) 03072025 24581421 Nombre de photos taguées (volume) : 0 / 5 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 1.0728836059570312e-05 ????? elapsed_time : fill_and_build_computed_from_old_data 0.0003428459167480469 elapsed_time : insert_dashboard_record_day_entry 0.023415565490722656 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24581025 order by id desc limit 1 Qualite : 0.029696513136184908 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24569263_03-07-2025_11_43_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24569263 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24569263 AND mptpi.`type`=3726 To do Qualite : 0.03129936084068947 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24569302_03-07-2025_11_44_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24569302 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24569302 AND mptpi.`type`=3726 To do Qualite : 0.04215979239896914 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24571191_03-07-2025_12_26_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24571191 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24571191 AND mptpi.`type`=3726 To do Qualite : 0.015375019127491259 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24581039_04-07-2025_08_54_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24581039 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24581039 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24581228 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24581312 order by id desc limit 1 Qualite : 0.16029692322530867 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24581421_04-07-2025_08_54_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24581421 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24581421 AND mptpi.`type`=3594 To do Qualite : 0.032759106967075576 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24581424_04-07-2025_08_51_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24581424 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24581424 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'03072025': {'nb_upload': 5, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1370467540, 1370467539, 1370467537, 1370467536, 1370467535] Looping around the photos to save general results len do output : 1 /24581421Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467540', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467539', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467537', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467536', None, None, None, None, None, '3234695') ('3318', None, None, None, None, None, None, None, '3234695') ('3318', '24581421', '1370467535', None, None, None, None, None, '3234695') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012659311294555664 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.5424516201019287 time spend to save output : 0.012841939926147461 total time spend for step 10 : 3.555293560028076 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 5 set_done_treatment 114.50user 95.25system 4:44.08elapsed 73%CPU (0avgtext+0avgdata 4601096maxresident)k 854224inputs+105704outputs (11575major+10027958minor)pagefaults 0swaps