python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 409132 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3273062'] with mtr_portfolio_ids : ['24854816'] and first list_photo_ids : [] new path : /proc/409132/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.864109992980957 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Jul 11 21:50:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5665 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-07-11 21:50:30.876544: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-07-11 21:50:30.903412: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-07-11 21:50:30.905649: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fdd0c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-07-11 21:50:30.905714: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-07-11 21:50:30.909777: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-07-11 21:50:31.060101: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x404d8210 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-07-11 21:50:31.060148: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-07-11 21:50:31.061340: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-11 21:50:31.061765: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-11 21:50:31.065193: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-11 21:50:31.068342: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-11 21:50:31.068815: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-11 21:50:31.071812: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-11 21:50:31.073283: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-11 21:50:31.078612: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-11 21:50:31.079792: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-11 21:50:31.079871: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-11 21:50:31.080480: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-11 21:50:31.080495: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-11 21:50:31.080504: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-11 21:50:31.081515: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5183 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-07-11 21:50:31.398099: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-11 21:50:31.398233: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-11 21:50:31.398263: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-11 21:50:31.398289: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-11 21:50:31.398314: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-11 21:50:31.398339: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-11 21:50:31.398364: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-11 21:50:31.398388: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-11 21:50:31.400163: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-11 21:50:31.401473: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-11 21:50:31.401560: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-11 21:50:31.401576: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-11 21:50:31.401591: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-11 21:50:31.401605: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-11 21:50:31.401619: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-11 21:50:31.401633: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-11 21:50:31.401648: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-11 21:50:31.402653: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-11 21:50:31.402693: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-11 21:50:31.402703: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-11 21:50:31.402712: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-11 21:50:31.403809: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5183 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-07-11 21:50:42.094319: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-11 21:50:42.275408: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-11 21:50:43.627567: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.628129: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.628654: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.629143: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.629641: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.630130: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.630645: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.630669: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 21:50:43.631216: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.631233: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 21:50:43.638229: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.638250: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 21:50:43.638786: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.638802: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 21:50:43.645301: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.645332: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 21:50:43.645871: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.645887: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 21:50:43.676559: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.676588: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 21:50:43.677126: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.677142: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 21:50:43.682873: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.682892: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 21:50:43.683412: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.683429: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 21:50:43.717087: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.717636: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.719455: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.719999: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.760516: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.761064: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.762939: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.763476: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.788451: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.788995: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.790473: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.791013: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.796241: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.796755: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.798351: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.798855: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.804530: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.805064: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.806502: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.807009: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.833348: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.833898: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.834409: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.834909: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.838372: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.838917: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.854153: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.854702: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.855246: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.855791: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.868078: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.868594: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.869096: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.869597: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.873812: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.874335: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.878952: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.879491: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.891719: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.892255: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.896415: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.896958: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.897497: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.898036: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.898672: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.899233: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.910142: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.910686: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.911240: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.911742: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.912242: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.912741: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.913240: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.913740: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.923147: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.923666: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.929836: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:43.930372: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.003337: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.003938: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.011800: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.012329: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.029228: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.029769: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.030288: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.030795: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.034855: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.035373: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.035883: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.036389: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.037408: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.037424: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-07-11 21:50:44.047599: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.048140: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.057103: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.057608: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.058129: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.058627: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.059134: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 21:50:44.059710: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 45 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 Detection mask done ! Trying to reset tf kernel 409616 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 695 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1279 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.004152536392211914 nb_pixel_total : 148153 time to create 1 rle with old method : 0.2086951732635498 length of segment : 446 time for calcul the mask position with numpy : 0.0013167858123779297 nb_pixel_total : 83571 time to create 1 rle with old method : 0.09593653678894043 length of segment : 335 time for calcul the mask position with numpy : 0.0005230903625488281 nb_pixel_total : 34447 time to create 1 rle with old method : 0.03943133354187012 length of segment : 162 time for calcul the mask position with numpy : 0.0003962516784667969 nb_pixel_total : 19698 time to create 1 rle with old method : 0.023183345794677734 length of segment : 144 time for calcul the mask position with numpy : 0.0019621849060058594 nb_pixel_total : 130424 time to create 1 rle with old method : 0.14653420448303223 length of segment : 310 time for calcul the mask position with numpy : 0.003964424133300781 nb_pixel_total : 189264 time to create 1 rle with new method : 0.008440732955932617 length of segment : 514 time for calcul the mask position with numpy : 0.0030965805053710938 nb_pixel_total : 179051 time to create 1 rle with new method : 0.01226806640625 length of segment : 786 time for calcul the mask position with numpy : 0.002883434295654297 nb_pixel_total : 152944 time to create 1 rle with new method : 0.011394262313842773 length of segment : 475 time for calcul the mask position with numpy : 0.0036110877990722656 nb_pixel_total : 180761 time to create 1 rle with new method : 0.016073226928710938 length of segment : 334 time for calcul the mask position with numpy : 0.0016417503356933594 nb_pixel_total : 97420 time to create 1 rle with old method : 0.11474800109863281 length of segment : 430 time for calcul the mask position with numpy : 0.0019800662994384766 nb_pixel_total : 91376 time to create 1 rle with old method : 0.10803365707397461 length of segment : 349 time for calcul the mask position with numpy : 0.0005860328674316406 nb_pixel_total : 20443 time to create 1 rle with old method : 0.02475571632385254 length of segment : 178 time for calcul the mask position with numpy : 0.0019054412841796875 nb_pixel_total : 108006 time to create 1 rle with old method : 0.13051056861877441 length of segment : 551 time for calcul the mask position with numpy : 0.001188039779663086 nb_pixel_total : 57661 time to create 1 rle with old method : 0.0693514347076416 length of segment : 353 time for calcul the mask position with numpy : 0.001310110092163086 nb_pixel_total : 47143 time to create 1 rle with old method : 0.09004688262939453 length of segment : 267 time for calcul the mask position with numpy : 0.00042557716369628906 nb_pixel_total : 18997 time to create 1 rle with old method : 0.023277759552001953 length of segment : 163 time for calcul the mask position with numpy : 0.0007734298706054688 nb_pixel_total : 35673 time to create 1 rle with old method : 0.0444488525390625 length of segment : 232 time for calcul the mask position with numpy : 0.0024385452270507812 nb_pixel_total : 135541 time to create 1 rle with old method : 0.1817340850830078 length of segment : 289 time for calcul the mask position with numpy : 0.0021605491638183594 nb_pixel_total : 75079 time to create 1 rle with old method : 0.08554911613464355 length of segment : 592 time for calcul the mask position with numpy : 0.00022745132446289062 nb_pixel_total : 7919 time to create 1 rle with old method : 0.009046554565429688 length of segment : 100 time for calcul the mask position with numpy : 0.0016405582427978516 nb_pixel_total : 81164 time to create 1 rle with old method : 0.09215116500854492 length of segment : 519 time for calcul the mask position with numpy : 0.0011031627655029297 nb_pixel_total : 54329 time to create 1 rle with old method : 0.06457018852233887 length of segment : 153 time for calcul the mask position with numpy : 0.00205230712890625 nb_pixel_total : 86838 time to create 1 rle with old method : 0.10575699806213379 length of segment : 247 time for calcul the mask position with numpy : 0.0012755393981933594 nb_pixel_total : 25495 time to create 1 rle with old method : 0.03076910972595215 length of segment : 181 time for calcul the mask position with numpy : 0.0004055500030517578 nb_pixel_total : 21051 time to create 1 rle with old method : 0.0276639461517334 length of segment : 185 time for calcul the mask position with numpy : 0.0007717609405517578 nb_pixel_total : 23702 time to create 1 rle with old method : 0.03927493095397949 length of segment : 152 time for calcul the mask position with numpy : 0.003749370574951172 nb_pixel_total : 46482 time to create 1 rle with old method : 0.0750131607055664 length of segment : 362 time for calcul the mask position with numpy : 0.003972768783569336 nb_pixel_total : 104304 time to create 1 rle with old method : 0.12623095512390137 length of segment : 334 time for calcul the mask position with numpy : 0.002841949462890625 nb_pixel_total : 54176 time to create 1 rle with old method : 0.06617379188537598 length of segment : 463 time for calcul the mask position with numpy : 0.008541107177734375 nb_pixel_total : 130922 time to create 1 rle with old method : 0.15201425552368164 length of segment : 508 time for calcul the mask position with numpy : 0.0012309551239013672 nb_pixel_total : 23267 time to create 1 rle with old method : 0.027175426483154297 length of segment : 209 time for calcul the mask position with numpy : 0.0041959285736083984 nb_pixel_total : 126096 time to create 1 rle with old method : 0.1437375545501709 length of segment : 509 time for calcul the mask position with numpy : 0.0017397403717041016 nb_pixel_total : 41055 time to create 1 rle with old method : 0.047757863998413086 length of segment : 172 time for calcul the mask position with numpy : 0.0014870166778564453 nb_pixel_total : 31004 time to create 1 rle with old method : 0.035010576248168945 length of segment : 261 time for calcul the mask position with numpy : 0.001500844955444336 nb_pixel_total : 45940 time to create 1 rle with old method : 0.05249738693237305 length of segment : 242 time for calcul the mask position with numpy : 0.0008080005645751953 nb_pixel_total : 17380 time to create 1 rle with old method : 0.020254850387573242 length of segment : 154 time for calcul the mask position with numpy : 0.0009398460388183594 nb_pixel_total : 27167 time to create 1 rle with old method : 0.032151222229003906 length of segment : 188 time for calcul the mask position with numpy : 0.0013637542724609375 nb_pixel_total : 44569 time to create 1 rle with old method : 0.05203723907470703 length of segment : 270 time for calcul the mask position with numpy : 0.006299495697021484 nb_pixel_total : 223333 time to create 1 rle with new method : 0.010161161422729492 length of segment : 463 time for calcul the mask position with numpy : 0.000701904296875 nb_pixel_total : 16616 time to create 1 rle with old method : 0.019522905349731445 length of segment : 225 time for calcul the mask position with numpy : 0.0008108615875244141 nb_pixel_total : 18678 time to create 1 rle with old method : 0.02212047576904297 length of segment : 177 time for calcul the mask position with numpy : 0.0007424354553222656 nb_pixel_total : 17124 time to create 1 rle with old method : 0.02232217788696289 length of segment : 172 time for calcul the mask position with numpy : 0.0017535686492919922 nb_pixel_total : 55797 time to create 1 rle with old method : 0.06417346000671387 length of segment : 410 time for calcul the mask position with numpy : 0.0034813880920410156 nb_pixel_total : 71559 time to create 1 rle with old method : 0.08418607711791992 length of segment : 446 time for calcul the mask position with numpy : 0.0037250518798828125 nb_pixel_total : 92504 time to create 1 rle with old method : 0.10840678215026855 length of segment : 502 time for calcul the mask position with numpy : 0.0007190704345703125 nb_pixel_total : 12864 time to create 1 rle with old method : 0.015942096710205078 length of segment : 218 time for calcul the mask position with numpy : 0.004622459411621094 nb_pixel_total : 112884 time to create 1 rle with old method : 0.13409090042114258 length of segment : 349 time for calcul the mask position with numpy : 0.00379180908203125 nb_pixel_total : 112292 time to create 1 rle with old method : 0.12647676467895508 length of segment : 413 time for calcul the mask position with numpy : 0.0045299530029296875 nb_pixel_total : 124368 time to create 1 rle with old method : 0.13649535179138184 length of segment : 562 time for calcul the mask position with numpy : 0.0014994144439697266 nb_pixel_total : 36936 time to create 1 rle with old method : 0.043630123138427734 length of segment : 389 time for calcul the mask position with numpy : 0.001664876937866211 nb_pixel_total : 48451 time to create 1 rle with old method : 0.05542755126953125 length of segment : 396 time for calcul the mask position with numpy : 0.0012373924255371094 nb_pixel_total : 52892 time to create 1 rle with old method : 0.05932974815368652 length of segment : 336 time for calcul the mask position with numpy : 0.0005738735198974609 nb_pixel_total : 19782 time to create 1 rle with old method : 0.022952556610107422 length of segment : 154 time for calcul the mask position with numpy : 0.0033097267150878906 nb_pixel_total : 129241 time to create 1 rle with old method : 0.15353083610534668 length of segment : 379 time for calcul the mask position with numpy : 0.0019774436950683594 nb_pixel_total : 64151 time to create 1 rle with old method : 0.07319974899291992 length of segment : 245 time for calcul the mask position with numpy : 0.0031311511993408203 nb_pixel_total : 159143 time to create 1 rle with new method : 0.00721287727355957 length of segment : 315 time for calcul the mask position with numpy : 0.04145097732543945 nb_pixel_total : 702015 time to create 1 rle with new method : 0.044255971908569336 length of segment : 746 time for calcul the mask position with numpy : 0.013794660568237305 nb_pixel_total : 263519 time to create 1 rle with new method : 0.06586456298828125 length of segment : 543 time for calcul the mask position with numpy : 0.004535675048828125 nb_pixel_total : 225108 time to create 1 rle with new method : 0.006978511810302734 length of segment : 689 time for calcul the mask position with numpy : 0.0038895606994628906 nb_pixel_total : 91879 time to create 1 rle with old method : 0.10248255729675293 length of segment : 353 time for calcul the mask position with numpy : 0.00015997886657714844 nb_pixel_total : 6712 time to create 1 rle with old method : 0.007884979248046875 length of segment : 93 time for calcul the mask position with numpy : 0.00036978721618652344 nb_pixel_total : 19845 time to create 1 rle with old method : 0.02273249626159668 length of segment : 178 time for calcul the mask position with numpy : 0.0003666877746582031 nb_pixel_total : 20037 time to create 1 rle with old method : 0.022648096084594727 length of segment : 155 time for calcul the mask position with numpy : 0.002787351608276367 nb_pixel_total : 102010 time to create 1 rle with old method : 0.11270689964294434 length of segment : 418 time for calcul the mask position with numpy : 0.0034945011138916016 nb_pixel_total : 90599 time to create 1 rle with old method : 0.10186529159545898 length of segment : 483 time for calcul the mask position with numpy : 0.0016376972198486328 nb_pixel_total : 52227 time to create 1 rle with old method : 0.05822920799255371 length of segment : 419 time for calcul the mask position with numpy : 0.0011105537414550781 nb_pixel_total : 47340 time to create 1 rle with old method : 0.05326032638549805 length of segment : 192 time for calcul the mask position with numpy : 0.0007607936859130859 nb_pixel_total : 23450 time to create 1 rle with old method : 0.02646636962890625 length of segment : 167 time for calcul the mask position with numpy : 0.001543283462524414 nb_pixel_total : 58610 time to create 1 rle with old method : 0.06508946418762207 length of segment : 419 time for calcul the mask position with numpy : 0.0025742053985595703 nb_pixel_total : 59318 time to create 1 rle with old method : 0.0659630298614502 length of segment : 381 time for calcul the mask position with numpy : 0.0008339881896972656 nb_pixel_total : 49905 time to create 1 rle with old method : 0.05610847473144531 length of segment : 224 time for calcul the mask position with numpy : 0.0009438991546630859 nb_pixel_total : 29879 time to create 1 rle with old method : 0.035347938537597656 length of segment : 233 time for calcul the mask position with numpy : 0.0006237030029296875 nb_pixel_total : 21991 time to create 1 rle with old method : 0.024477720260620117 length of segment : 165 time for calcul the mask position with numpy : 0.001920461654663086 nb_pixel_total : 54937 time to create 1 rle with old method : 0.06121397018432617 length of segment : 285 time for calcul the mask position with numpy : 0.00029397010803222656 nb_pixel_total : 7906 time to create 1 rle with old method : 0.008902788162231445 length of segment : 112 time for calcul the mask position with numpy : 0.001722574234008789 nb_pixel_total : 57528 time to create 1 rle with old method : 0.06493163108825684 length of segment : 293 time for calcul the mask position with numpy : 0.001291513442993164 nb_pixel_total : 52312 time to create 1 rle with old method : 0.05822300910949707 length of segment : 220 time for calcul the mask position with numpy : 0.0006170272827148438 nb_pixel_total : 17601 time to create 1 rle with old method : 0.020174026489257812 length of segment : 168 time for calcul the mask position with numpy : 0.0050661563873291016 nb_pixel_total : 193260 time to create 1 rle with new method : 0.009350776672363281 length of segment : 470 time for calcul the mask position with numpy : 0.0009183883666992188 nb_pixel_total : 27495 time to create 1 rle with old method : 0.030495882034301758 length of segment : 297 time for calcul the mask position with numpy : 0.0004055500030517578 nb_pixel_total : 11238 time to create 1 rle with old method : 0.012567758560180664 length of segment : 138 time for calcul the mask position with numpy : 0.0012612342834472656 nb_pixel_total : 68674 time to create 1 rle with old method : 0.0753786563873291 length of segment : 246 time for calcul the mask position with numpy : 0.0021762847900390625 nb_pixel_total : 76914 time to create 1 rle with old method : 0.08468270301818848 length of segment : 430 time for calcul the mask position with numpy : 0.0005867481231689453 nb_pixel_total : 30320 time to create 1 rle with old method : 0.03457140922546387 length of segment : 161 time for calcul the mask position with numpy : 0.0024483203887939453 nb_pixel_total : 179179 time to create 1 rle with new method : 0.006148338317871094 length of segment : 459 time spent for convertir_results : 10.571373462677002 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 85 chid ids of type : 3594 Number RLEs to save : 27407 save missing photos in datou_result : time spend for datou_step_exec : 55.44688820838928 time spend to save output : 1.6732275485992432 total time spend for step 1 : 57.120115756988525 step2:crop_condition Fri Jul 11 21:51:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 85 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 48 About to insert : list_path_to_insert length 48 new photo from crops ! About to upload 48 photos upload in portfolio : 3736932 init cache_photo without model_param we have 48 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1752263498_409132 we have uploaded 48 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.989487171173096 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1752263514_409132 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.6782755851745605 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1752263517_409132 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.829350471496582 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 3736932 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1752263533_409132 we have uploaded 28 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.927064418792725 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1752263542_409132 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8344769477844238 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1752263544_409132 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.8917076587677002 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1371668728, 1371668616, 1371668595, 1371668591, 1371668556] Looping around the photos to save general results len do output : 85 /1371675046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371675169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668728', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668616', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668595', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668591', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668556', None, None, None, None, None, '3273062') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 260 time used for this insertion : 0.03601336479187012 save_final save missing photos in datou_result : time spend for datou_step_exec : 61.11019563674927 time spend to save output : 0.03928089141845703 total time spend for step 2 : 61.149476528167725 step3:rle_unique_nms_with_priority Fri Jul 11 21:52:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 85 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 16 nb_hashtags : 4 time to prepare the origin masks : 8.69925308227539 time for calcul the mask position with numpy : 0.8099102973937988 nb_pixel_total : 6735060 time to create 1 rle with new method : 1.2829070091247559 time for calcul the mask position with numpy : 0.024866819381713867 nb_pixel_total : 18987 time to create 1 rle with old method : 0.022558927536010742 time for calcul the mask position with numpy : 0.024449825286865234 nb_pixel_total : 47134 time to create 1 rle with old method : 0.05575299263000488 time for calcul the mask position with numpy : 0.02611088752746582 nb_pixel_total : 57661 time to create 1 rle with old method : 0.06814169883728027 time for calcul the mask position with numpy : 0.02583622932434082 nb_pixel_total : 108006 time to create 1 rle with old method : 0.1261765956878662 time for calcul the mask position with numpy : 0.02631402015686035 nb_pixel_total : 20443 time to create 1 rle with old method : 0.023761987686157227 time for calcul the mask position with numpy : 0.02634906768798828 nb_pixel_total : 91376 time to create 1 rle with old method : 0.1069176197052002 time for calcul the mask position with numpy : 0.025636672973632812 nb_pixel_total : 97420 time to create 1 rle with old method : 0.11228728294372559 time for calcul the mask position with numpy : 0.02771615982055664 nb_pixel_total : 180761 time to create 1 rle with new method : 1.0768868923187256 time for calcul the mask position with numpy : 0.027888059616088867 nb_pixel_total : 152944 time to create 1 rle with new method : 1.0438528060913086 time for calcul the mask position with numpy : 0.02764272689819336 nb_pixel_total : 179051 time to create 1 rle with new method : 1.121556043624878 time for calcul the mask position with numpy : 0.026457548141479492 nb_pixel_total : 189264 time to create 1 rle with new method : 1.069850206375122 time for calcul the mask position with numpy : 0.02981281280517578 nb_pixel_total : 130424 time to create 1 rle with old method : 0.1537935733795166 time for calcul the mask position with numpy : 0.026613473892211914 nb_pixel_total : 19698 time to create 1 rle with old method : 0.022750377655029297 time for calcul the mask position with numpy : 0.02762770652770996 nb_pixel_total : 34447 time to create 1 rle with old method : 0.03977036476135254 time for calcul the mask position with numpy : 0.02648639678955078 nb_pixel_total : 83571 time to create 1 rle with old method : 0.11992692947387695 time for calcul the mask position with numpy : 0.026858806610107422 nb_pixel_total : 148153 time to create 1 rle with old method : 0.1946089267730713 create new chi : 8.028738021850586 time to delete rle : 0.019511938095092773 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 13721 TO DO : save crop sub photo not yet done ! save time : 0.8081772327423096 nb_obj : 21 nb_hashtags : 4 time to prepare the origin masks : 10.019877910614014 time for calcul the mask position with numpy : 0.9030842781066895 nb_pixel_total : 7099816 time to create 1 rle with new method : 0.836937427520752 time for calcul the mask position with numpy : 0.040134429931640625 nb_pixel_total : 27167 time to create 1 rle with old method : 0.03127169609069824 time for calcul the mask position with numpy : 0.04025626182556152 nb_pixel_total : 17380 time to create 1 rle with old method : 0.02052760124206543 time for calcul the mask position with numpy : 0.041045188903808594 nb_pixel_total : 45940 time to create 1 rle with old method : 0.05255627632141113 time for calcul the mask position with numpy : 0.040854454040527344 nb_pixel_total : 31004 time to create 1 rle with old method : 0.035733938217163086 time for calcul the mask position with numpy : 0.03328108787536621 nb_pixel_total : 41055 time to create 1 rle with old method : 0.04749417304992676 time for calcul the mask position with numpy : 0.026082515716552734 nb_pixel_total : 126096 time to create 1 rle with old method : 0.15551400184631348 time for calcul the mask position with numpy : 0.02891683578491211 nb_pixel_total : 23267 time to create 1 rle with old method : 0.026853561401367188 time for calcul the mask position with numpy : 0.027217864990234375 nb_pixel_total : 130922 time to create 1 rle with old method : 0.15060043334960938 time for calcul the mask position with numpy : 0.028660058975219727 nb_pixel_total : 54176 time to create 1 rle with old method : 0.06345677375793457 time for calcul the mask position with numpy : 0.025714635848999023 nb_pixel_total : 104304 time to create 1 rle with old method : 0.12336111068725586 time for calcul the mask position with numpy : 0.025217294692993164 nb_pixel_total : 46482 time to create 1 rle with old method : 0.05291628837585449 time for calcul the mask position with numpy : 0.026613950729370117 nb_pixel_total : 23702 time to create 1 rle with old method : 0.02740478515625 time for calcul the mask position with numpy : 0.026880264282226562 nb_pixel_total : 21051 time to create 1 rle with old method : 0.024338722229003906 time for calcul the mask position with numpy : 0.026177406311035156 nb_pixel_total : 25495 time to create 1 rle with old method : 0.029520750045776367 time for calcul the mask position with numpy : 0.025600194931030273 nb_pixel_total : 86838 time to create 1 rle with old method : 0.11645674705505371 time for calcul the mask position with numpy : 0.027889251708984375 nb_pixel_total : 54329 time to create 1 rle with old method : 0.06296801567077637 time for calcul the mask position with numpy : 0.041539907455444336 nb_pixel_total : 81164 time to create 1 rle with old method : 0.09529447555541992 time for calcul the mask position with numpy : 0.040554046630859375 nb_pixel_total : 7919 time to create 1 rle with old method : 0.009375333786010742 time for calcul the mask position with numpy : 0.040936946868896484 nb_pixel_total : 75079 time to create 1 rle with old method : 0.0860438346862793 time for calcul the mask position with numpy : 0.04354357719421387 nb_pixel_total : 135541 time to create 1 rle with old method : 0.1783590316772461 time for calcul the mask position with numpy : 0.034767866134643555 nb_pixel_total : 35673 time to create 1 rle with old method : 0.04199409484863281 create new chi : 3.90834903717041 time to delete rle : 0.0017914772033691406 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 14264 TO DO : save crop sub photo not yet done ! save time : 0.8599684238433838 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 8.358752250671387 time for calcul the mask position with numpy : 0.6449015140533447 nb_pixel_total : 7253533 time to create 1 rle with new method : 1.3255565166473389 time for calcul the mask position with numpy : 0.03301072120666504 nb_pixel_total : 52892 time to create 1 rle with old method : 0.06368064880371094 time for calcul the mask position with numpy : 0.02565479278564453 nb_pixel_total : 48451 time to create 1 rle with old method : 0.05645298957824707 time for calcul the mask position with numpy : 0.02666473388671875 nb_pixel_total : 36936 time to create 1 rle with old method : 0.0517430305480957 time for calcul the mask position with numpy : 0.02772378921508789 nb_pixel_total : 124368 time to create 1 rle with old method : 0.1615762710571289 time for calcul the mask position with numpy : 0.029835224151611328 nb_pixel_total : 112292 time to create 1 rle with old method : 0.1458899974822998 time for calcul the mask position with numpy : 0.026018142700195312 nb_pixel_total : 112884 time to create 1 rle with old method : 0.12421274185180664 time for calcul the mask position with numpy : 0.024451255798339844 nb_pixel_total : 12864 time to create 1 rle with old method : 0.01454472541809082 time for calcul the mask position with numpy : 0.025564908981323242 nb_pixel_total : 92504 time to create 1 rle with old method : 0.10928535461425781 time for calcul the mask position with numpy : 0.026536941528320312 nb_pixel_total : 71559 time to create 1 rle with old method : 0.08138871192932129 time for calcul the mask position with numpy : 0.027586698532104492 nb_pixel_total : 55797 time to create 1 rle with old method : 0.0644843578338623 time for calcul the mask position with numpy : 0.028861284255981445 nb_pixel_total : 17124 time to create 1 rle with old method : 0.01980280876159668 time for calcul the mask position with numpy : 0.026133060455322266 nb_pixel_total : 18678 time to create 1 rle with old method : 0.021373748779296875 time for calcul the mask position with numpy : 0.026379823684692383 nb_pixel_total : 16616 time to create 1 rle with old method : 0.01948261260986328 time for calcul the mask position with numpy : 0.028319358825683594 nb_pixel_total : 223333 time to create 1 rle with new method : 0.6531121730804443 time for calcul the mask position with numpy : 0.04519295692443848 nb_pixel_total : 44569 time to create 1 rle with old method : 0.06346416473388672 create new chi : 4.133686542510986 time to delete rle : 0.0017161369323730469 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 12816 TO DO : save crop sub photo not yet done ! save time : 0.7634317874908447 nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 5.802487134933472 time for calcul the mask position with numpy : 0.5570504665374756 nb_pixel_total : 6629674 time to create 1 rle with new method : 0.9030134677886963 time for calcul the mask position with numpy : 0.03969287872314453 nb_pixel_total : 16192 time to create 1 rle with old method : 0.0182187557220459 time for calcul the mask position with numpy : 0.0375058650970459 nb_pixel_total : 2728 time to create 1 rle with old method : 0.003086090087890625 time for calcul the mask position with numpy : 0.024939775466918945 nb_pixel_total : 5476 time to create 1 rle with old method : 0.006428718566894531 time for calcul the mask position with numpy : 0.025689125061035156 nb_pixel_total : 91879 time to create 1 rle with old method : 0.10286498069763184 time for calcul the mask position with numpy : 0.024528026580810547 nb_pixel_total : 225108 time to create 1 rle with new method : 0.7897210121154785 time for calcul the mask position with numpy : 0.02735447883605957 nb_pixel_total : 249949 time to create 1 rle with new method : 0.7110066413879395 time for calcul the mask position with numpy : 0.03054642677307129 nb_pixel_total : 702015 time to create 1 rle with new method : 1.074446201324463 time for calcul the mask position with numpy : 0.025506258010864258 nb_pixel_total : 158205 time to create 1 rle with new method : 0.7280423641204834 time for calcul the mask position with numpy : 0.025841236114501953 nb_pixel_total : 64151 time to create 1 rle with old method : 0.08154606819152832 time for calcul the mask position with numpy : 0.028326034545898438 nb_pixel_total : 129241 time to create 1 rle with old method : 0.1484358310699463 time for calcul the mask position with numpy : 0.0269925594329834 nb_pixel_total : 19782 time to create 1 rle with old method : 0.030192136764526367 create new chi : 5.621933221817017 time to delete rle : 0.001691579818725586 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 9152 TO DO : save crop sub photo not yet done ! save time : 0.5962190628051758 nb_obj : 22 nb_hashtags : 4 time to prepare the origin masks : 11.947161674499512 time for calcul the mask position with numpy : 0.6725752353668213 nb_pixel_total : 7213543 time to create 1 rle with new method : 0.9160590171813965 time for calcul the mask position with numpy : 0.025263547897338867 nb_pixel_total : 1820 time to create 1 rle with old method : 0.002697467803955078 time for calcul the mask position with numpy : 0.026132822036743164 nb_pixel_total : 23795 time to create 1 rle with old method : 0.02805185317993164 time for calcul the mask position with numpy : 0.02891230583190918 nb_pixel_total : 76914 time to create 1 rle with old method : 0.09038543701171875 time for calcul the mask position with numpy : 0.027224302291870117 nb_pixel_total : 68674 time to create 1 rle with old method : 0.08030152320861816 time for calcul the mask position with numpy : 0.025025606155395508 nb_pixel_total : 11238 time to create 1 rle with old method : 0.013348817825317383 time for calcul the mask position with numpy : 0.027393102645874023 nb_pixel_total : 27495 time to create 1 rle with old method : 0.03219413757324219 time for calcul the mask position with numpy : 0.025811195373535156 nb_pixel_total : 193260 time to create 1 rle with new method : 0.9578549861907959 time for calcul the mask position with numpy : 0.029267311096191406 nb_pixel_total : 17601 time to create 1 rle with old method : 0.02080368995666504 time for calcul the mask position with numpy : 0.02525615692138672 nb_pixel_total : 52312 time to create 1 rle with old method : 0.06125593185424805 time for calcul the mask position with numpy : 0.026494979858398438 nb_pixel_total : 57528 time to create 1 rle with old method : 0.07029986381530762 time for calcul the mask position with numpy : 0.025280475616455078 nb_pixel_total : 7906 time to create 1 rle with old method : 0.00908041000366211 time for calcul the mask position with numpy : 0.025317668914794922 nb_pixel_total : 54937 time to create 1 rle with old method : 0.07020139694213867 time for calcul the mask position with numpy : 0.02579212188720703 nb_pixel_total : 21991 time to create 1 rle with old method : 0.02528214454650879 time for calcul the mask position with numpy : 0.028317928314208984 nb_pixel_total : 29879 time to create 1 rle with old method : 0.03459310531616211 time for calcul the mask position with numpy : 0.02432394027709961 nb_pixel_total : 1953 time to create 1 rle with old method : 0.0024411678314208984 time for calcul the mask position with numpy : 0.024554967880249023 nb_pixel_total : 59318 time to create 1 rle with old method : 0.06753730773925781 time for calcul the mask position with numpy : 0.025607824325561523 nb_pixel_total : 58610 time to create 1 rle with old method : 0.06599164009094238 time for calcul the mask position with numpy : 0.025354623794555664 nb_pixel_total : 23450 time to create 1 rle with old method : 0.026610612869262695 time for calcul the mask position with numpy : 0.027022123336791992 nb_pixel_total : 47340 time to create 1 rle with old method : 0.0556638240814209 time for calcul the mask position with numpy : 0.02648019790649414 nb_pixel_total : 52227 time to create 1 rle with old method : 0.06218862533569336 time for calcul the mask position with numpy : 0.0282590389251709 nb_pixel_total : 90599 time to create 1 rle with old method : 0.10489773750305176 time for calcul the mask position with numpy : 0.02724480628967285 nb_pixel_total : 102010 time to create 1 rle with old method : 0.11767935752868652 create new chi : 4.25669002532959 time to delete rle : 0.0017969608306884766 batch 1 Loaded 45 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 13991 TO DO : save crop sub photo not yet done ! save time : 0.8758397102355957 map_output_result : {1371668728: (0.0, 'Should be the crop_list due to order', 0), 1371668616: (0.0, 'Should be the crop_list due to order', 0), 1371668595: (0.0, 'Should be the crop_list due to order', 0), 1371668591: (0.0, 'Should be the crop_list due to order', 0), 1371668556: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1371668728, 1371668616, 1371668595, 1371668591, 1371668556] Looping around the photos to save general results len do output : 5 /1371668728.Didn't retrieve data . /1371668616.Didn't retrieve data . /1371668595.Didn't retrieve data . /1371668591.Didn't retrieve data . /1371668556.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668728', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668616', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668595', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668591', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668556', None, None, None, None, None, '3273062') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.0121307373046875 save_final save missing photos in datou_result : time spend for datou_step_exec : 76.54314827919006 time spend to save output : 0.013580560684204102 total time spend for step 3 : 76.55672883987427 step4:ventilate_hashtags_in_portfolio Fri Jul 11 21:53:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 24854816 get user id for portfolio 24854816 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24854816 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','metal','papier','pet_clair','autre','environnement','pet_fonce','flou','carton','pehd','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24854816 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','metal','papier','pet_clair','autre','environnement','pet_fonce','flou','carton','pehd','mal_croppe')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24854816 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','metal','papier','pet_clair','autre','environnement','pet_fonce','flou','carton','pehd','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/24855464,24855465,24855466,24855467,24855468,24855469,24855470,24855471,24855472,24855473,24855474?tags=background,metal,papier,pet_clair,autre,environnement,pet_fonce,flou,carton,pehd,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1371668728, 1371668616, 1371668595, 1371668591, 1371668556] Looping around the photos to save general results len do output : 1 /24854816. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668728', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668616', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668595', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668591', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668556', None, None, None, None, None, '3273062') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.020513534545898438 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7753422260284424 time spend to save output : 0.020656824111938477 total time spend for step 4 : 1.7959990501403809 step5:final Fri Jul 11 21:53:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1371668728: ('0.15770577739197536',), 1371668616: ('0.15770577739197536',), 1371668595: ('0.15770577739197536',), 1371668591: ('0.15770577739197536',), 1371668556: ('0.15770577739197536',)} new output for save of step final : {1371668728: ('0.15770577739197536',), 1371668616: ('0.15770577739197536',), 1371668595: ('0.15770577739197536',), 1371668591: ('0.15770577739197536',), 1371668556: ('0.15770577739197536',)} [1371668728, 1371668616, 1371668595, 1371668591, 1371668556] Looping around the photos to save general results len do output : 5 /1371668728.Didn't retrieve data . /1371668616.Didn't retrieve data . /1371668595.Didn't retrieve data . /1371668591.Didn't retrieve data . /1371668556.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668728', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668616', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668595', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668591', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668556', None, None, None, None, None, '3273062') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.014013051986694336 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12539887428283691 time spend to save output : 0.041138648986816406 total time spend for step 5 : 0.16653752326965332 step6:blur_detection Fri Jul 11 21:53:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c.jpg resize: (2160, 3840) 1371668728 -6.21567962987311 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4.jpg resize: (2160, 3840) 1371668616 -7.104002859546748 treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d.jpg resize: (2160, 3840) 1371668595 -7.144579812501393 treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081.jpg resize: (2160, 3840) 1371668591 -6.187129629638814 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec.jpg resize: (2160, 3840) 1371668556 -6.273707977921656 treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209035_0.png resize: (433, 399) 1371675046 -1.8032525934928423 treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209038_0.png resize: (142, 170) 1371675047 -2.763470552249561 treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209039_0.png resize: (271, 618) 1371675048 -4.827808639614427 treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209042_0.png resize: (319, 690) 1371675049 -3.2236622995673927 treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209044_0.png resize: (324, 436) 1371675050 -2.5199430293930587 treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209046_0.png resize: (175, 166) 1371675051 -3.8169350778807223 treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209047_0.png resize: (547, 221) 1371675052 -5.006386103986972 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209051_0.png resize: (232, 191) 1371675053 -3.315194976894821 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209052_0.png resize: (280, 651) 1371675054 -4.970413274086228 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209053_0.png resize: (580, 241) 1371675055 -3.168360802145344 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209054_0.png resize: (100, 98) 1371675056 -1.9190614368030388 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209058_0.png resize: (181, 161) 1371675057 -1.4443859685382459 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209059_0.png resize: (185, 148) 1371675058 -1.231629034005991 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209060_0.png resize: (152, 261) 1371675059 -4.549329794988331 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209061_0.png resize: (353, 219) 1371675060 -3.1482859647231467 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209063_0.png resize: (351, 245) 1371675061 -3.629429594414659 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209067_0.png resize: (172, 348) 1371675062 -2.7704406970500317 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209068_0.png resize: (256, 191) 1371675063 -3.9232926786367437 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209069_0.png resize: (242, 253) 1371675064 -3.051938695987709 treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209072_0.png resize: (270, 244) 1371675065 -0.7908609486179866 treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209074_0.png resize: (223, 95) 1371675066 -4.037255818863854 treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209075_0.png resize: (172, 179) 1371675067 -3.592171275930346 treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209076_0.png resize: (172, 165) 1371675068 -3.9778607535462047 treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209077_0.png resize: (368, 249) 1371675069 -1.9849806282474336 treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209080_0.png resize: (180, 135) 1371675070 -3.1308839173365435 treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209082_0.png resize: (413, 463) 1371675071 -4.679052867011701 treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209084_0.png resize: (262, 282) 1371675072 -4.494584470419679 treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209085_0.png resize: (349, 231) 1371675073 -4.467209646431806 treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209087_0.png resize: (151, 180) 1371675074 -2.1066488304775155 treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209088_0.png resize: (379, 449) 1371675075 -3.2291932768187666 treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209089_0.png resize: (219, 554) 1371675076 -3.690213734625926 treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209090_0.png resize: (302, 672) 1371675077 -2.293329015607909 treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209095_0.png resize: (86, 125) 1371675078 -4.468637939814596 treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209096_0.png resize: (178, 150) 1371675079 -3.3397868742961316 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209098_0.png resize: (418, 396) 1371675080 0.23615121201508288 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209099_0.png resize: (346, 567) 1371675081 -3.379293503021751 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209100_0.png resize: (352, 258) 1371675082 -3.651226008848814 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209101_0.png resize: (192, 341) 1371675083 -5.186571180820555 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209102_0.png resize: (149, 205) 1371675084 -3.5329873169869117 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209103_0.png resize: (406, 241) 1371675086 -2.438776504624341 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209104_0.png resize: (380, 378) 1371675087 -3.0784263644681493 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209106_0.png resize: (181, 244) 1371675088 -1.7888069966155171 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209107_0.png resize: (164, 165) 1371675089 -2.178254702352455 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209108_0.png resize: (285, 333) 1371675090 -5.140992711678558 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209112_0.png resize: (168, 172) 1371675091 -2.9014018847427163 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209114_0.png resize: (294, 138) 1371675092 -4.1912279565088415 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209115_0.png resize: (111, 124) 1371675093 -3.453434768664215 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209118_0.png resize: (159, 236) 1371675094 -2.643137394448427 treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209048_0.png resize: (324, 268) 1371675096 -4.105739782186526 treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209073_0.png resize: (457, 564) 1371675097 -4.987258933431881 treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209092_0.png resize: (450, 1409) 1371675098 -3.5723382385317684 treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209050_0.png resize: (163, 150) 1371675102 -4.563616274158846 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209070_0.png resize: (154, 141) 1371675103 -4.231116400558752 treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209036_0.png resize: (333, 328) 1371675129 -5.595806595418116 treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209037_0.png resize: (152, 260) 1371675130 -3.9878541751845122 treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209040_0.png resize: (498, 429) 1371675131 -4.65829091057139 treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209041_0.png resize: (596, 507) 1371675132 -5.308414365390198 treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209043_0.png resize: (266, 1223) 1371675133 -4.367526367016494 treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209045_0.png resize: (344, 342) 1371675134 -5.244317032846187 treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209049_0.png resize: (267, 285) 1371675135 -4.333299111203263 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209055_0.png resize: (491, 224) 1371675136 -4.80453906594162 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209056_0.png resize: (141, 520) 1371675137 -4.36563526612264 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209057_0.png resize: (202, 581) 1371675138 -4.297100987251756 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209062_0.png resize: (308, 468) 1371675139 -0.8088086812509876 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209064_0.png resize: (508, 398) 1371675140 -4.745513676677383 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209065_0.png resize: (199, 203) 1371675141 -3.903664473233064 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209066_0.png resize: (434, 356) 1371675142 -4.780966564938388 treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209078_0.png resize: (347, 352) 1371675143 -4.622887903933545 treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209079_0.png resize: (486, 299) 1371675144 -5.3226158770903025 treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209081_0.png resize: (319, 545) 1371675145 -3.6728205444468114 treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209083_0.png resize: (409, 526) 1371675146 -4.175221805323251 treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209086_0.png resize: (286, 242) 1371675147 -4.292812037038 treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209091_0.png resize: (714, 1233) 1371675148 -3.5052725794099113 treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209094_0.png resize: (223, 852) 1371675149 -4.504117988875815 treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209097_0.png resize: (154, 172) 1371675150 -4.242090806489817 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209105_0.png resize: (223, 361) 1371675151 -3.2420157698355627 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209109_0.png resize: (104, 103) 1371675152 -3.313279176899645 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209110_0.png resize: (197, 423) 1371675153 -4.902859337161853 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209111_0.png resize: (196, 333) 1371675154 -4.1123603250398455 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209113_0.png resize: (437, 622) 1371675156 -4.574498149069837 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209117_0.png resize: (415, 351) 1371675157 -5.18249485643056 treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209093_0.png resize: (689, 440) 1371675162 -4.444227802545071 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209116_0.png resize: (246, 303) 1371675163 -4.401661336454905 treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209071_0.png resize: (188, 179) 1371675168 -4.123966303483049 treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209119_0.png resize: (405, 592) 1371675169 -4.520201760937793 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 90 time used for this insertion : 0.019345998764038086 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 90 time used for this insertion : 0.018146038055419922 save missing photos in datou_result : time spend for datou_step_exec : 23.55849051475525 time spend to save output : 0.052190303802490234 total time spend for step 6 : 23.61068081855774 step7:brightness Fri Jul 11 21:54:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c.jpg treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4.jpg treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d.jpg treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081.jpg treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec.jpg treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209035_0.png treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209038_0.png treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209039_0.png treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209042_0.png treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209044_0.png treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209046_0.png treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209047_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209051_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209052_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209053_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209054_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209058_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209059_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209060_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209061_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209063_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209067_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209068_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209069_0.png treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209072_0.png treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209074_0.png treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209075_0.png treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209076_0.png treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209077_0.png treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209080_0.png treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209082_0.png treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209084_0.png treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209085_0.png treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209087_0.png treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209088_0.png treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209089_0.png treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209090_0.png treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209095_0.png treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209096_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209098_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209099_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209100_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209101_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209102_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209103_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209104_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209106_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209107_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209108_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209112_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209114_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209115_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209118_0.png treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209048_0.png treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209073_0.png treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209092_0.png treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209050_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209070_0.png treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209036_0.png treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209037_0.png treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209040_0.png treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209041_0.png treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209043_0.png treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209045_0.png treat image : temp/1752263427_409132_1371668728_155f596857b984267322138884f6e68c_rle_crop_3880209049_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209055_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209056_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209057_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209062_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209064_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209065_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209066_0.png treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209078_0.png treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209079_0.png treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209081_0.png treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209083_0.png treat image : temp/1752263427_409132_1371668595_ca291a76f32aab4f7e3c8bc6942a9e5d_rle_crop_3880209086_0.png treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209091_0.png treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209094_0.png treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209097_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209105_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209109_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209110_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209111_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209113_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209117_0.png treat image : temp/1752263427_409132_1371668591_bdad38ce15823bf96b8a423da0fda081_rle_crop_3880209093_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209116_0.png treat image : temp/1752263427_409132_1371668616_b8390ef14f5c4ca6da523a1ddcae34a4_rle_crop_3880209071_0.png treat image : temp/1752263427_409132_1371668556_e980a8db34f01fe1b0ca578c492d4bec_rle_crop_3880209119_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 90 time used for this insertion : 0.020493030548095703 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 90 time used for this insertion : 0.020313262939453125 save missing photos in datou_result : time spend for datou_step_exec : 6.358696937561035 time spend to save output : 0.04553556442260742 total time spend for step 7 : 6.404232501983643 step8:velours_tree Fri Jul 11 21:54:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.30986642837524414 time spend to save output : 5.626678466796875e-05 total time spend for step 8 : 0.3099226951599121 step9:send_mail_cod Fri Jul 11 21:54:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P24854816_11-07-2025_21_54_15.pdf 24855464 imagette248554641752263655 24855465 change filename to text .change filename to text .imagette248554651752263655 24855466 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette248554661752263655 24855467 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette248554671752263656 24855468 change filename to text .change filename to text .imagette248554681752263658 24855470 change filename to text .change filename to text .imagette248554701752263658 24855471 imagette248554711752263659 24855472 change filename to text .change filename to text .change filename to text .imagette248554721752263659 24855473 imagette248554731752263659 24855474 imagette248554741752263659 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=24854816 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/24855464,24855465,24855466,24855467,24855468,24855469,24855470,24855471,24855472,24855473,24855474?tags=background,metal,papier,pet_clair,autre,environnement,pet_fonce,flou,carton,pehd,mal_croppe args[1371668728] : ((1371668728, -6.21567962987311, 492609224), (1371668728, 0.17051027914819447, 2107752395), '0.15770577739197536') We are sending mail with results at report@fotonower.com args[1371668616] : ((1371668616, -7.104002859546748, 492609224), (1371668616, 0.7960069409558376, 2107752395), '0.15770577739197536') We are sending mail with results at report@fotonower.com args[1371668595] : ((1371668595, -7.144579812501393, 492609224), (1371668595, 0.8155827280639859, 2107752395), '0.15770577739197536') We are sending mail with results at report@fotonower.com args[1371668591] : ((1371668591, -6.187129629638814, 492609224), (1371668591, 0.3179982042877232, 2107752395), '0.15770577739197536') We are sending mail with results at report@fotonower.com args[1371668556] : ((1371668556, -6.273707977921656, 492609224), (1371668556, 0.24626762316300557, 2107752395), '0.15770577739197536') We are sending mail with results at report@fotonower.com refus_total : 0.15770577739197536 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=24854816 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24854816_11-07-2025_21_54_15.pdf results_Auto_P24854816_11-07-2025_21_54_15.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24854816_11-07-2025_21_54_15.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','24854816','results_Auto_P24854816_11-07-2025_21_54_15.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24854816_11-07-2025_21_54_15.pdf','pdf','','0.72','0.15770577739197536') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/24854816

https://www.fotonower.com/image?json=false&list_photos_id=1371668728
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1371668616
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1371668595
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1371668591
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1371668556
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 15.77%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/24855465?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/24855466?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/24855467?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/24855468?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/24855470?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/24855472?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24854816_11-07-2025_21_54_15.pdf.

Lien vers velours :https://www.fotonower.com/velours/24855464,24855465,24855466,24855467,24855468,24855469,24855470,24855471,24855472,24855473,24855474?tags=background,metal,papier,pet_clair,autre,environnement,pet_fonce,flou,carton,pehd,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 11 Jul 2025 19:54:22 GMT Content-Length: 0 Connection: close X-Message-Id: -h6OV2BaTMO_nIobiS5Q2A Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1371668728, 1371668616, 1371668595, 1371668591, 1371668556] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668728', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668616', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668595', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668591', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668556', None, None, None, None, None, '3273062') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.014868736267089844 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.586334705352783 time spend to save output : 0.015053987503051758 total time spend for step 9 : 7.601388692855835 step10:split_time_score Fri Jul 11 21:54:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('13', 5),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 11072025 24854816 Nombre de photos uploadées : 5 / 23040 (0%) 11072025 24854816 Nombre de photos taguées (types de déchets): 0 / 5 (0%) 11072025 24854816 Nombre de photos taguées (volume) : 0 / 5 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 6.198883056640625e-06 ????? elapsed_time : fill_and_build_computed_from_old_data 0.00034427642822265625 elapsed_time : insert_dashboard_record_day_entry 0.028965473175048828 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.08246149543117659 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24846971_11-07-2025_18_11_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24846971 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24846971 AND mptpi.`type`=3726 To do Qualite : 0.037840879617694834 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24851563_11-07-2025_20_13_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24851563 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24851563 AND mptpi.`type`=3726 To do Qualite : 0.025590217689852927 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24851595_11-07-2025_20_22_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24851595 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24851595 AND mptpi.`type`=3726 To do Qualite : 0.03369315183910076 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24854815_11-07-2025_21_42_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24854815 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24854815 AND mptpi.`type`=3726 To do Qualite : 0.15770577739197536 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24854816_11-07-2025_21_54_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24854816 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24854816 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'11072025': {'nb_upload': 5, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1371668728, 1371668616, 1371668595, 1371668591, 1371668556] Looping around the photos to save general results len do output : 1 /24854816Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668728', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668616', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668595', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668591', None, None, None, None, None, '3273062') ('3318', None, None, None, None, None, None, None, '3273062') ('3318', '24854816', '1371668556', None, None, None, None, None, '3273062') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013857126235961914 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.49992942810058594 time spend to save output : 0.014029502868652344 total time spend for step 10 : 0.5139589309692383 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 5 set_done_treatment 102.06user 101.31system 3:58.25elapsed 85%CPU (0avgtext+0avgdata 4359748maxresident)k 678408inputs+121640outputs (15040major+9329067minor)pagefaults 0swaps