python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 4086187 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2617268'] with mtr_portfolio_ids : ['20850992'] and first list_photo_ids : [] new path : /proc/4086187/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 6 ; length of list_pids : 6 ; length of list_args : 6 time to download the photos : 1.1827335357666016 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Feb 26 19:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10589 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-26 19:20:33.120641: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-26 19:20:33.156042: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-26 19:20:33.157906: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3a40000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-26 19:20:33.157940: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-26 19:20:33.162051: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-26 19:20:33.289918: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x354d6390 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-26 19:20:33.289988: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-26 19:20:33.291770: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-26 19:20:33.292268: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-26 19:20:33.295480: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-26 19:20:33.298031: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-26 19:20:33.298485: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-26 19:20:33.301143: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-26 19:20:33.302483: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-26 19:20:33.309221: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-26 19:20:33.311866: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-26 19:20:33.312008: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-26 19:20:33.312996: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-26 19:20:33.313013: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-26 19:20:33.313023: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-26 19:20:33.314390: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9223 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-26 19:20:33.600413: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-26 19:20:33.600538: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-26 19:20:33.600574: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-26 19:20:33.600604: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-26 19:20:33.600632: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-26 19:20:33.600660: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-26 19:20:33.600690: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-26 19:20:33.600721: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-26 19:20:33.602553: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-26 19:20:33.604158: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-26 19:20:33.604262: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-26 19:20:33.604296: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-26 19:20:33.604325: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-26 19:20:33.604355: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-26 19:20:33.604384: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-26 19:20:33.604414: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-26 19:20:33.604444: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-26 19:20:33.606247: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-26 19:20:33.606301: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-26 19:20:33.606317: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-26 19:20:33.606330: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-26 19:20:33.611666: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9223 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-26 19:20:46.214410: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-26 19:20:46.560753: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-26 19:20:49.595221: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:49.595795: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:49.596447: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:49.597060: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:49.597589: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:49.598221: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:49.598829: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:49.599361: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-26 19:20:49.600416: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:49.600436: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-26 19:20:49.634992: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:49.635046: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-26 19:20:49.635627: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:49.635647: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-26 19:20:49.655267: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:49.655359: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-26 19:20:49.655968: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:49.655990: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-26 19:20:49.972763: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:49.972828: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-26 19:20:49.973888: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:49.973907: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-26 19:20:50.039206: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.039277: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-26 19:20:50.040996: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.041022: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-26 19:20:50.103713: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.104647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.106742: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.107631: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.220477: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.221512: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.226863: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.227563: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.329712: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.331949: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.335675: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.336871: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.346568: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.347754: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.350987: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.351982: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.362047: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.362945: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.366871: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.367697: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.435278: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.436449: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.437441: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.438362: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.443200: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.443960: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.467668: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.468768: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.469584: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.470392: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.486124: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.486877: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.487545: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.488263: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.494408: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.495160: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.500909: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.501603: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.515409: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.516178: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.521045: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.521783: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.522428: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.523186: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.525183: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.525886: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.537142: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.537931: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.538658: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.539368: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.540031: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.540668: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.541298: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.541954: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.552381: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.553159: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.560676: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.561579: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.614176: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.614237: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-26 19:20:50.615068: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.615872: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.623546: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.624265: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.624903: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.625527: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.633780: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.634438: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.662234: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.663438: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.664581: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.665673: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.670735: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.671873: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.672942: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.674070: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.675920: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.686300: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.687458: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.697626: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.698933: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.700305: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.701337: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.702369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-26 19:20:50.703645: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 6 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.60000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 32 Detection mask done ! Trying to reset tf kernel 4086751 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2960 tf kernel not reseted sub process len(results) : 6 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 6 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4153 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0006012916564941406 nb_pixel_total : 15592 time to create 1 rle with old method : 0.018099308013916016 length of segment : 172 time for calcul the mask position with numpy : 0.0010612010955810547 nb_pixel_total : 34006 time to create 1 rle with old method : 0.03961682319641113 length of segment : 234 time for calcul the mask position with numpy : 0.0011878013610839844 nb_pixel_total : 76865 time to create 1 rle with old method : 0.10771560668945312 length of segment : 363 time for calcul the mask position with numpy : 0.0013048648834228516 nb_pixel_total : 74148 time to create 1 rle with old method : 0.08416032791137695 length of segment : 248 time for calcul the mask position with numpy : 0.0006999969482421875 nb_pixel_total : 30658 time to create 1 rle with old method : 0.03558158874511719 length of segment : 263 time for calcul the mask position with numpy : 0.00032806396484375 nb_pixel_total : 15578 time to create 1 rle with old method : 0.01818060874938965 length of segment : 187 time for calcul the mask position with numpy : 0.003303050994873047 nb_pixel_total : 128033 time to create 1 rle with old method : 0.1429271697998047 length of segment : 694 time for calcul the mask position with numpy : 0.0007259845733642578 nb_pixel_total : 34942 time to create 1 rle with old method : 0.03689146041870117 length of segment : 196 time for calcul the mask position with numpy : 0.0022988319396972656 nb_pixel_total : 91835 time to create 1 rle with old method : 0.09580063819885254 length of segment : 423 time for calcul the mask position with numpy : 0.00031685829162597656 nb_pixel_total : 14166 time to create 1 rle with old method : 0.01554107666015625 length of segment : 135 time for calcul the mask position with numpy : 0.0005474090576171875 nb_pixel_total : 20402 time to create 1 rle with old method : 0.02195453643798828 length of segment : 251 time for calcul the mask position with numpy : 0.0017147064208984375 nb_pixel_total : 70722 time to create 1 rle with old method : 0.07506060600280762 length of segment : 604 time for calcul the mask position with numpy : 0.00034999847412109375 nb_pixel_total : 10720 time to create 1 rle with old method : 0.012295961380004883 length of segment : 149 time for calcul the mask position with numpy : 0.0009052753448486328 nb_pixel_total : 26405 time to create 1 rle with old method : 0.0295102596282959 length of segment : 195 time for calcul the mask position with numpy : 0.0008003711700439453 nb_pixel_total : 24482 time to create 1 rle with old method : 0.028441905975341797 length of segment : 313 time for calcul the mask position with numpy : 0.0010335445404052734 nb_pixel_total : 53806 time to create 1 rle with old method : 0.06497883796691895 length of segment : 278 time for calcul the mask position with numpy : 0.0010516643524169922 nb_pixel_total : 58796 time to create 1 rle with old method : 0.06320023536682129 length of segment : 252 time for calcul the mask position with numpy : 0.0003914833068847656 nb_pixel_total : 21353 time to create 1 rle with old method : 0.024233102798461914 length of segment : 143 time for calcul the mask position with numpy : 0.00038242340087890625 nb_pixel_total : 15181 time to create 1 rle with old method : 0.016917705535888672 length of segment : 204 time for calcul the mask position with numpy : 0.0037119388580322266 nb_pixel_total : 142172 time to create 1 rle with old method : 0.15473365783691406 length of segment : 501 time for calcul the mask position with numpy : 0.002125978469848633 nb_pixel_total : 108147 time to create 1 rle with old method : 0.11965203285217285 length of segment : 429 time for calcul the mask position with numpy : 0.0013582706451416016 nb_pixel_total : 59418 time to create 1 rle with old method : 0.06418776512145996 length of segment : 335 time for calcul the mask position with numpy : 0.00020623207092285156 nb_pixel_total : 7861 time to create 1 rle with old method : 0.008744478225708008 length of segment : 115 time for calcul the mask position with numpy : 0.0021975040435791016 nb_pixel_total : 127948 time to create 1 rle with old method : 0.13782620429992676 length of segment : 602 time for calcul the mask position with numpy : 0.0005762577056884766 nb_pixel_total : 24420 time to create 1 rle with old method : 0.0257112979888916 length of segment : 201 time for calcul the mask position with numpy : 0.0002315044403076172 nb_pixel_total : 9764 time to create 1 rle with old method : 0.010988235473632812 length of segment : 114 time for calcul the mask position with numpy : 0.00031185150146484375 nb_pixel_total : 19476 time to create 1 rle with old method : 0.021142959594726562 length of segment : 131 time for calcul the mask position with numpy : 0.0007047653198242188 nb_pixel_total : 27911 time to create 1 rle with old method : 0.0369563102722168 length of segment : 250 time for calcul the mask position with numpy : 0.00036144256591796875 nb_pixel_total : 17508 time to create 1 rle with old method : 0.019014358520507812 length of segment : 192 time for calcul the mask position with numpy : 0.0005693435668945312 nb_pixel_total : 26470 time to create 1 rle with old method : 0.029215097427368164 length of segment : 230 time for calcul the mask position with numpy : 0.00021839141845703125 nb_pixel_total : 10327 time to create 1 rle with old method : 0.01148366928100586 length of segment : 141 time for calcul the mask position with numpy : 0.00024437904357910156 nb_pixel_total : 14761 time to create 1 rle with old method : 0.016935348510742188 length of segment : 156 time for calcul the mask position with numpy : 0.0009043216705322266 nb_pixel_total : 45881 time to create 1 rle with old method : 0.05007433891296387 length of segment : 310 time for calcul the mask position with numpy : 0.0007288455963134766 nb_pixel_total : 34759 time to create 1 rle with old method : 0.03918123245239258 length of segment : 256 time for calcul the mask position with numpy : 0.009099245071411133 nb_pixel_total : 421546 time to create 1 rle with new method : 0.028505802154541016 length of segment : 1341 time for calcul the mask position with numpy : 0.0020797252655029297 nb_pixel_total : 107912 time to create 1 rle with old method : 0.12318801879882812 length of segment : 661 time for calcul the mask position with numpy : 0.0009965896606445312 nb_pixel_total : 56780 time to create 1 rle with old method : 0.06438159942626953 length of segment : 362 time for calcul the mask position with numpy : 0.0010495185852050781 nb_pixel_total : 74909 time to create 1 rle with old method : 0.08616256713867188 length of segment : 325 time for calcul the mask position with numpy : 0.0019121170043945312 nb_pixel_total : 96837 time to create 1 rle with old method : 0.10801339149475098 length of segment : 496 time for calcul the mask position with numpy : 0.00045990943908691406 nb_pixel_total : 20282 time to create 1 rle with old method : 0.02406907081604004 length of segment : 264 time for calcul the mask position with numpy : 0.0007140636444091797 nb_pixel_total : 40283 time to create 1 rle with old method : 0.2129194736480713 length of segment : 226 time for calcul the mask position with numpy : 0.0007011890411376953 nb_pixel_total : 37698 time to create 1 rle with old method : 0.04686570167541504 length of segment : 256 time for calcul the mask position with numpy : 0.0007805824279785156 nb_pixel_total : 42423 time to create 1 rle with old method : 0.04917263984680176 length of segment : 207 time for calcul the mask position with numpy : 0.00032448768615722656 nb_pixel_total : 14694 time to create 1 rle with old method : 0.020409822463989258 length of segment : 140 time for calcul the mask position with numpy : 0.0037810802459716797 nb_pixel_total : 107954 time to create 1 rle with old method : 0.11876416206359863 length of segment : 480 time for calcul the mask position with numpy : 0.0007984638214111328 nb_pixel_total : 18543 time to create 1 rle with old method : 0.02128911018371582 length of segment : 240 time for calcul the mask position with numpy : 0.0012443065643310547 nb_pixel_total : 33030 time to create 1 rle with old method : 0.03950047492980957 length of segment : 394 time for calcul the mask position with numpy : 0.0004172325134277344 nb_pixel_total : 7657 time to create 1 rle with old method : 0.012615442276000977 length of segment : 101 time for calcul the mask position with numpy : 0.0009548664093017578 nb_pixel_total : 35761 time to create 1 rle with old method : 0.042627573013305664 length of segment : 406 time for calcul the mask position with numpy : 0.0005953311920166016 nb_pixel_total : 14888 time to create 1 rle with old method : 0.017512798309326172 length of segment : 126 time for calcul the mask position with numpy : 0.0007650852203369141 nb_pixel_total : 20786 time to create 1 rle with old method : 0.02424335479736328 length of segment : 158 time for calcul the mask position with numpy : 0.001168966293334961 nb_pixel_total : 32474 time to create 1 rle with old method : 0.037551164627075195 length of segment : 187 time for calcul the mask position with numpy : 0.001462697982788086 nb_pixel_total : 53586 time to create 1 rle with old method : 0.06335043907165527 length of segment : 218 time for calcul the mask position with numpy : 0.0009036064147949219 nb_pixel_total : 22275 time to create 1 rle with old method : 0.0259091854095459 length of segment : 150 time for calcul the mask position with numpy : 0.0007417201995849609 nb_pixel_total : 22981 time to create 1 rle with old method : 0.02649998664855957 length of segment : 200 time for calcul the mask position with numpy : 0.0008015632629394531 nb_pixel_total : 26839 time to create 1 rle with old method : 0.0330812931060791 length of segment : 176 time for calcul the mask position with numpy : 0.001718759536743164 nb_pixel_total : 54682 time to create 1 rle with old method : 0.06233024597167969 length of segment : 268 time for calcul the mask position with numpy : 0.0013287067413330078 nb_pixel_total : 41086 time to create 1 rle with old method : 0.048462867736816406 length of segment : 295 time for calcul the mask position with numpy : 0.002980470657348633 nb_pixel_total : 84756 time to create 1 rle with old method : 0.09843325614929199 length of segment : 334 time for calcul the mask position with numpy : 0.003065347671508789 nb_pixel_total : 89528 time to create 1 rle with old method : 0.09834098815917969 length of segment : 439 time for calcul the mask position with numpy : 0.0008692741394042969 nb_pixel_total : 15812 time to create 1 rle with old method : 0.017886877059936523 length of segment : 218 time for calcul the mask position with numpy : 0.0013422966003417969 nb_pixel_total : 30259 time to create 1 rle with old method : 0.03478074073791504 length of segment : 182 time for calcul the mask position with numpy : 0.0013170242309570312 nb_pixel_total : 43145 time to create 1 rle with old method : 0.04849052429199219 length of segment : 243 time for calcul the mask position with numpy : 0.005479574203491211 nb_pixel_total : 121463 time to create 1 rle with old method : 0.1511077880859375 length of segment : 382 time for calcul the mask position with numpy : 0.000995635986328125 nb_pixel_total : 19254 time to create 1 rle with old method : 0.02284717559814453 length of segment : 206 time for calcul the mask position with numpy : 0.0007169246673583984 nb_pixel_total : 16832 time to create 1 rle with old method : 0.01967906951904297 length of segment : 168 time for calcul the mask position with numpy : 0.004048347473144531 nb_pixel_total : 70457 time to create 1 rle with old method : 0.07989788055419922 length of segment : 500 time for calcul the mask position with numpy : 0.002048492431640625 nb_pixel_total : 54965 time to create 1 rle with old method : 0.07209062576293945 length of segment : 298 time for calcul the mask position with numpy : 0.003728628158569336 nb_pixel_total : 96027 time to create 1 rle with old method : 0.11310887336730957 length of segment : 948 time for calcul the mask position with numpy : 0.0010285377502441406 nb_pixel_total : 17438 time to create 1 rle with old method : 0.02843642234802246 length of segment : 195 time for calcul the mask position with numpy : 0.0019240379333496094 nb_pixel_total : 28488 time to create 1 rle with old method : 0.033107757568359375 length of segment : 321 time for calcul the mask position with numpy : 0.0011212825775146484 nb_pixel_total : 34476 time to create 1 rle with old method : 0.040846824645996094 length of segment : 221 time for calcul the mask position with numpy : 0.004113912582397461 nb_pixel_total : 86275 time to create 1 rle with old method : 0.1117105484008789 length of segment : 422 time for calcul the mask position with numpy : 0.0007355213165283203 nb_pixel_total : 17778 time to create 1 rle with old method : 0.020626306533813477 length of segment : 130 time for calcul the mask position with numpy : 0.0005848407745361328 nb_pixel_total : 9722 time to create 1 rle with old method : 0.012036561965942383 length of segment : 155 time for calcul the mask position with numpy : 0.0008606910705566406 nb_pixel_total : 27552 time to create 1 rle with old method : 0.03267049789428711 length of segment : 177 time for calcul the mask position with numpy : 0.001695871353149414 nb_pixel_total : 48162 time to create 1 rle with old method : 0.05718636512756348 length of segment : 222 time for calcul the mask position with numpy : 0.0012149810791015625 nb_pixel_total : 41848 time to create 1 rle with old method : 0.047995567321777344 length of segment : 352 time for calcul the mask position with numpy : 0.0007588863372802734 nb_pixel_total : 18228 time to create 1 rle with old method : 0.021027326583862305 length of segment : 126 time for calcul the mask position with numpy : 0.006407022476196289 nb_pixel_total : 164573 time to create 1 rle with new method : 0.010990142822265625 length of segment : 602 time for calcul the mask position with numpy : 0.0021047592163085938 nb_pixel_total : 34131 time to create 1 rle with old method : 0.038143157958984375 length of segment : 458 time for calcul the mask position with numpy : 0.0007073879241943359 nb_pixel_total : 21256 time to create 1 rle with old method : 0.025016069412231445 length of segment : 231 time for calcul the mask position with numpy : 0.001009225845336914 nb_pixel_total : 27920 time to create 1 rle with old method : 0.03557538986206055 length of segment : 253 time for calcul the mask position with numpy : 0.0005285739898681641 nb_pixel_total : 9846 time to create 1 rle with old method : 0.012223005294799805 length of segment : 136 time for calcul the mask position with numpy : 0.0002231597900390625 nb_pixel_total : 6971 time to create 1 rle with old method : 0.008724451065063477 length of segment : 114 time for calcul the mask position with numpy : 0.001764535903930664 nb_pixel_total : 45716 time to create 1 rle with old method : 0.051865339279174805 length of segment : 345 time for calcul the mask position with numpy : 0.0005328655242919922 nb_pixel_total : 28401 time to create 1 rle with old method : 0.03543281555175781 length of segment : 242 time for calcul the mask position with numpy : 0.000606536865234375 nb_pixel_total : 16590 time to create 1 rle with old method : 0.019802570343017578 length of segment : 128 time spent for convertir_results : 8.841063261032104 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 88 chid ids of type : 3594 Number RLEs to save : 25692 save missing photos in datou_result : time spend for datou_step_exec : 66.19620966911316 time spend to save output : 1.5179007053375244 total time spend for step 1 : 67.71411037445068 step2:crop_condition Wed Feb 26 19:21:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 6 ! batch 1 Loaded 88 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 73 About to insert : list_path_to_insert length 73 new photo from crops ! About to upload 73 photos upload in portfolio : 3736932 init cache_photo without model_param we have 73 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740594116_4086187 we have uploaded 73 photos in the portfolio 3736932 time of upload the photos Elapsed time : 24.580963134765625 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740594145_4086187 we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.122898101806641 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740594151_4086187 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.573162317276001 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1339765147, 1339765145, 1339765141, 1339765139, 1339765135, 1339765117] Looping around the photos to save general results len do output : 88 /1339775873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339775967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339776017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765147', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765145', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765141', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765139', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765135', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765117', None, None, None, None, None, '2617268') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 270 time used for this insertion : 0.023012876510620117 save_final save missing photos in datou_result : time spend for datou_step_exec : 53.7498881816864 time spend to save output : 0.02594590187072754 total time spend for step 2 : 53.77583408355713 step3:rle_unique_nms_with_priority Wed Feb 26 19:22:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 88 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 15 nb_hashtags : 2 time to prepare the origin masks : 7.724755048751831 time for calcul the mask position with numpy : 0.3464376926422119 nb_pixel_total : 7646417 time to create 1 rle with new method : 0.6620087623596191 time for calcul the mask position with numpy : 0.029799699783325195 nb_pixel_total : 24482 time to create 1 rle with old method : 0.028754234313964844 time for calcul the mask position with numpy : 0.03180217742919922 nb_pixel_total : 26405 time to create 1 rle with old method : 0.02955007553100586 time for calcul the mask position with numpy : 0.031794071197509766 nb_pixel_total : 10720 time to create 1 rle with old method : 0.012545585632324219 time for calcul the mask position with numpy : 0.02728271484375 nb_pixel_total : 50151 time to create 1 rle with old method : 0.07625722885131836 time for calcul the mask position with numpy : 0.026363372802734375 nb_pixel_total : 20402 time to create 1 rle with old method : 0.022730588912963867 time for calcul the mask position with numpy : 0.025228261947631836 nb_pixel_total : 14166 time to create 1 rle with old method : 0.016051769256591797 time for calcul the mask position with numpy : 0.0277101993560791 nb_pixel_total : 91835 time to create 1 rle with old method : 0.10303282737731934 time for calcul the mask position with numpy : 0.026523351669311523 nb_pixel_total : 34942 time to create 1 rle with old method : 0.03910040855407715 time for calcul the mask position with numpy : 0.027010202407836914 nb_pixel_total : 128033 time to create 1 rle with old method : 0.14638376235961914 time for calcul the mask position with numpy : 0.04035782814025879 nb_pixel_total : 15578 time to create 1 rle with old method : 0.017684221267700195 time for calcul the mask position with numpy : 0.04185819625854492 nb_pixel_total : 30658 time to create 1 rle with old method : 0.035448312759399414 time for calcul the mask position with numpy : 0.04096388816833496 nb_pixel_total : 74148 time to create 1 rle with old method : 0.08068346977233887 time for calcul the mask position with numpy : 0.04069352149963379 nb_pixel_total : 76865 time to create 1 rle with old method : 0.10739541053771973 time for calcul the mask position with numpy : 0.04596757888793945 nb_pixel_total : 34006 time to create 1 rle with old method : 0.04196977615356445 time for calcul the mask position with numpy : 0.03902888298034668 nb_pixel_total : 15592 time to create 1 rle with old method : 0.017587661743164062 create new chi : 2.328089714050293 time to delete rle : 0.03209853172302246 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 10709 TO DO : save crop sub photo not yet done ! save time : 0.7520718574523926 nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 8.70603895187378 time for calcul the mask position with numpy : 1.1977837085723877 nb_pixel_total : 7600639 time to create 1 rle with new method : 0.8052284717559814 time for calcul the mask position with numpy : 0.037331581115722656 nb_pixel_total : 17508 time to create 1 rle with old method : 0.01962757110595703 time for calcul the mask position with numpy : 0.04086875915527344 nb_pixel_total : 27911 time to create 1 rle with old method : 0.031502723693847656 time for calcul the mask position with numpy : 0.04180598258972168 nb_pixel_total : 19476 time to create 1 rle with old method : 0.02165818214416504 time for calcul the mask position with numpy : 0.04051518440246582 nb_pixel_total : 9764 time to create 1 rle with old method : 0.01102447509765625 time for calcul the mask position with numpy : 0.04110217094421387 nb_pixel_total : 24420 time to create 1 rle with old method : 0.027379989624023438 time for calcul the mask position with numpy : 0.04438424110412598 nb_pixel_total : 127948 time to create 1 rle with old method : 0.14215731620788574 time for calcul the mask position with numpy : 0.043642282485961914 nb_pixel_total : 7861 time to create 1 rle with old method : 0.009166717529296875 time for calcul the mask position with numpy : 0.046000003814697266 nb_pixel_total : 59418 time to create 1 rle with old method : 0.06559038162231445 time for calcul the mask position with numpy : 0.04341530799865723 nb_pixel_total : 108147 time to create 1 rle with old method : 0.13747501373291016 time for calcul the mask position with numpy : 0.04317116737365723 nb_pixel_total : 142172 time to create 1 rle with old method : 0.163527250289917 time for calcul the mask position with numpy : 0.04126858711242676 nb_pixel_total : 15181 time to create 1 rle with old method : 0.018019437789916992 time for calcul the mask position with numpy : 0.02567005157470703 nb_pixel_total : 21353 time to create 1 rle with old method : 0.02457714080810547 time for calcul the mask position with numpy : 0.027662038803100586 nb_pixel_total : 58796 time to create 1 rle with old method : 0.06887507438659668 time for calcul the mask position with numpy : 0.028169870376586914 nb_pixel_total : 53806 time to create 1 rle with old method : 0.06220579147338867 create new chi : 3.396652936935425 time to delete rle : 0.00217437744140625 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 9654 TO DO : save crop sub photo not yet done ! save time : 0.5906758308410645 nb_obj : 11 nb_hashtags : 2 time to prepare the origin masks : 7.10004734992981 time for calcul the mask position with numpy : 0.6425330638885498 nb_pixel_total : 7430399 time to create 1 rle with new method : 0.739966869354248 time for calcul the mask position with numpy : 0.044867753982543945 nb_pixel_total : 20282 time to create 1 rle with old method : 0.02457714080810547 time for calcul the mask position with numpy : 0.028795480728149414 nb_pixel_total : 96837 time to create 1 rle with old method : 0.11841797828674316 time for calcul the mask position with numpy : 0.0269317626953125 nb_pixel_total : 74909 time to create 1 rle with old method : 0.1227257251739502 time for calcul the mask position with numpy : 0.029756784439086914 nb_pixel_total : 56780 time to create 1 rle with old method : 0.06383013725280762 time for calcul the mask position with numpy : 0.032488107681274414 nb_pixel_total : 107912 time to create 1 rle with old method : 0.12874150276184082 time for calcul the mask position with numpy : 0.03118610382080078 nb_pixel_total : 376482 time to create 1 rle with new method : 0.701545000076294 time for calcul the mask position with numpy : 0.02547144889831543 nb_pixel_total : 34759 time to create 1 rle with old method : 0.03774571418762207 time for calcul the mask position with numpy : 0.02529311180114746 nb_pixel_total : 45881 time to create 1 rle with old method : 0.04946088790893555 time for calcul the mask position with numpy : 0.02474355697631836 nb_pixel_total : 13362 time to create 1 rle with old method : 0.014561176300048828 time for calcul the mask position with numpy : 0.026012182235717773 nb_pixel_total : 10327 time to create 1 rle with old method : 0.011266946792602539 time for calcul the mask position with numpy : 0.025630950927734375 nb_pixel_total : 26470 time to create 1 rle with old method : 0.029218196868896484 create new chi : 3.0778210163116455 time to delete rle : 0.0015347003936767578 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 11049 TO DO : save crop sub photo not yet done ! save time : 0.6742112636566162 nb_obj : 11 nb_hashtags : 2 time to prepare the origin masks : 4.096329689025879 time for calcul the mask position with numpy : 0.6734020709991455 nb_pixel_total : 7953223 time to create 1 rle with new method : 0.814417839050293 time for calcul the mask position with numpy : 0.024341583251953125 nb_pixel_total : 20786 time to create 1 rle with old method : 0.021907329559326172 time for calcul the mask position with numpy : 0.024059534072875977 nb_pixel_total : 14319 time to create 1 rle with old method : 0.015378475189208984 time for calcul the mask position with numpy : 0.031488656997680664 nb_pixel_total : 3790 time to create 1 rle with old method : 0.0049588680267333984 time for calcul the mask position with numpy : 0.0385744571685791 nb_pixel_total : 7657 time to create 1 rle with old method : 0.008086204528808594 time for calcul the mask position with numpy : 0.03833603858947754 nb_pixel_total : 33030 time to create 1 rle with old method : 0.03567218780517578 time for calcul the mask position with numpy : 0.03357696533203125 nb_pixel_total : 18543 time to create 1 rle with old method : 0.02001023292541504 time for calcul the mask position with numpy : 0.02611851692199707 nb_pixel_total : 107954 time to create 1 rle with old method : 0.11284208297729492 time for calcul the mask position with numpy : 0.025603294372558594 nb_pixel_total : 14694 time to create 1 rle with old method : 0.017138957977294922 time for calcul the mask position with numpy : 0.026678085327148438 nb_pixel_total : 42423 time to create 1 rle with old method : 0.047724008560180664 time for calcul the mask position with numpy : 0.024385690689086914 nb_pixel_total : 37698 time to create 1 rle with old method : 0.040853261947631836 time for calcul the mask position with numpy : 0.0245668888092041 nb_pixel_total : 40283 time to create 1 rle with old method : 0.04601860046386719 create new chi : 2.222121477127075 time to delete rle : 0.0011377334594726562 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 7275 TO DO : save crop sub photo not yet done ! save time : 0.4665493965148926 nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 6.126975774765015 time for calcul the mask position with numpy : 0.42121005058288574 nb_pixel_total : 7365212 time to create 1 rle with new method : 0.9521024227142334 time for calcul the mask position with numpy : 0.03826165199279785 nb_pixel_total : 28488 time to create 1 rle with old method : 0.02980947494506836 time for calcul the mask position with numpy : 0.03863716125488281 nb_pixel_total : 17438 time to create 1 rle with old method : 0.018652677536010742 time for calcul the mask position with numpy : 0.024042606353759766 nb_pixel_total : 96027 time to create 1 rle with old method : 0.10122823715209961 time for calcul the mask position with numpy : 0.02272486686706543 nb_pixel_total : 41965 time to create 1 rle with old method : 0.04232525825500488 time for calcul the mask position with numpy : 0.02342534065246582 nb_pixel_total : 70457 time to create 1 rle with old method : 0.07197022438049316 time for calcul the mask position with numpy : 0.023258447647094727 nb_pixel_total : 16832 time to create 1 rle with old method : 0.017529726028442383 time for calcul the mask position with numpy : 0.02343583106994629 nb_pixel_total : 19254 time to create 1 rle with old method : 0.01943683624267578 time for calcul the mask position with numpy : 0.02399611473083496 nb_pixel_total : 121463 time to create 1 rle with old method : 0.12223529815673828 time for calcul the mask position with numpy : 0.023849964141845703 nb_pixel_total : 43145 time to create 1 rle with old method : 0.04343008995056152 time for calcul the mask position with numpy : 0.02359771728515625 nb_pixel_total : 30259 time to create 1 rle with old method : 0.03150463104248047 time for calcul the mask position with numpy : 0.023249149322509766 nb_pixel_total : 15812 time to create 1 rle with old method : 0.015990495681762695 time for calcul the mask position with numpy : 0.02398824691772461 nb_pixel_total : 89528 time to create 1 rle with old method : 0.09241414070129395 time for calcul the mask position with numpy : 0.023740291595458984 nb_pixel_total : 84756 time to create 1 rle with old method : 0.09726881980895996 time for calcul the mask position with numpy : 0.025956392288208008 nb_pixel_total : 41086 time to create 1 rle with old method : 0.0450282096862793 time for calcul the mask position with numpy : 0.024517536163330078 nb_pixel_total : 54682 time to create 1 rle with old method : 0.060961008071899414 time for calcul the mask position with numpy : 0.025187969207763672 nb_pixel_total : 26839 time to create 1 rle with old method : 0.029986858367919922 time for calcul the mask position with numpy : 0.02545762062072754 nb_pixel_total : 22822 time to create 1 rle with old method : 0.02593064308166504 time for calcul the mask position with numpy : 0.02511310577392578 nb_pixel_total : 22275 time to create 1 rle with old method : 0.02427506446838379 time for calcul the mask position with numpy : 0.02528667449951172 nb_pixel_total : 53586 time to create 1 rle with old method : 0.05928230285644531 time for calcul the mask position with numpy : 0.024867534637451172 nb_pixel_total : 32474 time to create 1 rle with old method : 0.03618955612182617 create new chi : 2.915060520172119 time to delete rle : 0.0016810894012451172 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 13816 TO DO : save crop sub photo not yet done ! save time : 0.8048484325408936 nb_obj : 17 nb_hashtags : 2 time to prepare the origin masks : 5.4215497970581055 time for calcul the mask position with numpy : 0.710827112197876 nb_pixel_total : 7690490 time to create 1 rle with new method : 0.779094934463501 time for calcul the mask position with numpy : 0.02370619773864746 nb_pixel_total : 15273 time to create 1 rle with old method : 0.016034841537475586 time for calcul the mask position with numpy : 0.02365279197692871 nb_pixel_total : 1070 time to create 1 rle with old method : 0.0014660358428955078 time for calcul the mask position with numpy : 0.024535417556762695 nb_pixel_total : 45716 time to create 1 rle with old method : 0.05003023147583008 time for calcul the mask position with numpy : 0.02373337745666504 nb_pixel_total : 6635 time to create 1 rle with old method : 0.00715184211730957 time for calcul the mask position with numpy : 0.024165630340576172 nb_pixel_total : 9846 time to create 1 rle with old method : 0.010395526885986328 time for calcul the mask position with numpy : 0.024530649185180664 nb_pixel_total : 27920 time to create 1 rle with old method : 0.030862808227539062 time for calcul the mask position with numpy : 0.024627208709716797 nb_pixel_total : 14705 time to create 1 rle with old method : 0.015768051147460938 time for calcul the mask position with numpy : 0.023949861526489258 nb_pixel_total : 34131 time to create 1 rle with old method : 0.038015127182006836 time for calcul the mask position with numpy : 0.023964881896972656 nb_pixel_total : 164573 time to create 1 rle with new method : 0.6672065258026123 time for calcul the mask position with numpy : 0.02546834945678711 nb_pixel_total : 18228 time to create 1 rle with old method : 0.021038532257080078 time for calcul the mask position with numpy : 0.02587604522705078 nb_pixel_total : 41848 time to create 1 rle with old method : 0.04737043380737305 time for calcul the mask position with numpy : 0.024721384048461914 nb_pixel_total : 48162 time to create 1 rle with old method : 0.057314395904541016 time for calcul the mask position with numpy : 0.02529168128967285 nb_pixel_total : 27552 time to create 1 rle with old method : 0.030350446701049805 time for calcul the mask position with numpy : 0.025120973587036133 nb_pixel_total : 9722 time to create 1 rle with old method : 0.010910749435424805 time for calcul the mask position with numpy : 0.024840593338012695 nb_pixel_total : 17778 time to create 1 rle with old method : 0.01949477195739746 time for calcul the mask position with numpy : 0.025232315063476562 nb_pixel_total : 86275 time to create 1 rle with old method : 0.0967552661895752 time for calcul the mask position with numpy : 0.024735689163208008 nb_pixel_total : 34476 time to create 1 rle with old method : 0.0389552116394043 create new chi : 3.1338860988616943 time to delete rle : 0.0014674663543701172 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 10377 TO DO : save crop sub photo not yet done ! save time : 0.9219884872436523 map_output_result : {1339765147: (0.0, 'Should be the crop_list due to order', 0), 1339765145: (0.0, 'Should be the crop_list due to order', 0), 1339765141: (0.0, 'Should be the crop_list due to order', 0), 1339765139: (0.0, 'Should be the crop_list due to order', 0), 1339765135: (0.0, 'Should be the crop_list due to order', 0), 1339765117: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1339765147, 1339765145, 1339765141, 1339765139, 1339765135, 1339765117] Looping around the photos to save general results len do output : 6 /1339765147.Didn't retrieve data . /1339765145.Didn't retrieve data . /1339765141.Didn't retrieve data . /1339765139.Didn't retrieve data . /1339765135.Didn't retrieve data . /1339765117.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765147', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765145', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765141', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765139', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765135', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765117', None, None, None, None, None, '2617268') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.013014793395996094 save_final save missing photos in datou_result : time spend for datou_step_exec : 61.843950033187866 time spend to save output : 0.013472318649291992 total time spend for step 3 : 61.85742235183716 step4:ventilate_hashtags_in_portfolio Wed Feb 26 19:23:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20850992 get user id for portfolio 20850992 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20850992 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','background','pet_clair','flou','papier','metal','pet_fonce','mal_croppe','environnement','autre','carton')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20850992 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','background','pet_clair','flou','papier','metal','pet_fonce','mal_croppe','environnement','autre','carton')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20850992 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','background','pet_clair','flou','papier','metal','pet_fonce','mal_croppe','environnement','autre','carton')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/20851405,20851406,20851407,20851408,20851409,20851410,20851411,20851412,20851413,20851414,20851415?tags=pehd,background,pet_clair,flou,papier,metal,pet_fonce,mal_croppe,environnement,autre,carton Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1339765147, 1339765145, 1339765141, 1339765139, 1339765135, 1339765117] Looping around the photos to save general results len do output : 1 /20850992. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765147', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765145', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765141', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765139', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765135', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765117', None, None, None, None, None, '2617268') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.01272726058959961 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.755979299545288 time spend to save output : 0.012960672378540039 total time spend for step 4 : 1.7689399719238281 step5:final Wed Feb 26 19:23:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1339765147: ('0.08198342656893003',), 1339765145: ('0.08198342656893003',), 1339765141: ('0.08198342656893003',), 1339765139: ('0.08198342656893003',), 1339765135: ('0.08198342656893003',), 1339765117: ('0.08198342656893003',)} new output for save of step final : {1339765147: ('0.08198342656893003',), 1339765145: ('0.08198342656893003',), 1339765141: ('0.08198342656893003',), 1339765139: ('0.08198342656893003',), 1339765135: ('0.08198342656893003',), 1339765117: ('0.08198342656893003',)} [1339765147, 1339765145, 1339765141, 1339765139, 1339765135, 1339765117] Looping around the photos to save general results len do output : 6 /1339765147.Didn't retrieve data . /1339765145.Didn't retrieve data . /1339765141.Didn't retrieve data . /1339765139.Didn't retrieve data . /1339765135.Didn't retrieve data . /1339765117.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765147', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765145', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765141', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765139', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765135', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765117', None, None, None, None, None, '2617268') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.012726306915283203 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1006479263305664 time spend to save output : 0.013100624084472656 total time spend for step 5 : 0.11374855041503906 step6:blur_detection Wed Feb 26 19:23:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533.jpg resize: (2160, 3840) 1339765147 -5.954200084026745 treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642.jpg resize: (2160, 3840) 1339765145 -6.00087081955141 treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09.jpg resize: (2160, 3840) 1339765141 -5.958674279437255 treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221.jpg resize: (2160, 3840) 1339765139 -5.343358749505451 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620.jpg resize: (2160, 3840) 1339765135 -5.2198643895719385 treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7.jpg resize: (2160, 3840) 1339765117 -3.791268745053101 treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806980_0.png resize: (133, 149) 1339775873 -3.917613163145023 treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806974_0.png resize: (246, 430) 1339775874 -4.19504328013525 treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806977_0.png resize: (376, 551) 1339775875 -4.1338202672107265 treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806979_0.png resize: (354, 461) 1339775876 -4.162424980652172 treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806975_0.png resize: (273, 182) 1339775877 -3.025817350210174 treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806983_0.png resize: (143, 110) 1339775878 -0.21019608781298066 treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806978_0.png resize: (194, 250) 1339775879 -0.599742810181473 treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806982_0.png resize: (364, 362) 1339775880 -4.03297258316595 treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806972_0.png resize: (236, 306) 1339775882 -3.5772812318503 treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806984_0.png resize: (184, 235) 1339775883 -3.345228781861927 treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806973_0.png resize: (349, 261) 1339775884 -3.522246492017413 treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806976_0.png resize: (185, 138) 1339775885 -2.1684429025969965 treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806985_0.png resize: (282, 145) 1339775886 -4.068859450794538 treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806986_0.png resize: (274, 271) 1339775887 -1.7623369769831 treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806995_0.png resize: (160, 250) 1339775888 -2.7791263478208057 treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806996_0.png resize: (113, 106) 1339775889 0.3479481519590776 treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806994_0.png resize: (543, 387) 1339775890 -3.24215684891977 treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806990_0.png resize: (383, 635) 1339775891 -3.101686450470984 treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806987_0.png resize: (252, 364) 1339775892 -0.6946623405479299 treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806997_0.png resize: (129, 194) 1339775893 -3.6162316467782607 treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806988_0.png resize: (135, 234) 1339775894 -0.9735437878309005 treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806992_0.png resize: (335, 307) 1339775895 -1.3003788611050078 treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806991_0.png resize: (429, 407) 1339775896 -3.7628444826113894 treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806999_0.png resize: (159, 169) 1339775897 -3.297549528219787 treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806998_0.png resize: (266, 231) 1339775898 -2.3517027689685936 treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806989_0.png resize: (204, 121) 1339775899 -3.2734793055368008 treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807002_0.png resize: (156, 124) 1339775900 -3.6049581056139757 treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807001_0.png resize: (140, 95) 1339775901 -2.9231846341353003 treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807009_0.png resize: (395, 460) 1339775902 -3.855596653040073 treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807006_0.png resize: (510, 308) 1339775903 -2.821462754476641 treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807010_0.png resize: (254, 116) 1339775904 -4.31298119107852 treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807007_0.png resize: (358, 245) 1339775905 -3.221050340667935 treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807008_0.png resize: (285, 375) 1339775906 -3.8419498244929913 treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807017_0.png resize: (297, 183) 1339775907 -3.3790861790054705 treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807020_0.png resize: (125, 143) 1339775908 -3.088125036789722 treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807013_0.png resize: (182, 366) 1339775909 -3.48987966703029 treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807011_0.png resize: (208, 244) 1339775910 -2.702835614633806 treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807012_0.png resize: (245, 232) 1339775911 -3.0934805814480737 treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807016_0.png resize: (212, 129) 1339775912 -3.0686910266759653 treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807018_0.png resize: (100, 100) 1339775913 -0.5705356213689101 treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807021_0.png resize: (158, 189) 1339775914 -2.3885345356220697 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807039_0.png resize: (478, 321) 1339775915 -4.242894936454611 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807030_0.png resize: (352, 430) 1339775916 -3.356654654685873 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807034_0.png resize: (381, 425) 1339775917 -3.1109791787152465 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807038_0.png resize: (253, 330) 1339775918 -2.418476120121815 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807024_0.png resize: (148, 210) 1339775919 -3.0011967577893457 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807026_0.png resize: (172, 200) 1339775920 -2.8382629500401437 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807025_0.png resize: (199, 202) 1339775921 -1.4068457462699877 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807027_0.png resize: (263, 242) 1339775922 -2.5618569958936144 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807031_0.png resize: (218, 142) 1339775923 -2.252975460223195 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807033_0.png resize: (242, 212) 1339775924 -2.834089282658185 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807022_0.png resize: (187, 268) 1339775925 -0.9424263999385805 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807035_0.png resize: (206, 146) 1339775926 -2.935823225474152 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807037_0.png resize: (465, 306) 1339775927 -3.1796136531563564 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807023_0.png resize: (216, 291) 1339775928 -3.3101187607156795 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807028_0.png resize: (261, 192) 1339775929 -2.835733355703164 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807040_0.png resize: (195, 163) 1339775930 -3.1495620524045393 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807036_0.png resize: (157, 155) 1339775931 -1.6389920324623428 treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807046_0.png resize: (174, 216) 1339775932 -4.3602120945746705 treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807042_0.png resize: (221, 226) 1339775933 -4.004796585973856 treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807049_0.png resize: (126, 189) 1339775934 -3.311624847933388 treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807044_0.png resize: (130, 179) 1339775935 -3.6282557610722765 treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807047_0.png resize: (219, 294) 1339775936 -2.9216180385365345 treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807053_0.png resize: (253, 166) 1339775937 -3.368946543130265 treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807054_0.png resize: (136, 112) 1339775938 -3.5115723292666488 treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807043_0.png resize: (411, 381) 1339775939 -4.209237217112803 treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807048_0.png resize: (284, 227) 1339775940 -2.9752899281399507 treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807045_0.png resize: (153, 113) 1339775941 -3.599823411950223 treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807050_0.png resize: (427, 731) 1339775942 -3.8193354788037595 treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807055_0.png resize: (114, 87) 1339775943 -3.5195716568951867 treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807056_0.png resize: (344, 173) 1339775944 -2.530280337735002 treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807051_0.png resize: (318, 237) 1339775945 -3.8987569551762515 treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807058_0.png resize: (125, 245) 1339775946 -2.1677712283187525 treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806981_0.png resize: (251, 139) 1339775951 -3.921292775214891 treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806971_0.png resize: (161, 152) 1339775952 -2.5655550895693207 treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806993_0.png resize: (115, 99) 1339775953 -1.985667718027695 treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807005_0.png resize: (1265, 486) 1339775954 -4.559154577165964 treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807003_0.png resize: (310, 200) 1339775955 -3.821834391477634 treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807004_0.png resize: (229, 241) 1339775956 -3.1915777991505494 treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807000_0.png resize: (230, 220) 1339775957 -2.3594699662812832 treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807019_0.png resize: (331, 187) 1339775958 -3.3585909748446623 treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807015_0.png resize: (467, 350) 1339775959 -3.352817726422432 treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807014_0.png resize: (139, 139) 1339775960 -2.1592751676491333 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807032_0.png resize: (180, 269) 1339775961 -2.1323355481377235 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807041_0.png resize: (321, 132) 1339775962 -3.6799468185197464 treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807057_0.png resize: (242, 176) 1339775965 -3.2813634995439362 treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807052_0.png resize: (231, 139) 1339775967 -3.184541722568393 treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807029_0.png resize: (306, 382) 1339776017 -2.9212235393071233 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 94 time used for this insertion : 0.015174388885498047 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 94 time used for this insertion : 0.016057729721069336 save missing photos in datou_result : time spend for datou_step_exec : 23.625359773635864 time spend to save output : 0.03683161735534668 total time spend for step 6 : 23.66219139099121 step7:brightness Wed Feb 26 19:23:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533.jpg treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642.jpg treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09.jpg treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221.jpg treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620.jpg treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7.jpg treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806980_0.png treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806974_0.png treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806977_0.png treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806979_0.png treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806975_0.png treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806983_0.png treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806978_0.png treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806982_0.png treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806972_0.png treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806984_0.png treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806973_0.png treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806976_0.png treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806985_0.png treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806986_0.png treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806995_0.png treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806996_0.png treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806994_0.png treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806990_0.png treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806987_0.png treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806997_0.png treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806988_0.png treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806992_0.png treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806991_0.png treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806999_0.png treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806998_0.png treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806989_0.png treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807002_0.png treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807001_0.png treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807009_0.png treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807006_0.png treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807010_0.png treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807007_0.png treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807008_0.png treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807017_0.png treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807020_0.png treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807013_0.png treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807011_0.png treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807012_0.png treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807016_0.png treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807018_0.png treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807021_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807039_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807030_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807034_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807038_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807024_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807026_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807025_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807027_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807031_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807033_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807022_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807035_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807037_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807023_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807028_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807040_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807036_0.png treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807046_0.png treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807042_0.png treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807049_0.png treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807044_0.png treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807047_0.png treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807053_0.png treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807054_0.png treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807043_0.png treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807048_0.png treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807045_0.png treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807050_0.png treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807055_0.png treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807056_0.png treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807051_0.png treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807058_0.png treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806981_0.png treat image : temp/1740594029_4086187_1339765147_65221720a3d327233e577620062f0533_rle_crop_3687806971_0.png treat image : temp/1740594029_4086187_1339765145_db8c690a586fe3949ac37bdc18e42642_rle_crop_3687806993_0.png treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807005_0.png treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807003_0.png treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807004_0.png treat image : temp/1740594029_4086187_1339765141_8ddb5841ba09c993cf903ca5e3a79a09_rle_crop_3687807000_0.png treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807019_0.png treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807015_0.png treat image : temp/1740594029_4086187_1339765139_cf50b2a129bcbf87fc265931ca0d4221_rle_crop_3687807014_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807032_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807041_0.png treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807057_0.png treat image : temp/1740594029_4086187_1339765117_c433b9e55b0019b0d3e5f16a6d4259e7_rle_crop_3687807052_0.png treat image : temp/1740594029_4086187_1339765135_88319784519232fb06981cdf54a6b620_rle_crop_3687807029_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 94 time used for this insertion : 0.01582646369934082 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 94 time used for this insertion : 0.01639580726623535 save missing photos in datou_result : time spend for datou_step_exec : 6.361007213592529 time spend to save output : 0.03715372085571289 total time spend for step 7 : 6.398160934448242 step8:velours_tree Wed Feb 26 19:24:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.11400413513183594 time spend to save output : 3.4809112548828125e-05 total time spend for step 8 : 0.11403894424438477 step9:send_mail_cod Wed Feb 26 19:24:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P20850992_26-02-2025_19_24_05.pdf 20851405 imagette208514051740594245 20851406 imagette208514061740594245 20851407 change filename to text .imagette208514071740594245 20851408 imagette208514081740594246 20851409 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette208514091740594246 20851410 imagette208514101740594247 20851411 imagette208514111740594247 20851412 imagette208514121740594247 20851414 imagette208514141740594247 20851415 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette208514151740594247 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20850992 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20851405,20851406,20851407,20851408,20851409,20851410,20851411,20851412,20851413,20851414,20851415?tags=pehd,background,pet_clair,flou,papier,metal,pet_fonce,mal_croppe,environnement,autre,carton args[1339765147] : ((1339765147, -5.954200084026745, 492609224), (1339765147, 0.26662319085330427, 2107752395), '0.08198342656893003') We are sending mail with results at report@fotonower.com args[1339765145] : ((1339765145, -6.00087081955141, 492609224), (1339765145, 0.28155450410880273, 2107752395), '0.08198342656893003') We are sending mail with results at report@fotonower.com args[1339765141] : ((1339765141, -5.958674279437255, 492609224), (1339765141, 0.41411954795480005, 2107752395), '0.08198342656893003') We are sending mail with results at report@fotonower.com args[1339765139] : ((1339765139, -5.343358749505451, 492609224), (1339765139, -0.09727404793055001, 496442774), '0.08198342656893003') We are sending mail with results at report@fotonower.com args[1339765135] : ((1339765135, -5.2198643895719385, 492609224), (1339765135, 0.113628833838884, 2107752395), '0.08198342656893003') We are sending mail with results at report@fotonower.com args[1339765117] : ((1339765117, -3.791268745053101, 492609224), (1339765117, -1.1116354792672316, 501862349), '0.08198342656893003') We are sending mail with results at report@fotonower.com refus_total : 0.08198342656893003 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20850992 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20850992_26-02-2025_19_24_05.pdf results_Auto_P20850992_26-02-2025_19_24_05.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20850992_26-02-2025_19_24_05.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','20850992','results_Auto_P20850992_26-02-2025_19_24_05.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20850992_26-02-2025_19_24_05.pdf','pdf','','0.46','0.08198342656893003') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/20850992

https://www.fotonower.com/image?json=false&list_photos_id=1339765147
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1339765145
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1339765141
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1339765139
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1339765135
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1339765117
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 8.20%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/20851407?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/20851409?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/20851415?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20850992_26-02-2025_19_24_05.pdf.

Lien vers velours :https://www.fotonower.com/velours/20851405,20851406,20851407,20851408,20851409,20851410,20851411,20851412,20851413,20851414,20851415?tags=pehd,background,pet_clair,flou,papier,metal,pet_fonce,mal_croppe,environnement,autre,carton.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 26 Feb 2025 18:24:10 GMT Content-Length: 0 Connection: close X-Message-Id: rJBulSdiQpGUTuUUxE4Fmw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1339765147, 1339765145, 1339765141, 1339765139, 1339765135, 1339765117] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765147', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765145', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765141', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765139', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765135', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765117', None, None, None, None, None, '2617268') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.011926651000976562 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.1078150272369385 time spend to save output : 0.012130022048950195 total time spend for step 9 : 5.119945049285889 step10:split_time_score Wed Feb 26 19:24:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 6),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 26022025 20850992 Nombre de photos uploadées : 6 / 23040 (0%) 26022025 20850992 Nombre de photos taguées (types de déchets): 0 / 6 (0%) 26022025 20850992 Nombre de photos taguées (volume) : 0 / 6 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ?????? elapsed_time : fill_and_build_computed_from_old_data 0.0004124641418457031 elapsed_time : insert_dashboard_record_day_entry 0.022385597229003906 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.02387533818242207 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20826446_26-02-2025_08_47_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20826446 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20826446 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20848639 order by id desc limit 1 Qualite : 0.10768649932484571 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20827592_26-02-2025_08_57_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20827592 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20827592 AND mptpi.`type`=3594 To do Qualite : 0.039102773186668056 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20836988_26-02-2025_11_35_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20836988 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20836988 AND mptpi.`type`=3726 To do Qualite : 0.02899874691544684 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20838641_26-02-2025_13_56_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20838641 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20838641 AND mptpi.`type`=3726 To do Qualite : 0.03562758551270434 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20840116_26-02-2025_13_28_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20840116 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20840116 AND mptpi.`type`=3726 To do Qualite : 0.030417501981202837 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20841928_26-02-2025_14_54_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20841928 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20841928 AND mptpi.`type`=3726 To do Qualite : 0.029872276385397495 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20841930_26-02-2025_14_51_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20841930 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20841930 AND mptpi.`type`=3726 To do Qualite : 0.048179243638668275 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20847133_26-02-2025_16_51_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20847133 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20847133 AND mptpi.`type`=3726 To do Qualite : 0.09568059473861884 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20847134_26-02-2025_16_56_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20847134 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20847134 AND mptpi.`type`=3594 To do Qualite : 0.08198342656893003 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20850992_26-02-2025_19_24_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20850992 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20850992 AND mptpi.`type`=3594 To do Qualite : 0.04372546827580247 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20850993_26-02-2025_19_21_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20850993 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20850993 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'26022025': {'nb_upload': 6, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1339765147, 1339765145, 1339765141, 1339765139, 1339765135, 1339765117] Looping around the photos to save general results len do output : 1 /20850992Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765147', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765145', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765141', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765139', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765135', None, None, None, None, None, '2617268') ('3318', None, None, None, None, None, None, None, '2617268') ('3318', '20850992', '1339765117', None, None, None, None, None, '2617268') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.013586759567260742 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.642552137374878 time spend to save output : 0.013763189315795898 total time spend for step 10 : 1.6563153266906738 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 6 set_done_treatment 92.76user 92.36system 3:47.40elapsed 81%CPU (0avgtext+0avgdata 3437452maxresident)k 197568inputs+76632outputs (12038major+9058379minor)pagefaults 0swaps