python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 402258 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2955647'] with mtr_portfolio_ids : ['23344698'] and first list_photo_ids : [] new path : /proc/402258/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 1.1684825420379639 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon May 26 16:50:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3439 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-26 16:50:32.448367: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-26 16:50:32.475192: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-26 16:50:32.477482: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fb7bc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-26 16:50:32.477564: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-26 16:50:32.481823: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-26 16:50:32.599411: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x383559f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-26 16:50:32.599499: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-26 16:50:32.600873: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 16:50:32.601503: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 16:50:32.605413: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 16:50:32.608498: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 16:50:32.609175: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 16:50:32.612810: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 16:50:32.614238: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 16:50:32.619225: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 16:50:32.620462: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 16:50:32.620573: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 16:50:32.621234: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 16:50:32.621255: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 16:50:32.621267: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-26 16:50:32.623119: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2834 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-26 16:50:32.976414: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 16:50:32.976569: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 16:50:32.976608: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 16:50:32.976643: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 16:50:32.976710: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 16:50:32.976744: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 16:50:32.976773: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 16:50:32.976804: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 16:50:32.978035: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 16:50:32.981241: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 16:50:32.981429: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 16:50:32.981463: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 16:50:32.981490: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 16:50:32.981514: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 16:50:32.981539: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 16:50:32.981564: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 16:50:32.981589: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 16:50:32.982944: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 16:50:32.983036: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 16:50:32.983052: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 16:50:32.983065: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-26 16:50:32.984576: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2834 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.pInside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-26 16:50:44.000788: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 16:50:44.005780: E tensorflow/stream_executor/cuda/cuda_blas.cc:238] failed to create cublas handle: CUBLAS_STATUS_NOT_INITIALIZED 2025-05-26 16:50:44.009773: E tensorflow/stream_executor/cuda/cuda_blas.cc:238] failed to create cublas handle: CUBLAS_STATUS_NOT_INITIALIZED 2025-05-26 16:50:44.021080: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 16:50:44.033183: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-26 16:50:44.034333: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-26 16:50:48.614263: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.614341: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 16:50:48.615157: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.615186: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 16:50:48.622539: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.622564: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 16:50:48.623184: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.623206: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 16:50:48.629890: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.629918: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 16:50:48.630538: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.630566: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 16:50:48.662222: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.662261: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 16:50:48.662907: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.662932: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 16:50:48.668898: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.668924: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 16:50:48.669534: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.669556: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 16:50:48.705067: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.705732: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.707814: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.708452: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.751202: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.751799: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.753941: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.754571: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.781908: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.782548: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.784218: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.784865: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.790679: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.791319: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.793153: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.793796: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.800544: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.801168: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.802856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.803476: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.832091: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.832719: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.833328: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.833936: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.837758: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.838316: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.855023: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.855618: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.856200: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.856756: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.869981: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.870534: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.871364: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.871947: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.876378: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.876922: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.881613: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.882199: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.894928: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.895516: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.899884: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.900469: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.901049: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.901617: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.902349: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.902956: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.914202: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.914749: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.915346: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.915930: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.916537: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.917127: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.932167: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.932754: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.962543: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.962595: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-26 16:50:48.963709: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.964746: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.971936: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.972684: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.973415: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.974130: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.982045: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:48.982649: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:49.004794: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:49.005548: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:49.006279: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:49.007074: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:49.011166: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:49.011820: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:49.012465: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:49.013088: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:49.014332: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:49.024920: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:49.025594: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:49.034647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:49.035292: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:49.035932: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:49.036523: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:49.037104: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:50:49.037675: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.27G (2436759552 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 16:51:18.005442: E tensorflow/stream_executor/dnn.cc:613] CUDNN_STATUS_EXECUTION_FAILED in tensorflow/stream_executor/cuda/cuda_dnn.cc(3158): 'cudnnConvolutionForward( cudnn.handle(), alpha, input_nd.handle(), input_data.opaque(), filter_nd.handle(), filter_data.opaque(), conv.handle(), ToConvForwardAlgo(algorithm_desc), scratch_memory.opaque(), scratch_memory.size(), beta, output_nd.handle(), output_data.opaque())' local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 error in detect the image : temp/1748271028_402258_1361100484_7dfb8a8aaf59ba3d262066be6a30c7d1.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/ExpandDims/_52]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 52 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 error in detect the image : temp/1748271028_402258_1361099809_b9c626f9f4c2c6109f6f4d3b0aa38f4c.jpg 2 root error(s) found. (0) Internal: cuDNN launch failure : input shape([1,3,646,646]) filter shape([7,7,3,64]) [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/map/while/loop_body_control/_33/_71]] (1) Internal: cuDNN launch failure : input shape([1,3,646,646]) filter shape([7,7,3,64]) [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph Detection mask done ! Trying to reset tf kernel 403105 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1053 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2246 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0043871402740478516 nb_pixel_total : 114318 time to create 1 rle with old method : 0.1309068202972412 length of segment : 424 time for calcul the mask position with numpy : 0.003532886505126953 nb_pixel_total : 126417 time to create 1 rle with old method : 0.14187240600585938 length of segment : 276 time for calcul the mask position with numpy : 0.004775285720825195 nb_pixel_total : 165846 time to create 1 rle with new method : 0.008846759796142578 length of segment : 471 time for calcul the mask position with numpy : 0.0006511211395263672 nb_pixel_total : 15500 time to create 1 rle with old method : 0.017609596252441406 length of segment : 191 time for calcul the mask position with numpy : 0.004729032516479492 nb_pixel_total : 120861 time to create 1 rle with old method : 0.13685345649719238 length of segment : 232 time for calcul the mask position with numpy : 0.000545501708984375 nb_pixel_total : 24101 time to create 1 rle with old method : 0.027344942092895508 length of segment : 298 time for calcul the mask position with numpy : 0.00030422210693359375 nb_pixel_total : 7583 time to create 1 rle with old method : 0.009363889694213867 length of segment : 116 time for calcul the mask position with numpy : 0.006688833236694336 nb_pixel_total : 261445 time to create 1 rle with new method : 0.014899969100952148 length of segment : 645 time for calcul the mask position with numpy : 0.0011763572692871094 nb_pixel_total : 56755 time to create 1 rle with old method : 0.06542372703552246 length of segment : 155 time for calcul the mask position with numpy : 0.001338958740234375 nb_pixel_total : 47085 time to create 1 rle with old method : 0.06364274024963379 length of segment : 154 time for calcul the mask position with numpy : 0.11314582824707031 nb_pixel_total : 889439 time to create 1 rle with new method : 0.19231247901916504 length of segment : 973 time for calcul the mask position with numpy : 0.0009322166442871094 nb_pixel_total : 23806 time to create 1 rle with old method : 0.03174901008605957 length of segment : 387 time for calcul the mask position with numpy : 0.0020422935485839844 nb_pixel_total : 92145 time to create 1 rle with old method : 0.11162590980529785 length of segment : 364 time for calcul the mask position with numpy : 0.007553577423095703 nb_pixel_total : 212889 time to create 1 rle with new method : 0.009714126586914062 length of segment : 546 time for calcul the mask position with numpy : 0.002897500991821289 nb_pixel_total : 50466 time to create 1 rle with old method : 0.057732582092285156 length of segment : 484 time for calcul the mask position with numpy : 0.0023093223571777344 nb_pixel_total : 21710 time to create 1 rle with old method : 0.02597212791442871 length of segment : 564 time for calcul the mask position with numpy : 0.0018014907836914062 nb_pixel_total : 31865 time to create 1 rle with old method : 0.03806567192077637 length of segment : 210 time for calcul the mask position with numpy : 0.013526201248168945 nb_pixel_total : 271597 time to create 1 rle with new method : 0.020250558853149414 length of segment : 698 time for calcul the mask position with numpy : 0.0018706321716308594 nb_pixel_total : 47882 time to create 1 rle with old method : 0.05297255516052246 length of segment : 429 time for calcul the mask position with numpy : 0.0033490657806396484 nb_pixel_total : 78785 time to create 1 rle with old method : 0.08956384658813477 length of segment : 355 time for calcul the mask position with numpy : 0.007025957107543945 nb_pixel_total : 137413 time to create 1 rle with old method : 0.15439701080322266 length of segment : 372 time for calcul the mask position with numpy : 0.0028655529022216797 nb_pixel_total : 65993 time to create 1 rle with old method : 0.07619309425354004 length of segment : 623 time for calcul the mask position with numpy : 0.004710197448730469 nb_pixel_total : 121057 time to create 1 rle with old method : 0.1358623504638672 length of segment : 366 time for calcul the mask position with numpy : 0.0010499954223632812 nb_pixel_total : 23568 time to create 1 rle with old method : 0.027344465255737305 length of segment : 355 time for calcul the mask position with numpy : 0.001119852066040039 nb_pixel_total : 38398 time to create 1 rle with old method : 0.04342818260192871 length of segment : 179 time for calcul the mask position with numpy : 0.0037059783935546875 nb_pixel_total : 88657 time to create 1 rle with old method : 0.09947848320007324 length of segment : 524 time for calcul the mask position with numpy : 0.00093841552734375 nb_pixel_total : 28291 time to create 1 rle with old method : 0.031868696212768555 length of segment : 186 time for calcul the mask position with numpy : 0.0016391277313232422 nb_pixel_total : 53388 time to create 1 rle with old method : 0.06106376647949219 length of segment : 356 time for calcul the mask position with numpy : 0.0005373954772949219 nb_pixel_total : 20079 time to create 1 rle with old method : 0.023380041122436523 length of segment : 323 time for calcul the mask position with numpy : 0.0077779293060302734 nb_pixel_total : 166903 time to create 1 rle with new method : 0.013402700424194336 length of segment : 995 time for calcul the mask position with numpy : 0.0016336441040039062 nb_pixel_total : 38876 time to create 1 rle with old method : 0.044797420501708984 length of segment : 192 time for calcul the mask position with numpy : 0.0017626285552978516 nb_pixel_total : 45654 time to create 1 rle with old method : 0.052245140075683594 length of segment : 330 time for calcul the mask position with numpy : 0.0036127567291259766 nb_pixel_total : 68235 time to create 1 rle with old method : 0.07528495788574219 length of segment : 412 time for calcul the mask position with numpy : 0.005208015441894531 nb_pixel_total : 105181 time to create 1 rle with old method : 0.11885857582092285 length of segment : 616 time for calcul the mask position with numpy : 0.0017464160919189453 nb_pixel_total : 37375 time to create 1 rle with old method : 0.043068647384643555 length of segment : 266 time for calcul the mask position with numpy : 0.001447439193725586 nb_pixel_total : 23249 time to create 1 rle with old method : 0.03781437873840332 length of segment : 212 time for calcul the mask position with numpy : 0.001222848892211914 nb_pixel_total : 25121 time to create 1 rle with old method : 0.028356552124023438 length of segment : 208 time for calcul the mask position with numpy : 0.003336668014526367 nb_pixel_total : 76641 time to create 1 rle with old method : 0.08859777450561523 length of segment : 199 time for calcul the mask position with numpy : 0.0009446144104003906 nb_pixel_total : 8896 time to create 1 rle with old method : 0.010683059692382812 length of segment : 120 time for calcul the mask position with numpy : 0.008899688720703125 nb_pixel_total : 112848 time to create 1 rle with old method : 0.1304173469543457 length of segment : 483 time for calcul the mask position with numpy : 0.0017418861389160156 nb_pixel_total : 64449 time to create 1 rle with old method : 0.07315278053283691 length of segment : 223 time for calcul the mask position with numpy : 0.0006330013275146484 nb_pixel_total : 11450 time to create 1 rle with old method : 0.01318502426147461 length of segment : 117 time for calcul the mask position with numpy : 0.0037772655487060547 nb_pixel_total : 71770 time to create 1 rle with old method : 0.07994818687438965 length of segment : 284 time for calcul the mask position with numpy : 0.0017690658569335938 nb_pixel_total : 27671 time to create 1 rle with old method : 0.031056880950927734 length of segment : 272 time for calcul the mask position with numpy : 0.0034084320068359375 nb_pixel_total : 59169 time to create 1 rle with old method : 0.09020280838012695 length of segment : 374 time for calcul the mask position with numpy : 0.0030612945556640625 nb_pixel_total : 54978 time to create 1 rle with old method : 0.06282520294189453 length of segment : 660 time for calcul the mask position with numpy : 0.0006172657012939453 nb_pixel_total : 9199 time to create 1 rle with old method : 0.010838985443115234 length of segment : 120 time for calcul the mask position with numpy : 0.005484342575073242 nb_pixel_total : 109498 time to create 1 rle with old method : 0.12563133239746094 length of segment : 386 time for calcul the mask position with numpy : 0.004488229751586914 nb_pixel_total : 96450 time to create 1 rle with old method : 0.10886645317077637 length of segment : 315 time for calcul the mask position with numpy : 0.0008730888366699219 nb_pixel_total : 15689 time to create 1 rle with old method : 0.018108606338500977 length of segment : 363 time for calcul the mask position with numpy : 0.015459299087524414 nb_pixel_total : 335510 time to create 1 rle with new method : 0.030675411224365234 length of segment : 1285 time for calcul the mask position with numpy : 0.0004394054412841797 nb_pixel_total : 9004 time to create 1 rle with old method : 0.010629892349243164 length of segment : 100 time for calcul the mask position with numpy : 0.0018696784973144531 nb_pixel_total : 49771 time to create 1 rle with old method : 0.0588836669921875 length of segment : 423 time for calcul the mask position with numpy : 0.0022895336151123047 nb_pixel_total : 73685 time to create 1 rle with old method : 0.08486270904541016 length of segment : 432 time for calcul the mask position with numpy : 0.007309675216674805 nb_pixel_total : 159000 time to create 1 rle with new method : 0.009816169738769531 length of segment : 583 time for calcul the mask position with numpy : 0.004053592681884766 nb_pixel_total : 114594 time to create 1 rle with old method : 0.1284952163696289 length of segment : 400 time for calcul the mask position with numpy : 0.003940582275390625 nb_pixel_total : 90598 time to create 1 rle with old method : 0.10458493232727051 length of segment : 421 time for calcul the mask position with numpy : 0.005766868591308594 nb_pixel_total : 179282 time to create 1 rle with new method : 0.00734257698059082 length of segment : 519 time for calcul the mask position with numpy : 0.0007638931274414062 nb_pixel_total : 13943 time to create 1 rle with old method : 0.016449689865112305 length of segment : 130 time for calcul the mask position with numpy : 0.001394510269165039 nb_pixel_total : 30551 time to create 1 rle with old method : 0.035590171813964844 length of segment : 254 time for calcul the mask position with numpy : 0.002242565155029297 nb_pixel_total : 56471 time to create 1 rle with old method : 0.06366467475891113 length of segment : 320 time for calcul the mask position with numpy : 0.0010688304901123047 nb_pixel_total : 24388 time to create 1 rle with old method : 0.0306851863861084 length of segment : 201 time for calcul the mask position with numpy : 0.0010600090026855469 nb_pixel_total : 22378 time to create 1 rle with old method : 0.025693655014038086 length of segment : 254 time for calcul the mask position with numpy : 0.00470280647277832 nb_pixel_total : 211489 time to create 1 rle with new method : 0.0074961185455322266 length of segment : 600 time for calcul the mask position with numpy : 0.0004010200500488281 nb_pixel_total : 16340 time to create 1 rle with old method : 0.01877880096435547 length of segment : 206 time for calcul the mask position with numpy : 0.0015385150909423828 nb_pixel_total : 36266 time to create 1 rle with old method : 0.04265713691711426 length of segment : 221 time for calcul the mask position with numpy : 0.0016226768493652344 nb_pixel_total : 37503 time to create 1 rle with old method : 0.04367685317993164 length of segment : 305 time for calcul the mask position with numpy : 0.005371570587158203 nb_pixel_total : 157406 time to create 1 rle with new method : 0.0072286128997802734 length of segment : 489 time for calcul the mask position with numpy : 0.00033473968505859375 nb_pixel_total : 9193 time to create 1 rle with old method : 0.01079416275024414 length of segment : 152 time for calcul the mask position with numpy : 0.0003495216369628906 nb_pixel_total : 11555 time to create 1 rle with old method : 0.013614177703857422 length of segment : 159 time for calcul the mask position with numpy : 0.0016970634460449219 nb_pixel_total : 51780 time to create 1 rle with old method : 0.05859565734863281 length of segment : 241 time for calcul the mask position with numpy : 0.0012106895446777344 nb_pixel_total : 16492 time to create 1 rle with old method : 0.019070863723754883 length of segment : 266 time for calcul the mask position with numpy : 0.009224414825439453 nb_pixel_total : 288898 time to create 1 rle with new method : 0.014051675796508789 length of segment : 652 time for calcul the mask position with numpy : 0.004663228988647461 nb_pixel_total : 139880 time to create 1 rle with old method : 0.1645205020904541 length of segment : 411 time for calcul the mask position with numpy : 0.00039768218994140625 nb_pixel_total : 17668 time to create 1 rle with old method : 0.020238161087036133 length of segment : 173 time for calcul the mask position with numpy : 0.005229473114013672 nb_pixel_total : 175837 time to create 1 rle with new method : 0.006750345230102539 length of segment : 587 time for calcul the mask position with numpy : 0.0034761428833007812 nb_pixel_total : 103008 time to create 1 rle with old method : 0.12154078483581543 length of segment : 531 time for calcul the mask position with numpy : 0.00699162483215332 nb_pixel_total : 210376 time to create 1 rle with new method : 0.012415170669555664 length of segment : 877 time for calcul the mask position with numpy : 0.004206657409667969 nb_pixel_total : 131556 time to create 1 rle with old method : 0.15665411949157715 length of segment : 314 time for calcul the mask position with numpy : 0.0047457218170166016 nb_pixel_total : 107604 time to create 1 rle with old method : 0.13075757026672363 length of segment : 496 time for calcul the mask position with numpy : 0.0006842613220214844 nb_pixel_total : 22702 time to create 1 rle with old method : 0.026096343994140625 length of segment : 194 time for calcul the mask position with numpy : 0.0012145042419433594 nb_pixel_total : 21118 time to create 1 rle with old method : 0.02443695068359375 length of segment : 160 time for calcul the mask position with numpy : 0.0009992122650146484 nb_pixel_total : 43231 time to create 1 rle with old method : 0.05019116401672363 length of segment : 174 time for calcul the mask position with numpy : 0.0004558563232421875 nb_pixel_total : 18629 time to create 1 rle with old method : 0.021460294723510742 length of segment : 215 time for calcul the mask position with numpy : 0.0037271976470947266 nb_pixel_total : 135562 time to create 1 rle with old method : 0.18989300727844238 length of segment : 626 time for calcul the mask position with numpy : 0.0009233951568603516 nb_pixel_total : 25217 time to create 1 rle with old method : 0.031403541564941406 length of segment : 164 time for calcul the mask position with numpy : 0.00024771690368652344 nb_pixel_total : 7459 time to create 1 rle with old method : 0.009591817855834961 length of segment : 116 time for calcul the mask position with numpy : 0.00016880035400390625 nb_pixel_total : 6927 time to create 1 rle with old method : 0.008890151977539062 length of segment : 96 time spent for convertir_results : 11.239132642745972 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 88 chid ids of type : 3594 Number RLEs to save : 32150 save missing photos in datou_result : time spend for datou_step_exec : 71.6315062046051 time spend to save output : 2.019066095352173 total time spend for step 1 : 73.65057229995728 step2:crop_condition Mon May 26 16:51:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 88 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 61 About to insert : list_path_to_insert length 61 new photo from crops ! About to upload 61 photos upload in portfolio : 3736932 init cache_photo without model_param we have 61 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748271123_402258 we have uploaded 61 photos in the portfolio 3736932 time of upload the photos Elapsed time : 16.940640211105347 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748271142_402258 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3530128002166748 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 3736932 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748271158_402258 we have uploaded 17 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.430326223373413 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748271164_402258 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7800607681274414 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748271168_402258 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9118320941925049 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748271170_402258 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8012843132019043 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1361100484, 1361100436, 1361100375, 1361100297, 1361099917, 1361099872, 1361099809] Looping around the photos to save general results len do output : 88 /1361114714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361114832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100484', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100436', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100375', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100297', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361099917', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361099872', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361099809', None, None, None, None, None, '2955647') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 271 time used for this insertion : 0.03877902030944824 save_final save missing photos in datou_result : time spend for datou_step_exec : 67.97551703453064 time spend to save output : 0.04107928276062012 total time spend for step 2 : 68.01659631729126 step3:rle_unique_nms_with_priority Mon May 26 16:52:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 88 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ No data in photo_id : 1361100484 nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 9.36056900024414 time for calcul the mask position with numpy : 0.7760491371154785 nb_pixel_total : 6157861 time to create 1 rle with new method : 1.0784080028533936 time for calcul the mask position with numpy : 0.030023813247680664 nb_pixel_total : 212889 time to create 1 rle with new method : 0.9439051151275635 time for calcul the mask position with numpy : 0.027611732482910156 nb_pixel_total : 92145 time to create 1 rle with old method : 0.1033778190612793 time for calcul the mask position with numpy : 0.0271456241607666 nb_pixel_total : 23806 time to create 1 rle with old method : 0.02609395980834961 time for calcul the mask position with numpy : 0.032250404357910156 nb_pixel_total : 867788 time to create 1 rle with new method : 0.6590511798858643 time for calcul the mask position with numpy : 0.026690959930419922 nb_pixel_total : 47085 time to create 1 rle with old method : 0.053411245346069336 time for calcul the mask position with numpy : 0.029337644577026367 nb_pixel_total : 56755 time to create 1 rle with old method : 0.09279084205627441 time for calcul the mask position with numpy : 0.03708243370056152 nb_pixel_total : 261445 time to create 1 rle with new method : 1.2581360340118408 time for calcul the mask position with numpy : 0.028788089752197266 nb_pixel_total : 7583 time to create 1 rle with old method : 0.008993864059448242 time for calcul the mask position with numpy : 0.027703285217285156 nb_pixel_total : 24101 time to create 1 rle with old method : 0.027105331420898438 time for calcul the mask position with numpy : 0.02776622772216797 nb_pixel_total : 120861 time to create 1 rle with old method : 0.1374804973602295 time for calcul the mask position with numpy : 0.02812933921813965 nb_pixel_total : 15500 time to create 1 rle with old method : 0.018649816513061523 time for calcul the mask position with numpy : 0.029288768768310547 nb_pixel_total : 165846 time to create 1 rle with new method : 1.1317787170410156 time for calcul the mask position with numpy : 0.029036998748779297 nb_pixel_total : 126417 time to create 1 rle with old method : 0.1436910629272461 time for calcul the mask position with numpy : 0.027096986770629883 nb_pixel_total : 114318 time to create 1 rle with old method : 0.1267380714416504 create new chi : 7.151670217514038 time to delete rle : 0.01850152015686035 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 12485 TO DO : save crop sub photo not yet done ! save time : 0.8447561264038086 nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 8.720581531524658 time for calcul the mask position with numpy : 0.634009838104248 nb_pixel_total : 6791134 time to create 1 rle with new method : 0.8536362648010254 time for calcul the mask position with numpy : 0.02663731575012207 nb_pixel_total : 105181 time to create 1 rle with old method : 0.11889052391052246 time for calcul the mask position with numpy : 0.02856755256652832 nb_pixel_total : 68235 time to create 1 rle with old method : 0.07788300514221191 time for calcul the mask position with numpy : 0.027034759521484375 nb_pixel_total : 45654 time to create 1 rle with old method : 0.05033707618713379 time for calcul the mask position with numpy : 0.02540874481201172 nb_pixel_total : 38876 time to create 1 rle with old method : 0.043595075607299805 time for calcul the mask position with numpy : 0.027487754821777344 nb_pixel_total : 166903 time to create 1 rle with new method : 0.9079394340515137 time for calcul the mask position with numpy : 0.028151750564575195 nb_pixel_total : 19347 time to create 1 rle with old method : 0.021932601928710938 time for calcul the mask position with numpy : 0.02694559097290039 nb_pixel_total : 53388 time to create 1 rle with old method : 0.05956101417541504 time for calcul the mask position with numpy : 0.025679349899291992 nb_pixel_total : 28291 time to create 1 rle with old method : 0.039277076721191406 time for calcul the mask position with numpy : 0.03088665008544922 nb_pixel_total : 88657 time to create 1 rle with old method : 0.10871219635009766 time for calcul the mask position with numpy : 0.02747321128845215 nb_pixel_total : 38398 time to create 1 rle with old method : 0.05855822563171387 time for calcul the mask position with numpy : 0.02953052520751953 nb_pixel_total : 23568 time to create 1 rle with old method : 0.02672266960144043 time for calcul the mask position with numpy : 0.029585599899291992 nb_pixel_total : 121057 time to create 1 rle with old method : 0.13781380653381348 time for calcul the mask position with numpy : 0.028012752532958984 nb_pixel_total : 65993 time to create 1 rle with old method : 0.07424020767211914 time for calcul the mask position with numpy : 0.027193069458007812 nb_pixel_total : 137413 time to create 1 rle with old method : 0.1519761085510254 time for calcul the mask position with numpy : 0.02536797523498535 nb_pixel_total : 78785 time to create 1 rle with old method : 0.0875558853149414 time for calcul the mask position with numpy : 0.02943873405456543 nb_pixel_total : 47882 time to create 1 rle with old method : 0.05670785903930664 time for calcul the mask position with numpy : 0.028133153915405273 nb_pixel_total : 271597 time to create 1 rle with new method : 0.633312463760376 time for calcul the mask position with numpy : 0.02938532829284668 nb_pixel_total : 31865 time to create 1 rle with old method : 0.035714149475097656 time for calcul the mask position with numpy : 0.027126073837280273 nb_pixel_total : 21710 time to create 1 rle with old method : 0.025661706924438477 time for calcul the mask position with numpy : 0.030583858489990234 nb_pixel_total : 50466 time to create 1 rle with old method : 0.07506322860717773 create new chi : 4.9436280727386475 time to delete rle : 0.003248453140258789 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++Number RLEs to save : 19243 TO DO : save crop sub photo not yet done ! save time : 1.1539859771728516 nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 12.5830717086792 time for calcul the mask position with numpy : 0.7999413013458252 nb_pixel_total : 7111886 time to create 1 rle with new method : 0.8180224895477295 time for calcul the mask position with numpy : 0.04706168174743652 nb_pixel_total : 4124 time to create 1 rle with old method : 0.00494837760925293 time for calcul the mask position with numpy : 0.045091867446899414 nb_pixel_total : 49771 time to create 1 rle with old method : 0.06270694732666016 time for calcul the mask position with numpy : 0.041893720626831055 nb_pixel_total : 9004 time to create 1 rle with old method : 0.009963750839233398 time for calcul the mask position with numpy : 0.04750823974609375 nb_pixel_total : 326153 time to create 1 rle with new method : 0.7662994861602783 time for calcul the mask position with numpy : 0.0445554256439209 nb_pixel_total : 15689 time to create 1 rle with old method : 0.0175478458404541 time for calcul the mask position with numpy : 0.04781031608581543 nb_pixel_total : 96450 time to create 1 rle with old method : 0.1053924560546875 time for calcul the mask position with numpy : 0.04423046112060547 nb_pixel_total : 109498 time to create 1 rle with old method : 0.1187131404876709 time for calcul the mask position with numpy : 0.026057720184326172 nb_pixel_total : 9199 time to create 1 rle with old method : 0.010088443756103516 time for calcul the mask position with numpy : 0.02578449249267578 nb_pixel_total : 54978 time to create 1 rle with old method : 0.058930397033691406 time for calcul the mask position with numpy : 0.028274059295654297 nb_pixel_total : 59169 time to create 1 rle with old method : 0.06532907485961914 time for calcul the mask position with numpy : 0.025784015655517578 nb_pixel_total : 27671 time to create 1 rle with old method : 0.030953168869018555 time for calcul the mask position with numpy : 0.0270843505859375 nb_pixel_total : 71770 time to create 1 rle with old method : 0.07798337936401367 time for calcul the mask position with numpy : 0.0261995792388916 nb_pixel_total : 11450 time to create 1 rle with old method : 0.012724876403808594 time for calcul the mask position with numpy : 0.026948213577270508 nb_pixel_total : 53458 time to create 1 rle with old method : 0.05951642990112305 time for calcul the mask position with numpy : 0.030407190322875977 nb_pixel_total : 112848 time to create 1 rle with old method : 0.1246793270111084 time for calcul the mask position with numpy : 0.02455759048461914 nb_pixel_total : 8896 time to create 1 rle with old method : 0.009899377822875977 time for calcul the mask position with numpy : 0.027135610580444336 nb_pixel_total : 76641 time to create 1 rle with old method : 0.08489751815795898 time for calcul the mask position with numpy : 0.0296173095703125 nb_pixel_total : 25121 time to create 1 rle with old method : 0.0335078239440918 time for calcul the mask position with numpy : 0.030362844467163086 nb_pixel_total : 23249 time to create 1 rle with old method : 0.03183722496032715 time for calcul the mask position with numpy : 0.03134632110595703 nb_pixel_total : 37375 time to create 1 rle with old method : 0.04976987838745117 create new chi : 4.118899822235107 time to delete rle : 0.0023987293243408203 batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++++++Number RLEs to save : 15000 TO DO : save crop sub photo not yet done ! save time : 0.946774959564209 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 9.167850494384766 time for calcul the mask position with numpy : 0.4135749340057373 nb_pixel_total : 7064921 time to create 1 rle with new method : 1.10310959815979 time for calcul the mask position with numpy : 0.048216819763183594 nb_pixel_total : 16492 time to create 1 rle with old method : 0.023912668228149414 time for calcul the mask position with numpy : 0.04268360137939453 nb_pixel_total : 51780 time to create 1 rle with old method : 0.056542158126831055 time for calcul the mask position with numpy : 0.04334831237792969 nb_pixel_total : 11553 time to create 1 rle with old method : 0.013116121292114258 time for calcul the mask position with numpy : 0.04314279556274414 nb_pixel_total : 9193 time to create 1 rle with old method : 0.010459184646606445 time for calcul the mask position with numpy : 0.04509854316711426 nb_pixel_total : 157406 time to create 1 rle with new method : 0.92472243309021 time for calcul the mask position with numpy : 0.0405423641204834 nb_pixel_total : 37503 time to create 1 rle with old method : 0.04084372520446777 time for calcul the mask position with numpy : 0.04037928581237793 nb_pixel_total : 36266 time to create 1 rle with old method : 0.03929853439331055 time for calcul the mask position with numpy : 0.041106224060058594 nb_pixel_total : 7015 time to create 1 rle with old method : 0.007912397384643555 time for calcul the mask position with numpy : 0.04061436653137207 nb_pixel_total : 211066 time to create 1 rle with new method : 0.8215034008026123 time for calcul the mask position with numpy : 0.039621829986572266 nb_pixel_total : 22378 time to create 1 rle with old method : 0.024933338165283203 time for calcul the mask position with numpy : 0.03973889350891113 nb_pixel_total : 24388 time to create 1 rle with old method : 0.03258204460144043 time for calcul the mask position with numpy : 0.052384376525878906 nb_pixel_total : 56471 time to create 1 rle with old method : 0.07019376754760742 time for calcul the mask position with numpy : 0.03898429870605469 nb_pixel_total : 30551 time to create 1 rle with old method : 0.035846710205078125 time for calcul the mask position with numpy : 0.027016878128051758 nb_pixel_total : 13943 time to create 1 rle with old method : 0.014751911163330078 time for calcul the mask position with numpy : 0.042107582092285156 nb_pixel_total : 179282 time to create 1 rle with new method : 0.9622452259063721 time for calcul the mask position with numpy : 0.042999982833862305 nb_pixel_total : 90598 time to create 1 rle with old method : 0.10131382942199707 time for calcul the mask position with numpy : 0.04180288314819336 nb_pixel_total : 114594 time to create 1 rle with old method : 0.15806961059570312 time for calcul the mask position with numpy : 0.046524763107299805 nb_pixel_total : 159000 time to create 1 rle with new method : 0.5736939907073975 create new chi : 6.346855878829956 time to delete rle : 0.002144336700439453 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 13426 TO DO : save crop sub photo not yet done ! save time : 0.8150832653045654 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 8.720397233963013 time for calcul the mask position with numpy : 0.8114809989929199 nb_pixel_total : 6845587 time to create 1 rle with new method : 1.0067005157470703 time for calcul the mask position with numpy : 0.045716047286987305 nb_pixel_total : 69 time to create 1 rle with old method : 0.0001723766326904297 time for calcul the mask position with numpy : 0.04108715057373047 nb_pixel_total : 7458 time to create 1 rle with old method : 0.008405685424804688 time for calcul the mask position with numpy : 0.04094576835632324 nb_pixel_total : 25217 time to create 1 rle with old method : 0.028161287307739258 time for calcul the mask position with numpy : 0.03837013244628906 nb_pixel_total : 135562 time to create 1 rle with old method : 0.15023326873779297 time for calcul the mask position with numpy : 0.03843832015991211 nb_pixel_total : 18629 time to create 1 rle with old method : 0.023160934448242188 time for calcul the mask position with numpy : 0.029138565063476562 nb_pixel_total : 43231 time to create 1 rle with old method : 0.048370361328125 time for calcul the mask position with numpy : 0.026625871658325195 nb_pixel_total : 21118 time to create 1 rle with old method : 0.0260317325592041 time for calcul the mask position with numpy : 0.0349726676940918 nb_pixel_total : 22702 time to create 1 rle with old method : 0.026269912719726562 time for calcul the mask position with numpy : 0.04883456230163574 nb_pixel_total : 107604 time to create 1 rle with old method : 0.12176680564880371 time for calcul the mask position with numpy : 0.04370617866516113 nb_pixel_total : 131556 time to create 1 rle with old method : 0.37018275260925293 time for calcul the mask position with numpy : 0.044718265533447266 nb_pixel_total : 210376 time to create 1 rle with new method : 0.9238553047180176 time for calcul the mask position with numpy : 0.04220771789550781 nb_pixel_total : 103008 time to create 1 rle with old method : 0.1143949031829834 time for calcul the mask position with numpy : 0.03871035575866699 nb_pixel_total : 175837 time to create 1 rle with new method : 1.0206387042999268 time for calcul the mask position with numpy : 0.03496885299682617 nb_pixel_total : 17668 time to create 1 rle with old method : 0.020040512084960938 time for calcul the mask position with numpy : 0.028235435485839844 nb_pixel_total : 139880 time to create 1 rle with old method : 0.1542649269104004 time for calcul the mask position with numpy : 0.028505325317382812 nb_pixel_total : 288898 time to create 1 rle with new method : 1.0263400077819824 create new chi : 6.630340576171875 time to delete rle : 0.0033752918243408203 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 13539 TO DO : save crop sub photo not yet done ! save time : 0.8155739307403564 No data in photo_id : 1361099809 map_output_result : {1361100484: (0.0, 'Should be the crop_list due to order', 0.0), 1361100436: (0.0, 'Should be the crop_list due to order', 0), 1361100375: (0.0, 'Should be the crop_list due to order', 0), 1361100297: (0.0, 'Should be the crop_list due to order', 0), 1361099917: (0.0, 'Should be the crop_list due to order', 0), 1361099872: (0.0, 'Should be the crop_list due to order', 0), 1361099809: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1361100484, 1361100436, 1361100375, 1361100297, 1361099917, 1361099872, 1361099809] Looping around the photos to save general results len do output : 7 /1361100484.Didn't retrieve data . /1361100436.Didn't retrieve data . /1361100375.Didn't retrieve data . /1361100297.Didn't retrieve data . /1361099917.Didn't retrieve data . /1361099872.Didn't retrieve data . /1361099809.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100484', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100436', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100375', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100297', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361099917', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361099872', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361099809', None, None, None, None, None, '2955647') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.012755870819091797 save_final save missing photos in datou_result : time spend for datou_step_exec : 83.27277541160583 time spend to save output : 0.013231039047241211 total time spend for step 3 : 83.28600645065308 step4:ventilate_hashtags_in_portfolio Mon May 26 16:54:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23344698 get user id for portfolio 23344698 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23344698 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','carton','pet_fonce','mal_croppe','papier','autre','pehd','flou','background','environnement','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23344698 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','carton','pet_fonce','mal_croppe','papier','autre','pehd','flou','background','environnement','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23344698 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','carton','pet_fonce','mal_croppe','papier','autre','pehd','flou','background','environnement','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23346164,23346165,23346166,23346167,23346168,23346169,23346170,23346171,23346172,23346173,23346174?tags=metal,carton,pet_fonce,mal_croppe,papier,autre,pehd,flou,background,environnement,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1361100484, 1361100436, 1361100375, 1361100297, 1361099917, 1361099872, 1361099809] Looping around the photos to save general results len do output : 1 /23344698. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100484', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100436', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100375', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100297', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361099917', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361099872', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361099809', None, None, None, None, None, '2955647') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.013521909713745117 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.531822681427002 time spend to save output : 0.014000654220581055 total time spend for step 4 : 1.545823335647583 step5:final Mon May 26 16:54:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1361100484: ('0.1291854573137125',), 1361100436: ('0.1291854573137125',), 1361100375: ('0.1291854573137125',), 1361100297: ('0.1291854573137125',), 1361099917: ('0.1291854573137125',), 1361099872: ('0.1291854573137125',), 1361099809: ('0.1291854573137125',)} new output for save of step final : {1361100484: ('0.1291854573137125',), 1361100436: ('0.1291854573137125',), 1361100375: ('0.1291854573137125',), 1361100297: ('0.1291854573137125',), 1361099917: ('0.1291854573137125',), 1361099872: ('0.1291854573137125',), 1361099809: ('0.1291854573137125',)} [1361100484, 1361100436, 1361100375, 1361100297, 1361099917, 1361099872, 1361099809] Looping around the photos to save general results len do output : 7 /1361100484.Didn't retrieve data . /1361100436.Didn't retrieve data . /1361100375.Didn't retrieve data . /1361100297.Didn't retrieve data . /1361099917.Didn't retrieve data . /1361099872.Didn't retrieve data . /1361099809.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100484', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100436', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100375', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100297', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361099917', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361099872', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361099809', None, None, None, None, None, '2955647') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.013702869415283203 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10959649085998535 time spend to save output : 0.014240741729736328 total time spend for step 5 : 0.12383723258972168 step6:blur_detection Mon May 26 16:54:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1748271028_402258_1361100484_7dfb8a8aaf59ba3d262066be6a30c7d1.jpg resize: (2160, 3840) 1361100484 -5.626561528222301 treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195.jpg resize: (2160, 3840) 1361100436 -5.745128332060183 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38.jpg resize: (2160, 3840) 1361100375 -5.691040948321064 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732.jpg resize: (2160, 3840) 1361100297 -5.815132767310385 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965.jpg resize: (2160, 3840) 1361099917 -5.973764492965687 treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b.jpg resize: (2160, 3840) 1361099872 -5.678643317353458 treat image : temp/1748271028_402258_1361099809_b9c626f9f4c2c6109f6f4d3b0aa38f4c.jpg resize: (2160, 3840) 1361099809 -5.2089799017407685 treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262916_0.png resize: (404, 502) 1361114714 -1.976806034560815 treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262917_0.png resize: (268, 644) 1361114715 -3.195345039684031 treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262919_0.png resize: (191, 153) 1361114716 -3.6096395617919326 treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262921_0.png resize: (297, 97) 1361114717 -4.531225748767654 treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262922_0.png resize: (116, 176) 1361114718 -2.493521670082336 treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262927_0.png resize: (387, 108) 1361114719 -3.8277729062579837 treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262929_0.png resize: (452, 636) 1361114720 -2.0182810763889094 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262930_0.png resize: (608, 160) 1361114721 -2.6792123566357584 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262931_0.png resize: (364, 239) 1361114722 -3.251516867096051 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262933_0.png resize: (698, 728) 1361114723 -2.898301965787545 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262934_0.png resize: (429, 183) 1361114725 -3.6500669776819654 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262937_0.png resize: (496, 201) 1361114726 -3.1673925956017914 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262938_0.png resize: (319, 541) 1361114727 -4.026012196910149 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262939_0.png resize: (223, 231) 1361114728 -3.4777274318888125 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262940_0.png resize: (178, 267) 1361114729 -3.655062569017675 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262944_0.png resize: (248, 153) 1361114730 -3.212961108827452 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262945_0.png resize: (425, 626) 1361114731 -2.701879571186174 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262946_0.png resize: (184, 330) 1361114732 -2.9730576347966946 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262947_0.png resize: (319, 189) 1361114733 -4.509013872025868 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262948_0.png resize: (404, 263) 1361114734 -0.9070349140549676 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262949_0.png resize: (628, 330) 1361114735 -3.297959404840123 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262950_0.png resize: (266, 204) 1361114736 -2.715314116758923 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262951_0.png resize: (212, 168) 1361114737 -3.5927500197766657 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262952_0.png resize: (204, 160) 1361114738 -3.2371007951467976 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262954_0.png resize: (120, 142) 1361114739 -1.8468002839312119 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262955_0.png resize: (455, 610) 1361114740 -3.6754149475145748 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262956_0.png resize: (223, 429) 1361114741 -3.32791339381586 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262959_0.png resize: (272, 188) 1361114742 -2.5270559794104503 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262961_0.png resize: (320, 306) 1361114743 -3.5720697735764477 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262962_0.png resize: (119, 119) 1361114744 -3.7096213749636466 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262965_0.png resize: (256, 150) 1361114745 -3.4384429687182156 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262967_0.png resize: (100, 124) 1361114746 -2.6823814356708398 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262969_0.png resize: (277, 478) 1361114747 -2.626217368402236 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262970_0.png resize: (566, 498) 1361114748 -3.978148792614096 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262971_0.png resize: (400, 459) 1361114749 -1.2690755141164363 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262972_0.png resize: (310, 436) 1361114750 -4.18017826859753 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262974_0.png resize: (129, 173) 1361114751 -2.732267992634502 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262975_0.png resize: (146, 301) 1361114752 -4.520212831234142 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262976_0.png resize: (273, 370) 1361114753 -0.0831465528048402 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262977_0.png resize: (194, 170) 1361114754 -3.083618195736007 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262978_0.png resize: (254, 104) 1361114755 -3.6158165810757574 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262980_0.png resize: (206, 107) 1361114756 -3.1417833258896786 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262981_0.png resize: (221, 240) 1361114757 -3.842978691694948 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262982_0.png resize: (297, 187) 1361114758 -1.3149079659479956 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262983_0.png resize: (484, 410) 1361114759 -3.4736063293270303 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262984_0.png resize: (151, 91) 1361114760 -4.136264712890896 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262985_0.png resize: (159, 96) 1361114761 -1.5669723004300251 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262987_0.png resize: (195, 172) 1361114763 -3.5466180585626095 treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262988_0.png resize: (652, 565) 1361114764 2.3871172812349886 treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262989_0.png resize: (396, 563) 1361114765 -3.7737701024110493 treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262990_0.png resize: (173, 149) 1361114766 -1.627708988269905 treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262992_0.png resize: (518, 267) 1361114768 -2.626730740036602 treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262993_0.png resize: (609, 534) 1361114769 -4.088222315050318 treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262996_0.png resize: (193, 241) 1361114770 -2.2806839248203383 treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262997_0.png resize: (160, 254) 1361114771 -3.1532675335606766 treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262998_0.png resize: (171, 292) 1361114772 -1.3988839165493185 treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262999_0.png resize: (173, 171) 1361114773 -2.4291142879418626 treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813263000_0.png resize: (625, 306) 1361114774 -4.402905718984774 treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813263001_0.png resize: (145, 241) 1361114775 -3.969390319070328 treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813263002_0.png resize: (116, 101) 1361114776 -2.8721986077041572 treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813263003_0.png resize: (80, 122) 1361114777 -3.420284532007322 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262957_0.png resize: (115, 140) 1361114781 -1.6849571858630994 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262963_0.png resize: (386, 427) 1361114782 -3.301450623565337 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262968_0.png resize: (254, 294) 1361114783 -4.395948259229498 treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262994_0.png resize: (299, 532) 1361114784 -4.209060120394173 treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262918_0.png resize: (471, 472) 1361114798 -3.79009237153523 treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262920_0.png resize: (189, 912) 1361114799 -3.794245866486028 treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262925_0.png resize: (151, 448) 1361114800 -2.67640538468497 treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262926_0.png resize: (920, 1325) 1361114801 -2.3308027870318444 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262935_0.png resize: (335, 321) 1361114802 -4.4929284044250295 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262936_0.png resize: (369, 492) 1361114803 -2.566230104875327 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262941_0.png resize: (524, 262) 1361114804 -3.263140617943492 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262942_0.png resize: (184, 189) 1361114805 -3.2762528940265203 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262953_0.png resize: (196, 523) 1361114806 -3.2927567587658055 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262958_0.png resize: (228, 424) 1361114807 -3.322333922376785 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262960_0.png resize: (371, 231) 1361114808 -4.9571201143371715 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262964_0.png resize: (314, 481) 1361114809 -3.1012977475298666 treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262966_0.png resize: (791, 794) 1361114810 -4.344343697120117 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262973_0.png resize: (519, 479) 1361114811 -4.5080319697427615 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262979_0.png resize: (600, 436) 1361114812 -3.4785155273190176 treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262991_0.png resize: (585, 431) 1361114813 -3.9765985323155517 treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262995_0.png resize: (475, 431) 1361114814 -3.456441703744739 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262932_0.png resize: (210, 220) 1361114816 -4.474711220978714 treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262943_0.png resize: (321, 244) 1361114817 -3.341204557233971 treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262923_0.png resize: (641, 487) 1361114826 0.5373269709933945 treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262928_0.png resize: (364, 307) 1361114827 -2.839751303759302 treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262924_0.png resize: (155, 441) 1361114831 -2.914835033057439 treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262986_0.png resize: (240, 269) 1361114832 -3.004493714019881 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 95 time used for this insertion : 0.01563096046447754 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 95 time used for this insertion : 0.014890670776367188 save missing photos in datou_result : time spend for datou_step_exec : 32.468212604522705 time spend to save output : 0.03507637977600098 total time spend for step 6 : 32.503288984298706 step7:brightness Mon May 26 16:54:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1748271028_402258_1361100484_7dfb8a8aaf59ba3d262066be6a30c7d1.jpg treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195.jpg treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38.jpg treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732.jpg treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965.jpg treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b.jpg treat image : temp/1748271028_402258_1361099809_b9c626f9f4c2c6109f6f4d3b0aa38f4c.jpg treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262916_0.png treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262917_0.png treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262919_0.png treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262921_0.png treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262922_0.png treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262927_0.png treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262929_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262930_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262931_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262933_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262934_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262937_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262938_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262939_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262940_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262944_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262945_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262946_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262947_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262948_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262949_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262950_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262951_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262952_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262954_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262955_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262956_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262959_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262961_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262962_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262965_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262967_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262969_0.png treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262970_0.png treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262971_0.png treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262972_0.png treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262974_0.png treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262975_0.png treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262976_0.png treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262977_0.png treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262978_0.png treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262980_0.png treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262981_0.png treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262982_0.png treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262983_0.png treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262984_0.png treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262985_0.png treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262987_0.png treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262988_0.png treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262989_0.png treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262990_0.png treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262992_0.png treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262993_0.png treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262996_0.png treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262997_0.png treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262998_0.png treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262999_0.png treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813263000_0.png treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813263001_0.png treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813263002_0.png treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813263003_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262957_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262963_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262968_0.png treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262994_0.png treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262918_0.png treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262920_0.png treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262925_0.png treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262926_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262935_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262936_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262941_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262942_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262953_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262958_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262960_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262964_0.png treat image : temp/1748271028_402258_1361100297_41998855d44371c42247d05e96f2a732_rle_crop_3813262966_0.png treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262973_0.png treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262979_0.png treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262991_0.png treat image : temp/1748271028_402258_1361099872_c55294b350f69f6fc2308f7acde4847b_rle_crop_3813262995_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262932_0.png treat image : temp/1748271028_402258_1361100375_c2671f9a7095e6446b0fcdae3a81fb38_rle_crop_3813262943_0.png treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262923_0.png treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262928_0.png treat image : temp/1748271028_402258_1361100436_053c05cf024b48e6cfc7fd502e332195_rle_crop_3813262924_0.png treat image : temp/1748271028_402258_1361099917_8c3ac2899926509fbc5c06e5131b2965_rle_crop_3813262986_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 95 time used for this insertion : 0.01530766487121582 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 95 time used for this insertion : 0.015263080596923828 save missing photos in datou_result : time spend for datou_step_exec : 7.494966983795166 time spend to save output : 0.035300493240356445 total time spend for step 7 : 7.5302674770355225 step8:velours_tree Mon May 26 16:54:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.14371228218078613 time spend to save output : 3.552436828613281e-05 total time spend for step 8 : 0.14374780654907227 step9:send_mail_cod Mon May 26 16:54:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23344698_26-05-2025_16_54_56.pdf 23346164 imagette233461641748271296 23346165 change filename to text .change filename to text .change filename to text .change filename to text .imagette233461651748271296 23346166 change filename to text .change filename to text .imagette233461661748271296 23346167 imagette233461671748271296 23346168 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233461681748271296 23346169 change filename to text .change filename to text .imagette233461691748271298 23346170 change filename to text .change filename to text .imagette233461701748271298 23346171 imagette233461711748271298 23346172 imagette233461721748271298 23346174 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233461741748271298 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23344698 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23346164,23346165,23346166,23346167,23346168,23346169,23346170,23346171,23346172,23346173,23346174?tags=metal,carton,pet_fonce,mal_croppe,papier,autre,pehd,flou,background,environnement,pet_clair args[1361100484] : ((1361100484, -5.626561528222301, 492609224), (1361100484, 0.6183349831229632, 2107752395), '0.1291854573137125') We are sending mail with results at report@fotonower.com args[1361100436] : ((1361100436, -5.745128332060183, 492609224), (1361100436, 0.5626494913429704, 2107752395), '0.1291854573137125') We are sending mail with results at report@fotonower.com args[1361100375] : ((1361100375, -5.691040948321064, 492609224), (1361100375, 0.8351045640046981, 2107752395), '0.1291854573137125') We are sending mail with results at report@fotonower.com args[1361100297] : ((1361100297, -5.815132767310385, 492609224), (1361100297, 0.6932096263638451, 2107752395), '0.1291854573137125') We are sending mail with results at report@fotonower.com args[1361099917] : ((1361099917, -5.973764492965687, 492609224), (1361099917, 0.7079905467187206, 2107752395), '0.1291854573137125') We are sending mail with results at report@fotonower.com args[1361099872] : ((1361099872, -5.678643317353458, 492609224), (1361099872, 0.6599232846880567, 2107752395), '0.1291854573137125') We are sending mail with results at report@fotonower.com args[1361099809] : ((1361099809, -5.2089799017407685, 492609224), (1361099809, 0.04204608707144518, 2107752395), '0.1291854573137125') We are sending mail with results at report@fotonower.com refus_total : 0.1291854573137125 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23344698 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23344698_26-05-2025_16_54_56.pdf results_Auto_P23344698_26-05-2025_16_54_56.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23344698_26-05-2025_16_54_56.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23344698','results_Auto_P23344698_26-05-2025_16_54_56.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23344698_26-05-2025_16_54_56.pdf','pdf','','0.77','0.1291854573137125') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23344698

https://www.fotonower.com/image?json=false&list_photos_id=1361100484
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361100436
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361100375
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361100297
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361099917
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361099872
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361099809
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.92%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/23346165?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23346166?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23346168?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23346169?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/23346170?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23346174?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23344698_26-05-2025_16_54_56.pdf.

Lien vers velours :https://www.fotonower.com/velours/23346164,23346165,23346166,23346167,23346168,23346169,23346170,23346171,23346172,23346173,23346174?tags=metal,carton,pet_fonce,mal_croppe,papier,autre,pehd,flou,background,environnement,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 26 May 2025 14:55:03 GMT Content-Length: 0 Connection: close X-Message-Id: 0w-IIaa6SXe0_1genYoMyQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1361100484, 1361100436, 1361100375, 1361100297, 1361099917, 1361099872, 1361099809] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100484', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100436', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100375', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100297', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361099917', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361099872', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361099809', None, None, None, None, None, '2955647') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.012982368469238281 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.7627410888671875 time spend to save output : 0.013196468353271484 total time spend for step 9 : 6.775937557220459 step10:split_time_score Mon May 26 16:55:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 7),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 26052025 23344698 Nombre de photos uploadées : 7 / 23040 (0%) 26052025 23344698 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 26052025 23344698 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 3.814697265625e-06 elapsed_time : order_list_meta_photo_and_scores 9.775161743164062e-06 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.0004439353942871094 elapsed_time : insert_dashboard_record_day_entry 0.02349376678466797 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344668 order by id desc limit 1 Qualite : 0.10631123107156629 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23331064_26-05-2025_13_10_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23331064 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23331064 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23331066 order by id desc limit 1 Qualite : 0.09622099389524323 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23331105_26-05-2025_15_13_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23331105 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23331105 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23328666 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23328671 order by id desc limit 1 Qualite : 0.1437267627398686 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339058 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339058 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339060 order by id desc limit 1 Qualite : 0.10856602044753087 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339062_26-05-2025_15_34_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339062 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339062 AND mptpi.`type`=3594 To do Qualite : 0.12075810185185182 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339075_26-05-2025_15_29_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339075 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339075 AND mptpi.`type`=3594 To do Qualite : 0.11833079346707819 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339078_26-05-2025_15_20_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339078 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339078 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339082 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339099 order by id desc limit 1 Qualite : 0.1057252148705418 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23342743_26-05-2025_16_36_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23342743 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23342743 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23342745 order by id desc limit 1 Qualite : 0.11492990451388885 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23342759_26-05-2025_16_32_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23342759 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23342759 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344670 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344672 order by id desc limit 1 Qualite : 0.1291854573137125 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23344698_26-05-2025_16_54_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344698 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23344698 AND mptpi.`type`=3594 To do Qualite : 0.10039044013631691 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23344701_26-05-2025_16_50_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344701 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23344701 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'26052025': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1361100484, 1361100436, 1361100375, 1361100297, 1361099917, 1361099872, 1361099809] Looping around the photos to save general results len do output : 1 /23344698Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100484', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100436', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100375', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361100297', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361099917', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361099872', None, None, None, None, None, '2955647') ('3318', None, None, None, None, None, None, None, '2955647') ('3318', '23344698', '1361099809', None, None, None, None, None, '2955647') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.013349294662475586 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.707022428512573 time spend to save output : 0.01351618766784668 total time spend for step 10 : 10.72053861618042 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 124.60user 119.25system 4:49.72elapsed 84%CPU (0avgtext+0avgdata 4846196maxresident)k 744216inputs+121680outputs (11513major+11262880minor)pagefaults 0swaps