python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 3459 -l 10 ' -s datou_current_3459 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 534737 load datou : 3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? id de la photo (peut être local ou global) was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? id de la photo (peut être local ou global) was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (4999, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 16384, 25088, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'res5b', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2020, 10, 23, 14, 27, 22), datetime.datetime(2020, 10, 23, 14, 27, 22)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5288, 'learn_papier_nantes_300421', 512, 512, 'learn_papier_nantes_300421', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 30, 17, 9, 41), datetime.datetime(2021, 4, 30, 17, 9, 41)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5309, 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 16384, 25088, 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 5, 10, 19, 20, 46), datetime.datetime(2021, 5, 10, 19, 20, 46)) load thcls load THCL from format json or kwargs add thcl : 2456 in CacheModelConfig load THCL from format json or kwargs add thcl : 2868 in CacheModelConfig load THCL from format json or kwargs add thcl : 2896 in CacheModelConfig load pdts add pdt : 4999 in CacheModelConfig add pdt : 5288 in CacheModelConfig add pdt : 5309 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 206>10 please execute split_portfolio.py -i 20042942 -l 10 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 3459, datou_cur_ids : ['2525967'] with mtr_portfolio_ids : ['20042942'] and first list_photo_ids : [] new path : /proc/534737/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, thcl, merge_mask_thcl_custom, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 2.4037978649139404 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Fri Feb 7 18:16:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 721 wait 20 seconds l 3637 free memory gpu now : 721 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-07 18:16:54.400337: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-07 18:16:54.427141: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-07 18:16:54.429193: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7facd8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-07 18:16:54.429224: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-07 18:16:54.433104: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-07 18:16:54.574978: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xf7dddc0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-07 18:16:54.575037: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-07 18:16:54.575757: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-07 18:16:54.576212: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-07 18:16:54.579305: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-07 18:16:54.582316: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-07 18:16:54.582815: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-07 18:16:54.585475: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-07 18:16:54.586599: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-07 18:16:54.597201: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-07 18:16:54.598608: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-07 18:16:54.598752: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-07 18:16:54.599539: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-07 18:16:54.599567: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-07 18:16:54.599583: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-07 18:16:54.600670: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 125 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-07 18:16:54.912081: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-07 18:16:54.912172: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-07 18:16:54.912195: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-07 18:16:54.912212: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-07 18:16:54.912226: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-07 18:16:54.912241: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-07 18:16:54.912261: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-07 18:16:54.912278: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-07 18:16:54.912986: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-07 18:16:54.913783: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-07 18:16:54.913811: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-07 18:16:54.913833: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-07 18:16:54.913849: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-07 18:16:54.913862: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-07 18:16:54.913876: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-07 18:16:54.913894: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-07 18:16:54.913912: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-07 18:16:54.914608: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-07 18:16:54.914637: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-07 18:16:54.914648: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-07 18:16:54.914656: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-07 18:16:54.915414: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 125 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) 2025-02-07 18:17:06.818558: W tensorflow/core/common_runtime/bfc_allocator.cc:434] Allocator (GPU_0_bfc) ran out of memory trying to allocate 9.00MiB (rounded to 9437184) Current allocation summary follows. 2025-02-07 18:17:06.818634: I tensorflow/core/common_runtime/bfc_allocator.cc:934] BFCAllocator dump for GPU_0_bfc 2025-02-07 18:17:06.818654: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (256): Total Chunks: 59, Chunks in use: 59. 14.8KiB allocated for chunks. 14.8KiB in use in bin. 8.8KiB client-requested in use in bin. 2025-02-07 18:17:06.818670: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (512): Total Chunks: 40, Chunks in use: 40. 20.0KiB allocated for chunks. 20.0KiB in use in bin. 20.0KiB client-requested in use in bin. 2025-02-07 18:17:06.818702: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1024): Total Chunks: 251, Chunks in use: 251. 251.2KiB allocated for chunks. 251.2KiB in use in bin. 251.0KiB client-requested in use in bin. 2025-02-07 18:17:06.818718: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2048): Total Chunks: 30, Chunks in use: 30. 60.0KiB allocated for chunks. 60.0KiB in use in bin. 60.0KiB client-requested in use in bin. 2025-02-07 18:17:06.818733: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4096): Total Chunks: 120, Chunks in use: 120. 487.5KiB allocated for chunks. 487.5KiB in use in bin. 480.0KiB client-requested in use in bin. 2025-02-07 18:17:06.818747: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8192): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-02-07 18:17:06.818762: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16384): Total Chunks: 1, Chunks in use: 1. 16.0KiB allocated for chunks. 16.0KiB in use in bin. 16.0KiB client-requested in use in bin. 2025-02-07 18:17:06.818776: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (32768): Total Chunks: 1, Chunks in use: 1. 36.8KiB allocated for chunks. 36.8KiB in use in bin. 36.8KiB client-requested in use in bin. 2025-02-07 18:17:06.818791: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (65536): Total Chunks: 6, Chunks in use: 6. 384.0KiB allocated for chunks. 384.0KiB in use in bin. 384.0KiB client-requested in use in bin. 2025-02-07 18:17:06.818806: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (131072): Total Chunks: 4, Chunks in use: 4. 560.0KiB allocated for chunks. 560.0KiB in use in bin. 560.0KiB client-requested in use in bin. 2025-02-07 18:17:06.818821: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (262144): Total Chunks: 7, Chunks in use: 7. 1.91MiB allocated for chunks. 1.91MiB in use in bin. 1.75MiB client-requested in use in bin. 2025-02-07 18:17:06.818835: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (524288): Total Chunks: 8, Chunks in use: 6. 4.93MiB allocated for chunks. 3.44MiB in use in bin. 3.25MiB client-requested in use in bin. 2025-02-07 18:17:06.818850: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1048576): Total Chunks: 48, Chunks in use: 45. 54.12MiB allocated for chunks. 50.62MiB in use in bin. 45.00MiB client-requested in use in bin. 2025-02-07 18:17:06.818865: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2097152): Total Chunks: 28, Chunks in use: 25. 63.12MiB allocated for chunks. 55.75MiB in use in bin. 55.75MiB client-requested in use in bin. 2025-02-07 18:17:06.818878: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4194304): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-02-07 18:17:06.818891: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8388608): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-02-07 18:17:06.818917: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16777216): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-02-07 18:17:06.818930: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (33554432): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-02-07 18:17:06.818943: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (67108864): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-02-07 18:17:06.818956: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (134217728): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-02-07 18:17:06.818969: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (268435456): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-02-07 18:17:06.818991: I tensorflow/core/common_runtime/bfc_allocator.cc:957] Bin for 9.00MiB was 8.00MiB, Chunk State: 2025-02-07 18:17:06.819003: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 65929216 2025-02-07 18:17:06.819020: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf2000000 of size 2359296 next 370 2025-02-07 18:17:06.819032: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf2240000 of size 1048576 next 394 2025-02-07 18:17:06.819044: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7faaf2340000 of size 1310720 next 388 2025-02-07 18:17:06.819055: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf2480000 of size 2359296 next 387 2025-02-07 18:17:06.819067: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf26c0000 of size 1048576 next 412 2025-02-07 18:17:06.819079: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf27c0000 of size 1310720 next 406 2025-02-07 18:17:06.819090: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf2900000 of size 2359296 next 405 2025-02-07 18:17:06.819102: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf2b40000 of size 1048576 next 430 2025-02-07 18:17:06.819113: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf2c40000 of size 1310720 next 424 2025-02-07 18:17:06.819125: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf2d80000 of size 2359296 next 423 2025-02-07 18:17:06.819136: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf2fc0000 of size 1048576 next 447 2025-02-07 18:17:06.819147: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf30c0000 of size 1310720 next 441 2025-02-07 18:17:06.819159: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf3200000 of size 2359296 next 440 2025-02-07 18:17:06.819170: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf3440000 of size 1048576 next 465 2025-02-07 18:17:06.819182: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf3540000 of size 1310720 next 459 2025-02-07 18:17:06.819193: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf3680000 of size 2359296 next 458 2025-02-07 18:17:06.819204: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf38c0000 of size 1048576 next 483 2025-02-07 18:17:06.819216: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf39c0000 of size 1310720 next 477 2025-02-07 18:17:06.819227: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf3b00000 of size 2359296 next 476 2025-02-07 18:17:06.819238: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf3d40000 of size 1048576 next 501 2025-02-07 18:17:06.819250: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf3e40000 of size 1310720 next 495 2025-02-07 18:17:06.819261: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf3f80000 of size 2359296 next 494 2025-02-07 18:17:06.819272: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf41c0000 of size 1048576 next 519 2025-02-07 18:17:06.819284: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf42c0000 of size 1310720 next 513 2025-02-07 18:17:06.819295: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf4400000 of size 2359296 next 512 2025-02-07 18:17:06.819307: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf4640000 of size 1048576 next 537 2025-02-07 18:17:06.819318: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf4740000 of size 1310720 next 531 2025-02-07 18:17:06.819329: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf4880000 of size 2359296 next 530 2025-02-07 18:17:06.819341: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf4ac0000 of size 1048576 next 555 2025-02-07 18:17:06.819360: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf4bc0000 of size 1310720 next 549 2025-02-07 18:17:06.819372: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf4d00000 of size 2359296 next 548 2025-02-07 18:17:06.819384: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf4f40000 of size 1048576 next 573 2025-02-07 18:17:06.819395: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf5040000 of size 1310720 next 567 2025-02-07 18:17:06.819406: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf5180000 of size 2359296 next 566 2025-02-07 18:17:06.819418: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf53c0000 of size 1048576 next 591 2025-02-07 18:17:06.819429: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7faaf54c0000 of size 1310720 next 585 2025-02-07 18:17:06.819440: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf5600000 of size 2359296 next 584 2025-02-07 18:17:06.819452: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7faaf5840000 of size 2097152 next 597 2025-02-07 18:17:06.819463: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf5a40000 of size 2097152 next 596 2025-02-07 18:17:06.819475: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7faaf5c40000 of size 2752512 next 18446744073709551615 2025-02-07 18:17:06.819487: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 33554432 2025-02-07 18:17:06.819498: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf6000000 of size 2359296 next 245 2025-02-07 18:17:06.819509: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf6240000 of size 1048576 next 269 2025-02-07 18:17:06.819521: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf6340000 of size 1310720 next 263 2025-02-07 18:17:06.819532: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf6480000 of size 2359296 next 262 2025-02-07 18:17:06.819544: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf66c0000 of size 1048576 next 287 2025-02-07 18:17:06.819555: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf67c0000 of size 1310720 next 281 2025-02-07 18:17:06.819566: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf6900000 of size 2359296 next 280 2025-02-07 18:17:06.819578: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf6b40000 of size 1048576 next 304 2025-02-07 18:17:06.819589: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf6c40000 of size 1310720 next 298 2025-02-07 18:17:06.819600: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf6d80000 of size 2359296 next 297 2025-02-07 18:17:06.819612: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf6fc0000 of size 1048576 next 322 2025-02-07 18:17:06.819623: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf70c0000 of size 1310720 next 316 2025-02-07 18:17:06.819634: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf7200000 of size 2359296 next 315 2025-02-07 18:17:06.819645: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf7440000 of size 1048576 next 340 2025-02-07 18:17:06.819657: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf7540000 of size 1310720 next 334 2025-02-07 18:17:06.819668: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf7680000 of size 2359296 next 333 2025-02-07 18:17:06.819679: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf78c0000 of size 1048576 next 358 2025-02-07 18:17:06.819691: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf79c0000 of size 1310720 next 352 2025-02-07 18:17:06.819702: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf7b00000 of size 2359296 next 351 2025-02-07 18:17:06.819721: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf7d40000 of size 1048576 next 376 2025-02-07 18:17:06.819733: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf7e40000 of size 1835008 next 18446744073709551615 2025-02-07 18:17:06.819744: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 16777216 2025-02-07 18:17:06.819756: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf8000000 of size 2359296 next 181 2025-02-07 18:17:06.819767: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf8240000 of size 2097152 next 196 2025-02-07 18:17:06.819779: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf8440000 of size 1048576 next 216 2025-02-07 18:17:06.819790: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf8540000 of size 1310720 next 209 2025-02-07 18:17:06.819802: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf8680000 of size 2359296 next 208 2025-02-07 18:17:06.819813: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf88c0000 of size 1048576 next 234 2025-02-07 18:17:06.819824: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf89c0000 of size 1310720 next 228 2025-02-07 18:17:06.819836: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faaf8b00000 of size 2359296 next 227 2025-02-07 18:17:06.819847: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7faaf8d40000 of size 2883584 next 18446744073709551615 2025-02-07 18:17:06.819858: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 2097152 2025-02-07 18:17:06.819870: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa600000 of size 147456 next 55 2025-02-07 18:17:06.819882: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa624000 of size 65536 next 78 2025-02-07 18:17:06.819893: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa634000 of size 4096 next 191 2025-02-07 18:17:06.819905: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa635000 of size 4096 next 192 2025-02-07 18:17:06.819916: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa636000 of size 4096 next 193 2025-02-07 18:17:06.819928: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa637000 of size 256 next 194 2025-02-07 18:17:06.819939: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa637100 of size 256 next 195 2025-02-07 18:17:06.819951: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa637200 of size 4096 next 197 2025-02-07 18:17:06.819962: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa638200 of size 4096 next 198 2025-02-07 18:17:06.819973: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa639200 of size 4096 next 199 2025-02-07 18:17:06.819985: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa63a200 of size 4096 next 200 2025-02-07 18:17:06.819996: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa63b200 of size 4096 next 201 2025-02-07 18:17:06.820008: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa63c200 of size 1024 next 202 2025-02-07 18:17:06.820019: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa63c600 of size 1024 next 204 2025-02-07 18:17:06.820031: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa63ca00 of size 1024 next 205 2025-02-07 18:17:06.820042: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa63ce00 of size 1024 next 206 2025-02-07 18:17:06.820053: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa63d200 of size 1024 next 207 2025-02-07 18:17:06.820065: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa63d600 of size 1024 next 210 2025-02-07 18:17:06.820076: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa63da00 of size 1024 next 211 2025-02-07 18:17:06.820095: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa63de00 of size 1024 next 212 2025-02-07 18:17:06.820107: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa63e200 of size 1024 next 213 2025-02-07 18:17:06.820118: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa63e600 of size 1024 next 214 2025-02-07 18:17:06.820130: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa63ea00 of size 4096 next 215 2025-02-07 18:17:06.820141: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa63fa00 of size 4096 next 217 2025-02-07 18:17:06.820152: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa640a00 of size 4096 next 218 2025-02-07 18:17:06.820164: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa641a00 of size 4096 next 219 2025-02-07 18:17:06.820175: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa642a00 of size 4096 next 220 2025-02-07 18:17:06.820186: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa643a00 of size 1024 next 221 2025-02-07 18:17:06.820198: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa643e00 of size 1024 next 223 2025-02-07 18:17:06.820209: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa644200 of size 1024 next 224 2025-02-07 18:17:06.820220: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa644600 of size 1024 next 225 2025-02-07 18:17:06.820232: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa644a00 of size 1024 next 226 2025-02-07 18:17:06.820243: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa644e00 of size 1024 next 229 2025-02-07 18:17:06.820254: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa645200 of size 1024 next 230 2025-02-07 18:17:06.820266: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa645600 of size 1024 next 231 2025-02-07 18:17:06.820277: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa645a00 of size 1024 next 232 2025-02-07 18:17:06.820288: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa645e00 of size 1024 next 233 2025-02-07 18:17:06.820300: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa646200 of size 7680 next 72 2025-02-07 18:17:06.820311: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa648000 of size 147456 next 71 2025-02-07 18:17:06.820323: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa66c000 of size 131072 next 87 2025-02-07 18:17:06.820335: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa68c000 of size 4096 next 289 2025-02-07 18:17:06.820346: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa68d000 of size 4096 next 290 2025-02-07 18:17:06.820357: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa68e000 of size 4096 next 291 2025-02-07 18:17:06.820369: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa68f000 of size 1024 next 292 2025-02-07 18:17:06.820380: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa68f400 of size 1024 next 293 2025-02-07 18:17:06.820391: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa68f800 of size 1024 next 294 2025-02-07 18:17:06.820402: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa68fc00 of size 1024 next 295 2025-02-07 18:17:06.820414: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa690000 of size 1024 next 296 2025-02-07 18:17:06.820425: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa690400 of size 1024 next 299 2025-02-07 18:17:06.820436: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa690800 of size 1024 next 300 2025-02-07 18:17:06.820448: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa690c00 of size 1024 next 301 2025-02-07 18:17:06.820459: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa691000 of size 1024 next 302 2025-02-07 18:17:06.820478: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa691400 of size 1024 next 303 2025-02-07 18:17:06.820490: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa691800 of size 4096 next 305 2025-02-07 18:17:06.820501: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa692800 of size 4096 next 306 2025-02-07 18:17:06.820512: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa693800 of size 4096 next 307 2025-02-07 18:17:06.820524: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa694800 of size 4096 next 308 2025-02-07 18:17:06.820535: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa695800 of size 4096 next 309 2025-02-07 18:17:06.820546: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa696800 of size 1024 next 310 2025-02-07 18:17:06.820558: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa696c00 of size 1024 next 311 2025-02-07 18:17:06.820569: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa697000 of size 1024 next 312 2025-02-07 18:17:06.820580: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa697400 of size 1024 next 313 2025-02-07 18:17:06.820592: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa697800 of size 1024 next 314 2025-02-07 18:17:06.820603: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa697c00 of size 1024 next 317 2025-02-07 18:17:06.820614: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa698000 of size 1024 next 318 2025-02-07 18:17:06.820626: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa698400 of size 1024 next 319 2025-02-07 18:17:06.820637: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa698800 of size 1024 next 320 2025-02-07 18:17:06.820648: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa698c00 of size 1024 next 321 2025-02-07 18:17:06.820660: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa699000 of size 4096 next 323 2025-02-07 18:17:06.820671: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa69a000 of size 4096 next 324 2025-02-07 18:17:06.820682: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa69b000 of size 4096 next 325 2025-02-07 18:17:06.820694: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa69c000 of size 4096 next 326 2025-02-07 18:17:06.820705: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa69d000 of size 4096 next 327 2025-02-07 18:17:06.820716: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa69e000 of size 1024 next 328 2025-02-07 18:17:06.820728: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa69e400 of size 1024 next 329 2025-02-07 18:17:06.820739: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa69e800 of size 1024 next 330 2025-02-07 18:17:06.820750: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa69ec00 of size 1024 next 331 2025-02-07 18:17:06.820762: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa69f000 of size 1024 next 332 2025-02-07 18:17:06.820773: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa69f400 of size 1024 next 335 2025-02-07 18:17:06.820784: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa69f800 of size 1024 next 336 2025-02-07 18:17:06.820796: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa69fc00 of size 1024 next 337 2025-02-07 18:17:06.820807: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a0000 of size 1024 next 338 2025-02-07 18:17:06.820818: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a0400 of size 1024 next 339 2025-02-07 18:17:06.820829: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a0800 of size 4096 next 341 2025-02-07 18:17:06.820855: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a1800 of size 4096 next 342 2025-02-07 18:17:06.820867: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a2800 of size 4096 next 343 2025-02-07 18:17:06.820878: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a3800 of size 4096 next 344 2025-02-07 18:17:06.820889: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a4800 of size 4096 next 345 2025-02-07 18:17:06.820901: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a5800 of size 1024 next 346 2025-02-07 18:17:06.820912: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a5c00 of size 1024 next 347 2025-02-07 18:17:06.820923: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a6000 of size 1024 next 348 2025-02-07 18:17:06.820935: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a6400 of size 1024 next 349 2025-02-07 18:17:06.820946: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a6800 of size 1024 next 350 2025-02-07 18:17:06.820957: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a6c00 of size 1024 next 353 2025-02-07 18:17:06.820969: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a7000 of size 1024 next 354 2025-02-07 18:17:06.820980: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a7400 of size 1024 next 355 2025-02-07 18:17:06.820991: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a7800 of size 1024 next 356 2025-02-07 18:17:06.821002: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a7c00 of size 1024 next 357 2025-02-07 18:17:06.821014: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a8000 of size 4096 next 359 2025-02-07 18:17:06.821025: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6a9000 of size 4096 next 360 2025-02-07 18:17:06.821036: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6aa000 of size 4096 next 361 2025-02-07 18:17:06.821048: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6ab000 of size 4096 next 362 2025-02-07 18:17:06.821059: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6ac000 of size 4096 next 363 2025-02-07 18:17:06.821070: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6ad000 of size 1024 next 364 2025-02-07 18:17:06.821081: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6ad400 of size 1024 next 365 2025-02-07 18:17:06.821093: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6ad800 of size 1024 next 366 2025-02-07 18:17:06.821104: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6adc00 of size 1024 next 367 2025-02-07 18:17:06.821115: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6ae000 of size 1024 next 368 2025-02-07 18:17:06.821127: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6ae400 of size 1024 next 371 2025-02-07 18:17:06.821138: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6ae800 of size 1024 next 372 2025-02-07 18:17:06.821149: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6aec00 of size 1024 next 373 2025-02-07 18:17:06.821161: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6af000 of size 1024 next 374 2025-02-07 18:17:06.821172: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6af400 of size 1024 next 375 2025-02-07 18:17:06.821183: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6af800 of size 4096 next 377 2025-02-07 18:17:06.821195: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6b0800 of size 4096 next 378 2025-02-07 18:17:06.821206: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6b1800 of size 4096 next 379 2025-02-07 18:17:06.821225: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6b2800 of size 4096 next 380 2025-02-07 18:17:06.821237: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6b3800 of size 4096 next 381 2025-02-07 18:17:06.821248: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6b4800 of size 1024 next 382 2025-02-07 18:17:06.821259: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6b4c00 of size 1024 next 383 2025-02-07 18:17:06.821271: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6b5000 of size 1024 next 384 2025-02-07 18:17:06.821282: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6b5400 of size 1024 next 385 2025-02-07 18:17:06.821293: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6b5800 of size 1024 next 386 2025-02-07 18:17:06.821304: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6b5c00 of size 1024 next 389 2025-02-07 18:17:06.821316: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6b6000 of size 1024 next 390 2025-02-07 18:17:06.821327: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6b6400 of size 1024 next 391 2025-02-07 18:17:06.821338: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6b6800 of size 1024 next 392 2025-02-07 18:17:06.821350: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6b6c00 of size 1024 next 393 2025-02-07 18:17:06.821361: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6b7000 of size 4096 next 395 2025-02-07 18:17:06.821372: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6b8000 of size 4096 next 396 2025-02-07 18:17:06.821384: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6b9000 of size 4096 next 397 2025-02-07 18:17:06.821395: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6ba000 of size 4096 next 398 2025-02-07 18:17:06.821406: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6bb000 of size 4096 next 399 2025-02-07 18:17:06.821418: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6bc000 of size 1024 next 400 2025-02-07 18:17:06.821429: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6bc400 of size 1024 next 401 2025-02-07 18:17:06.821440: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6bc800 of size 1024 next 402 2025-02-07 18:17:06.821451: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6bcc00 of size 1024 next 403 2025-02-07 18:17:06.821463: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6bd000 of size 1024 next 404 2025-02-07 18:17:06.821474: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6bd400 of size 1024 next 407 2025-02-07 18:17:06.821485: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6bd800 of size 1024 next 408 2025-02-07 18:17:06.821497: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6bdc00 of size 1024 next 409 2025-02-07 18:17:06.821508: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6be000 of size 1024 next 410 2025-02-07 18:17:06.821519: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6be400 of size 1024 next 411 2025-02-07 18:17:06.821531: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6be800 of size 4096 next 413 2025-02-07 18:17:06.821542: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6bf800 of size 4096 next 414 2025-02-07 18:17:06.821553: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6c0800 of size 4096 next 415 2025-02-07 18:17:06.821565: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6c1800 of size 4096 next 416 2025-02-07 18:17:06.821576: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6c2800 of size 4096 next 417 2025-02-07 18:17:06.821595: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6c3800 of size 1024 next 418 2025-02-07 18:17:06.821606: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6c3c00 of size 1024 next 419 2025-02-07 18:17:06.821618: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6c4000 of size 1024 next 420 2025-02-07 18:17:06.821629: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6c4400 of size 1024 next 421 2025-02-07 18:17:06.821640: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6c4800 of size 1024 next 422 2025-02-07 18:17:06.821652: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6c4c00 of size 1024 next 425 2025-02-07 18:17:06.821663: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6c5000 of size 1024 next 426 2025-02-07 18:17:06.821674: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6c5400 of size 1024 next 427 2025-02-07 18:17:06.821686: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6c5800 of size 1024 next 428 2025-02-07 18:17:06.821697: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6c5c00 of size 1024 next 429 2025-02-07 18:17:06.821708: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6c6000 of size 4096 next 431 2025-02-07 18:17:06.821720: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6c7000 of size 4096 next 432 2025-02-07 18:17:06.821731: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6c8000 of size 4096 next 433 2025-02-07 18:17:06.821742: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6c9000 of size 4096 next 434 2025-02-07 18:17:06.821753: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6ca000 of size 4096 next 435 2025-02-07 18:17:06.821765: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6cb000 of size 1024 next 436 2025-02-07 18:17:06.821776: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6cb400 of size 1024 next 437 2025-02-07 18:17:06.821787: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6cb800 of size 1024 next 438 2025-02-07 18:17:06.821799: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6cbc00 of size 1024 next 103 2025-02-07 18:17:06.821810: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa6cc000 of size 262144 next 102 2025-02-07 18:17:06.821822: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7faafa70c000 of size 999424 next 18446744073709551615 2025-02-07 18:17:06.821833: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 4194304 2025-02-07 18:17:06.821845: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa800000 of size 589824 next 96 2025-02-07 18:17:06.821856: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa890000 of size 262144 next 117 2025-02-07 18:17:06.821867: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d0000 of size 1024 next 439 2025-02-07 18:17:06.821879: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d0400 of size 1024 next 442 2025-02-07 18:17:06.821890: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d0800 of size 1024 next 443 2025-02-07 18:17:06.821901: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d0c00 of size 1024 next 444 2025-02-07 18:17:06.821913: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d1000 of size 1024 next 445 2025-02-07 18:17:06.821924: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d1400 of size 1024 next 446 2025-02-07 18:17:06.821935: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d1800 of size 4096 next 448 2025-02-07 18:17:06.821947: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d2800 of size 4096 next 449 2025-02-07 18:17:06.821965: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d3800 of size 4096 next 450 2025-02-07 18:17:06.821977: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d4800 of size 4096 next 451 2025-02-07 18:17:06.821989: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d5800 of size 4096 next 452 2025-02-07 18:17:06.822000: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d6800 of size 1024 next 453 2025-02-07 18:17:06.822011: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d6c00 of size 1024 next 454 2025-02-07 18:17:06.822023: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d7000 of size 1024 next 455 2025-02-07 18:17:06.822034: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d7400 of size 1024 next 456 2025-02-07 18:17:06.822045: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d7800 of size 1024 next 457 2025-02-07 18:17:06.822057: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d7c00 of size 1024 next 460 2025-02-07 18:17:06.822068: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d8000 of size 1024 next 461 2025-02-07 18:17:06.822079: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d8400 of size 1024 next 462 2025-02-07 18:17:06.822090: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d8800 of size 1024 next 463 2025-02-07 18:17:06.822102: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d8c00 of size 1024 next 464 2025-02-07 18:17:06.822113: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8d9000 of size 4096 next 466 2025-02-07 18:17:06.822124: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8da000 of size 4096 next 467 2025-02-07 18:17:06.822136: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8db000 of size 4096 next 468 2025-02-07 18:17:06.822147: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8dc000 of size 4096 next 469 2025-02-07 18:17:06.822158: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8dd000 of size 4096 next 470 2025-02-07 18:17:06.822170: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8de000 of size 1024 next 471 2025-02-07 18:17:06.822181: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8de400 of size 1024 next 472 2025-02-07 18:17:06.822192: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8de800 of size 1024 next 473 2025-02-07 18:17:06.822204: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8dec00 of size 1024 next 474 2025-02-07 18:17:06.822215: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8df000 of size 1024 next 475 2025-02-07 18:17:06.822226: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8df400 of size 1024 next 478 2025-02-07 18:17:06.822238: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8df800 of size 1024 next 479 2025-02-07 18:17:06.822249: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8dfc00 of size 1024 next 480 2025-02-07 18:17:06.822260: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e0000 of size 1024 next 481 2025-02-07 18:17:06.822272: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e0400 of size 1024 next 482 2025-02-07 18:17:06.822283: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e0800 of size 4096 next 484 2025-02-07 18:17:06.822294: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e1800 of size 4096 next 485 2025-02-07 18:17:06.822306: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e2800 of size 4096 next 486 2025-02-07 18:17:06.822317: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e3800 of size 4096 next 487 2025-02-07 18:17:06.822329: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e4800 of size 4096 next 488 2025-02-07 18:17:06.822347: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e5800 of size 1024 next 489 2025-02-07 18:17:06.822359: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e5c00 of size 1024 next 490 2025-02-07 18:17:06.822370: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e6000 of size 1024 next 491 2025-02-07 18:17:06.822382: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e6400 of size 1024 next 492 2025-02-07 18:17:06.822393: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e6800 of size 1024 next 493 2025-02-07 18:17:06.822404: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e6c00 of size 1024 next 496 2025-02-07 18:17:06.822416: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e7000 of size 1024 next 497 2025-02-07 18:17:06.822427: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e7400 of size 1024 next 498 2025-02-07 18:17:06.822438: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e7800 of size 1024 next 499 2025-02-07 18:17:06.822450: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e7c00 of size 1024 next 500 2025-02-07 18:17:06.822461: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e8000 of size 4096 next 502 2025-02-07 18:17:06.822472: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8e9000 of size 4096 next 503 2025-02-07 18:17:06.822484: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8ea000 of size 4096 next 504 2025-02-07 18:17:06.822495: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8eb000 of size 4096 next 505 2025-02-07 18:17:06.822506: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8ec000 of size 4096 next 506 2025-02-07 18:17:06.822518: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8ed000 of size 1024 next 507 2025-02-07 18:17:06.822529: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8ed400 of size 1024 next 508 2025-02-07 18:17:06.822540: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8ed800 of size 1024 next 509 2025-02-07 18:17:06.822552: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8edc00 of size 1024 next 510 2025-02-07 18:17:06.822563: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8ee000 of size 1024 next 511 2025-02-07 18:17:06.822574: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8ee400 of size 1024 next 514 2025-02-07 18:17:06.822586: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8ee800 of size 1024 next 515 2025-02-07 18:17:06.822597: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8eec00 of size 1024 next 516 2025-02-07 18:17:06.822608: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8ef000 of size 1024 next 517 2025-02-07 18:17:06.822619: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8ef400 of size 1024 next 518 2025-02-07 18:17:06.822631: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8ef800 of size 4096 next 520 2025-02-07 18:17:06.822642: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8f0800 of size 4096 next 521 2025-02-07 18:17:06.822653: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8f1800 of size 4096 next 522 2025-02-07 18:17:06.822665: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8f2800 of size 4096 next 523 2025-02-07 18:17:06.822676: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8f3800 of size 4096 next 524 2025-02-07 18:17:06.822687: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8f4800 of size 1024 next 525 2025-02-07 18:17:06.822699: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8f4c00 of size 1024 next 526 2025-02-07 18:17:06.822718: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8f5000 of size 1024 next 527 2025-02-07 18:17:06.822729: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8f5400 of size 1024 next 528 2025-02-07 18:17:06.822741: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8f5800 of size 1024 next 529 2025-02-07 18:17:06.822752: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8f5c00 of size 1024 next 532 2025-02-07 18:17:06.822764: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8f6000 of size 1024 next 533 2025-02-07 18:17:06.822775: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8f6400 of size 1024 next 534 2025-02-07 18:17:06.822786: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8f6800 of size 1024 next 535 2025-02-07 18:17:06.822798: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8f6c00 of size 1024 next 536 2025-02-07 18:17:06.822809: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8f7000 of size 4096 next 538 2025-02-07 18:17:06.822821: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8f8000 of size 4096 next 539 2025-02-07 18:17:06.822832: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8f9000 of size 4096 next 540 2025-02-07 18:17:06.822843: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8fa000 of size 4096 next 541 2025-02-07 18:17:06.822855: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8fb000 of size 4096 next 542 2025-02-07 18:17:06.822866: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8fc000 of size 1024 next 543 2025-02-07 18:17:06.822878: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8fc400 of size 1024 next 544 2025-02-07 18:17:06.822889: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8fc800 of size 1024 next 545 2025-02-07 18:17:06.822939: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8fcc00 of size 1024 next 546 2025-02-07 18:17:06.822956: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8fd000 of size 1024 next 547 2025-02-07 18:17:06.822971: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8fd400 of size 1024 next 550 2025-02-07 18:17:06.822985: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8fd800 of size 1024 next 551 2025-02-07 18:17:06.823000: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8fdc00 of size 1024 next 552 2025-02-07 18:17:06.823014: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8fe000 of size 1024 next 553 2025-02-07 18:17:06.823029: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8fe400 of size 1024 next 554 2025-02-07 18:17:06.823043: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8fe800 of size 4096 next 556 2025-02-07 18:17:06.823055: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa8ff800 of size 4096 next 557 2025-02-07 18:17:06.823066: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa900800 of size 4096 next 558 2025-02-07 18:17:06.823077: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa901800 of size 4096 next 559 2025-02-07 18:17:06.823089: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa902800 of size 4096 next 560 2025-02-07 18:17:06.823100: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa903800 of size 1024 next 561 2025-02-07 18:17:06.823111: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa903c00 of size 1024 next 562 2025-02-07 18:17:06.823123: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa904000 of size 1024 next 563 2025-02-07 18:17:06.823134: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa904400 of size 1024 next 564 2025-02-07 18:17:06.823155: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa904800 of size 1024 next 565 2025-02-07 18:17:06.823167: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa904c00 of size 1024 next 568 2025-02-07 18:17:06.823178: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa905000 of size 1024 next 569 2025-02-07 18:17:06.823190: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa905400 of size 1024 next 570 2025-02-07 18:17:06.823201: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa905800 of size 1024 next 571 2025-02-07 18:17:06.823212: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa905c00 of size 1024 next 572 2025-02-07 18:17:06.823224: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa906000 of size 4096 next 574 2025-02-07 18:17:06.823235: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa907000 of size 4096 next 575 2025-02-07 18:17:06.823246: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa908000 of size 4096 next 576 2025-02-07 18:17:06.823258: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa909000 of size 4096 next 577 2025-02-07 18:17:06.823269: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa90a000 of size 4096 next 578 2025-02-07 18:17:06.823280: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa90b000 of size 1024 next 579 2025-02-07 18:17:06.823291: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa90b400 of size 1024 next 580 2025-02-07 18:17:06.823303: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa90b800 of size 1024 next 581 2025-02-07 18:17:06.823314: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa90bc00 of size 1024 next 582 2025-02-07 18:17:06.823325: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa90c000 of size 1024 next 583 2025-02-07 18:17:06.823336: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa90c400 of size 1024 next 586 2025-02-07 18:17:06.823348: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa90c800 of size 1024 next 587 2025-02-07 18:17:06.823359: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa90cc00 of size 1024 next 588 2025-02-07 18:17:06.823370: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa90d000 of size 1024 next 589 2025-02-07 18:17:06.823382: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa90d400 of size 1024 next 590 2025-02-07 18:17:06.823393: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa90d800 of size 4096 next 592 2025-02-07 18:17:06.823405: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa90e800 of size 6144 next 112 2025-02-07 18:17:06.823417: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa910000 of size 524288 next 111 2025-02-07 18:17:06.823428: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa990000 of size 262144 next 135 2025-02-07 18:17:06.823440: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafa9d0000 of size 327680 next 124 2025-02-07 18:17:06.823451: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafaa20000 of size 589824 next 123 2025-02-07 18:17:06.823463: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafaab0000 of size 262144 next 152 2025-02-07 18:17:06.823474: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafaaf0000 of size 327680 next 142 2025-02-07 18:17:06.823486: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafab40000 of size 786432 next 18446744073709551615 2025-02-07 18:17:06.823497: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 8388608 2025-02-07 18:17:06.823509: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafac00000 of size 4096 next 593 2025-02-07 18:17:06.823528: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafac01000 of size 4096 next 594 2025-02-07 18:17:06.823540: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafac02000 of size 4096 next 595 2025-02-07 18:17:06.823551: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafac03000 of size 2048 next 598 2025-02-07 18:17:06.823563: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafac03800 of size 2048 next 599 2025-02-07 18:17:06.823574: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafac04000 of size 2048 next 600 2025-02-07 18:17:06.823585: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafac04800 of size 2048 next 601 2025-02-07 18:17:06.823597: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafac05000 of size 2048 next 602 2025-02-07 18:17:06.823608: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7faafac05800 of size 567296 next 160 2025-02-07 18:17:06.823619: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafac90000 of size 589824 next 158 2025-02-07 18:17:06.823631: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafad20000 of size 524288 next 171 2025-02-07 18:17:06.823642: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7faafada0000 of size 1048576 next 222 2025-02-07 18:17:06.823654: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafaea0000 of size 1048576 next 190 2025-02-07 18:17:06.823665: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafafa0000 of size 1048576 next 189 2025-02-07 18:17:06.823677: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafb0a0000 of size 1048576 next 203 2025-02-07 18:17:06.823688: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafb1a0000 of size 1048576 next 251 2025-02-07 18:17:06.823700: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7faafb2a0000 of size 1441792 next 18446744073709551615 2025-02-07 18:17:06.823711: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 1048576 2025-02-07 18:17:06.823723: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae00000 of size 1280 next 1 2025-02-07 18:17:06.823735: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae00500 of size 256 next 5 2025-02-07 18:17:06.823746: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae00600 of size 256 next 8 2025-02-07 18:17:06.823757: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae00700 of size 256 next 9 2025-02-07 18:17:06.823769: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae00800 of size 256 next 10 2025-02-07 18:17:06.823780: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae00900 of size 256 next 11 2025-02-07 18:17:06.823791: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae00a00 of size 256 next 12 2025-02-07 18:17:06.823803: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae00b00 of size 256 next 13 2025-02-07 18:17:06.823814: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae00c00 of size 256 next 17 2025-02-07 18:17:06.823826: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae00d00 of size 256 next 19 2025-02-07 18:17:06.823837: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae00e00 of size 256 next 20 2025-02-07 18:17:06.823848: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae00f00 of size 256 next 21 2025-02-07 18:17:06.823860: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae01000 of size 256 next 22 2025-02-07 18:17:06.823871: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae01100 of size 256 next 24 2025-02-07 18:17:06.823882: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae01200 of size 256 next 25 2025-02-07 18:17:06.823893: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae01300 of size 256 next 23 2025-02-07 18:17:06.823912: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae01400 of size 256 next 28 2025-02-07 18:17:06.823924: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae01500 of size 256 next 29 2025-02-07 18:17:06.823936: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae01600 of size 256 next 30 2025-02-07 18:17:06.823947: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae01700 of size 256 next 31 2025-02-07 18:17:06.823958: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae01800 of size 256 next 33 2025-02-07 18:17:06.823970: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae01900 of size 256 next 34 2025-02-07 18:17:06.823981: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae01a00 of size 1024 next 32 2025-02-07 18:17:06.823992: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae01e00 of size 1024 next 37 2025-02-07 18:17:06.824004: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae02200 of size 1024 next 38 2025-02-07 18:17:06.824015: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae02600 of size 1024 next 39 2025-02-07 18:17:06.824026: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae02a00 of size 1024 next 40 2025-02-07 18:17:06.824038: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae02e00 of size 1024 next 41 2025-02-07 18:17:06.824049: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae03200 of size 1024 next 43 2025-02-07 18:17:06.824060: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae03600 of size 1024 next 44 2025-02-07 18:17:06.824071: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae03a00 of size 1024 next 45 2025-02-07 18:17:06.824083: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae03e00 of size 1024 next 46 2025-02-07 18:17:06.824094: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae04200 of size 256 next 48 2025-02-07 18:17:06.824105: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae04300 of size 256 next 49 2025-02-07 18:17:06.824117: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae04400 of size 256 next 50 2025-02-07 18:17:06.824128: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae04500 of size 256 next 51 2025-02-07 18:17:06.824139: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae04600 of size 256 next 52 2025-02-07 18:17:06.824151: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae04700 of size 256 next 53 2025-02-07 18:17:06.824162: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae04800 of size 256 next 56 2025-02-07 18:17:06.824173: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae04900 of size 256 next 57 2025-02-07 18:17:06.824185: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae04a00 of size 256 next 58 2025-02-07 18:17:06.824196: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae04b00 of size 256 next 14 2025-02-07 18:17:06.824207: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae04c00 of size 256 next 15 2025-02-07 18:17:06.824219: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae04d00 of size 256 next 16 2025-02-07 18:17:06.824230: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae04e00 of size 1024 next 60 2025-02-07 18:17:06.824241: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae05200 of size 1024 next 61 2025-02-07 18:17:06.824253: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae05600 of size 1024 next 62 2025-02-07 18:17:06.824264: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae05a00 of size 1024 next 63 2025-02-07 18:17:06.824286: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae05e00 of size 1024 next 64 2025-02-07 18:17:06.824297: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae06200 of size 256 next 66 2025-02-07 18:17:06.824307: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae06300 of size 256 next 67 2025-02-07 18:17:06.824316: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae06400 of size 256 next 68 2025-02-07 18:17:06.824324: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae06500 of size 256 next 69 2025-02-07 18:17:06.824332: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae06600 of size 256 next 70 2025-02-07 18:17:06.824341: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae06700 of size 256 next 73 2025-02-07 18:17:06.824349: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae06800 of size 256 next 74 2025-02-07 18:17:06.824357: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae06900 of size 256 next 75 2025-02-07 18:17:06.824366: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae06a00 of size 256 next 76 2025-02-07 18:17:06.824374: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae06b00 of size 256 next 77 2025-02-07 18:17:06.824382: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae06c00 of size 1024 next 79 2025-02-07 18:17:06.824391: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae07000 of size 1024 next 80 2025-02-07 18:17:06.824399: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae07400 of size 1024 next 81 2025-02-07 18:17:06.824407: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae07800 of size 1024 next 82 2025-02-07 18:17:06.824415: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae07c00 of size 1024 next 83 2025-02-07 18:17:06.824424: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae08000 of size 256 next 85 2025-02-07 18:17:06.824432: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae08100 of size 256 next 86 2025-02-07 18:17:06.824441: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae08200 of size 512 next 84 2025-02-07 18:17:06.824449: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae08400 of size 512 next 88 2025-02-07 18:17:06.824457: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae08600 of size 512 next 89 2025-02-07 18:17:06.824466: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae08800 of size 512 next 90 2025-02-07 18:17:06.824474: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae08a00 of size 512 next 91 2025-02-07 18:17:06.824483: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae08c00 of size 256 next 93 2025-02-07 18:17:06.824491: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae08d00 of size 256 next 94 2025-02-07 18:17:06.824499: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae08e00 of size 512 next 92 2025-02-07 18:17:06.824508: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae09000 of size 512 next 97 2025-02-07 18:17:06.824516: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae09200 of size 512 next 98 2025-02-07 18:17:06.824524: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae09400 of size 512 next 99 2025-02-07 18:17:06.824532: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae09600 of size 512 next 2 2025-02-07 18:17:06.824541: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae09800 of size 256 next 3 2025-02-07 18:17:06.824549: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae09900 of size 256 next 4 2025-02-07 18:17:06.824558: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae09a00 of size 16384 next 18 2025-02-07 18:17:06.824572: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae0da00 of size 256 next 100 2025-02-07 18:17:06.824580: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae0db00 of size 256 next 101 2025-02-07 18:17:06.824589: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae0dc00 of size 2048 next 104 2025-02-07 18:17:06.824597: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae0e400 of size 2048 next 105 2025-02-07 18:17:06.824606: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae0ec00 of size 2048 next 106 2025-02-07 18:17:06.824614: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae0f400 of size 2048 next 107 2025-02-07 18:17:06.824622: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae0fc00 of size 2048 next 108 2025-02-07 18:17:06.824631: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae10400 of size 256 next 109 2025-02-07 18:17:06.824639: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae10500 of size 256 next 110 2025-02-07 18:17:06.824647: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae10600 of size 2048 next 113 2025-02-07 18:17:06.824655: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae10e00 of size 2048 next 114 2025-02-07 18:17:06.824664: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae11600 of size 2048 next 115 2025-02-07 18:17:06.824672: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae11e00 of size 2048 next 116 2025-02-07 18:17:06.824680: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae12600 of size 2048 next 6 2025-02-07 18:17:06.824689: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae12e00 of size 37632 next 7 2025-02-07 18:17:06.824697: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae1c100 of size 512 next 118 2025-02-07 18:17:06.824706: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae1c300 of size 512 next 119 2025-02-07 18:17:06.824714: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae1c500 of size 512 next 120 2025-02-07 18:17:06.824722: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae1c700 of size 512 next 121 2025-02-07 18:17:06.824731: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae1c900 of size 512 next 122 2025-02-07 18:17:06.824739: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae1cb00 of size 512 next 125 2025-02-07 18:17:06.824747: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae1cd00 of size 512 next 126 2025-02-07 18:17:06.824756: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae1cf00 of size 512 next 127 2025-02-07 18:17:06.824764: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae1d100 of size 512 next 128 2025-02-07 18:17:06.824772: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae1d300 of size 512 next 129 2025-02-07 18:17:06.824780: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae1d500 of size 2048 next 130 2025-02-07 18:17:06.824789: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae1dd00 of size 2048 next 131 2025-02-07 18:17:06.824797: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae1e500 of size 2048 next 132 2025-02-07 18:17:06.824805: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae1ed00 of size 2048 next 133 2025-02-07 18:17:06.824814: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae1f500 of size 2048 next 134 2025-02-07 18:17:06.824822: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae1fd00 of size 512 next 136 2025-02-07 18:17:06.824830: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae1ff00 of size 512 next 137 2025-02-07 18:17:06.824844: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae20100 of size 512 next 138 2025-02-07 18:17:06.824853: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae20300 of size 512 next 139 2025-02-07 18:17:06.824861: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae20500 of size 512 next 140 2025-02-07 18:17:06.824869: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae20700 of size 512 next 141 2025-02-07 18:17:06.824878: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae20900 of size 512 next 143 2025-02-07 18:17:06.824886: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae20b00 of size 512 next 144 2025-02-07 18:17:06.824894: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae20d00 of size 512 next 145 2025-02-07 18:17:06.824903: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae20f00 of size 512 next 146 2025-02-07 18:17:06.824911: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae21100 of size 2048 next 147 2025-02-07 18:17:06.824919: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae21900 of size 2048 next 148 2025-02-07 18:17:06.824928: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae22100 of size 2048 next 149 2025-02-07 18:17:06.824936: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae22900 of size 2048 next 150 2025-02-07 18:17:06.824944: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae23100 of size 2048 next 151 2025-02-07 18:17:06.824953: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae23900 of size 512 next 153 2025-02-07 18:17:06.824961: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae23b00 of size 512 next 154 2025-02-07 18:17:06.824969: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae23d00 of size 512 next 155 2025-02-07 18:17:06.824978: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae23f00 of size 512 next 156 2025-02-07 18:17:06.824986: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae24100 of size 512 next 157 2025-02-07 18:17:06.824994: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae24300 of size 512 next 161 2025-02-07 18:17:06.825002: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae24500 of size 512 next 162 2025-02-07 18:17:06.825011: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae24700 of size 512 next 163 2025-02-07 18:17:06.825019: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae24900 of size 512 next 164 2025-02-07 18:17:06.825027: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae24b00 of size 512 next 165 2025-02-07 18:17:06.825036: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae24d00 of size 2048 next 166 2025-02-07 18:17:06.825044: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae25500 of size 2048 next 167 2025-02-07 18:17:06.825052: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae25d00 of size 2048 next 168 2025-02-07 18:17:06.825061: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae26500 of size 2048 next 169 2025-02-07 18:17:06.825069: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae26d00 of size 2048 next 170 2025-02-07 18:17:06.825077: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae27500 of size 1024 next 172 2025-02-07 18:17:06.825086: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae27900 of size 1024 next 173 2025-02-07 18:17:06.825094: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae27d00 of size 1024 next 174 2025-02-07 18:17:06.825102: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae28100 of size 1024 next 175 2025-02-07 18:17:06.825111: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae28500 of size 1024 next 176 2025-02-07 18:17:06.825124: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae28900 of size 256 next 178 2025-02-07 18:17:06.825133: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae28a00 of size 256 next 179 2025-02-07 18:17:06.825141: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae28b00 of size 1024 next 177 2025-02-07 18:17:06.825150: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae28f00 of size 1024 next 182 2025-02-07 18:17:06.825158: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae29300 of size 1024 next 183 2025-02-07 18:17:06.825166: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae29700 of size 1024 next 184 2025-02-07 18:17:06.825175: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae29b00 of size 1024 next 185 2025-02-07 18:17:06.825183: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae29f00 of size 256 next 187 2025-02-07 18:17:06.825191: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae2a000 of size 256 next 188 2025-02-07 18:17:06.825199: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae2a100 of size 4096 next 186 2025-02-07 18:17:06.825208: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae2b100 of size 4096 next 42 2025-02-07 18:17:06.825216: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae2c100 of size 65536 next 36 2025-02-07 18:17:06.825224: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae3c100 of size 65536 next 35 2025-02-07 18:17:06.825233: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae4c100 of size 4096 next 235 2025-02-07 18:17:06.825241: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae4d100 of size 4096 next 236 2025-02-07 18:17:06.825249: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae4e100 of size 4096 next 237 2025-02-07 18:17:06.825258: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae4f100 of size 4096 next 238 2025-02-07 18:17:06.825266: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae50100 of size 1024 next 239 2025-02-07 18:17:06.825274: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae50500 of size 1024 next 240 2025-02-07 18:17:06.825283: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae50900 of size 1024 next 241 2025-02-07 18:17:06.825291: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae50d00 of size 1024 next 242 2025-02-07 18:17:06.825299: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae51100 of size 1024 next 243 2025-02-07 18:17:06.825308: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae51500 of size 1024 next 246 2025-02-07 18:17:06.825316: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae51900 of size 1024 next 247 2025-02-07 18:17:06.825324: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae51d00 of size 1024 next 248 2025-02-07 18:17:06.825333: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae52100 of size 1024 next 249 2025-02-07 18:17:06.825341: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae52500 of size 1024 next 250 2025-02-07 18:17:06.825349: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae52900 of size 4096 next 252 2025-02-07 18:17:06.825357: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae53900 of size 4096 next 253 2025-02-07 18:17:06.825366: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae54900 of size 4096 next 254 2025-02-07 18:17:06.825374: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae55900 of size 4096 next 255 2025-02-07 18:17:06.825382: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae56900 of size 4096 next 256 2025-02-07 18:17:06.825402: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae57900 of size 1024 next 257 2025-02-07 18:17:06.825411: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae57d00 of size 1024 next 258 2025-02-07 18:17:06.825419: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae58100 of size 1024 next 259 2025-02-07 18:17:06.825428: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae58500 of size 1024 next 260 2025-02-07 18:17:06.825436: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae58900 of size 1024 next 261 2025-02-07 18:17:06.825444: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae58d00 of size 1024 next 264 2025-02-07 18:17:06.825453: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae59100 of size 1024 next 265 2025-02-07 18:17:06.825461: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae59500 of size 1024 next 266 2025-02-07 18:17:06.825469: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae59900 of size 1024 next 267 2025-02-07 18:17:06.825478: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae59d00 of size 1024 next 268 2025-02-07 18:17:06.825486: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae5a100 of size 4096 next 270 2025-02-07 18:17:06.825494: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae5b100 of size 4096 next 271 2025-02-07 18:17:06.825503: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae5c100 of size 4096 next 272 2025-02-07 18:17:06.825511: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae5d100 of size 4096 next 273 2025-02-07 18:17:06.825519: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae5e100 of size 4096 next 274 2025-02-07 18:17:06.825528: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae5f100 of size 1024 next 275 2025-02-07 18:17:06.825536: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae5f500 of size 1024 next 276 2025-02-07 18:17:06.825544: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae5f900 of size 1024 next 277 2025-02-07 18:17:06.825552: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae5fd00 of size 1024 next 278 2025-02-07 18:17:06.825561: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae60100 of size 1024 next 279 2025-02-07 18:17:06.825569: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae60500 of size 1024 next 282 2025-02-07 18:17:06.825577: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae60900 of size 1024 next 283 2025-02-07 18:17:06.825586: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae60d00 of size 1024 next 284 2025-02-07 18:17:06.825594: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae61100 of size 1024 next 285 2025-02-07 18:17:06.825602: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae61500 of size 1024 next 286 2025-02-07 18:17:06.825611: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae61900 of size 4096 next 288 2025-02-07 18:17:06.825619: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae62900 of size 6144 next 27 2025-02-07 18:17:06.825627: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae64100 of size 147456 next 26 2025-02-07 18:17:06.825636: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae88100 of size 65536 next 47 2025-02-07 18:17:06.825644: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3ae98100 of size 65536 next 59 2025-02-07 18:17:06.825652: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3aea8100 of size 65536 next 65 2025-02-07 18:17:06.825661: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7fac3aeb8100 of size 294656 next 18446744073709551615 2025-02-07 18:17:06.825675: I tensorflow/core/common_runtime/bfc_allocator.cc:995] Summary of in-use Chunks by size: 2025-02-07 18:17:06.825686: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 59 Chunks of size 256 totalling 14.8KiB 2025-02-07 18:17:06.825696: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 40 Chunks of size 512 totalling 20.0KiB 2025-02-07 18:17:06.825706: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 250 Chunks of size 1024 totalling 250.0KiB 2025-02-07 18:17:06.825715: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1280 totalling 1.2KiB 2025-02-07 18:17:06.825725: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 30 Chunks of size 2048 totalling 60.0KiB 2025-02-07 18:17:06.825734: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 117 Chunks of size 4096 totalling 468.0KiB 2025-02-07 18:17:06.825743: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 6144 totalling 12.0KiB 2025-02-07 18:17:06.825752: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 7680 totalling 7.5KiB 2025-02-07 18:17:06.825762: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 16384 totalling 16.0KiB 2025-02-07 18:17:06.825771: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 37632 totalling 36.8KiB 2025-02-07 18:17:06.825780: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 6 Chunks of size 65536 totalling 384.0KiB 2025-02-07 18:17:06.825789: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 131072 totalling 128.0KiB 2025-02-07 18:17:06.825799: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 147456 totalling 432.0KiB 2025-02-07 18:17:06.825808: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 4 Chunks of size 262144 totalling 1.00MiB 2025-02-07 18:17:06.825817: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 294656 totalling 287.8KiB 2025-02-07 18:17:06.825826: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 327680 totalling 640.0KiB 2025-02-07 18:17:06.825835: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 524288 totalling 1.00MiB 2025-02-07 18:17:06.825844: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 589824 totalling 1.69MiB 2025-02-07 18:17:06.825854: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 786432 totalling 768.0KiB 2025-02-07 18:17:06.825863: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 25 Chunks of size 1048576 totalling 25.00MiB 2025-02-07 18:17:06.825872: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 18 Chunks of size 1310720 totalling 22.50MiB 2025-02-07 18:17:06.825881: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1441792 totalling 1.38MiB 2025-02-07 18:17:06.825890: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1835008 totalling 1.75MiB 2025-02-07 18:17:06.825899: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 2097152 totalling 4.00MiB 2025-02-07 18:17:06.825909: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 23 Chunks of size 2359296 totalling 51.75MiB 2025-02-07 18:17:06.825918: I tensorflow/core/common_runtime/bfc_allocator.cc:1002] Sum Total of in-use chunks: 113.51MiB 2025-02-07 18:17:06.825927: I tensorflow/core/common_runtime/bfc_allocator.cc:1004] total_region_allocated_bytes_: 131989504 memory_limit_: 131989504 available bytes: 0 curr_region_allocation_bytes_: 134217728 2025-02-07 18:17:06.825939: I tensorflow/core/common_runtime/bfc_allocator.cc:1010] Stats: Limit: 131989504 InUse: 119019520 MaxInUse: 123990016 NumAllocs: 2020 MaxAllocSize: 4325376 2025-02-07 18:17:06.825959: W tensorflow/core/common_runtime/bfc_allocator.cc:439] *********************************************_**_*************************************__************ 2025-02-07 18:17:06.825995: W tensorflow/core/framework/op_kernel.cc:1753] OP_REQUIRES failed at random_op.cc:77 : Resource exhausted: OOM when allocating tensor with shape[3,3,512,512] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2896 thcls : [{'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5309 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5309, 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 16384, 25088, 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 5, 10, 19, 20, 46), datetime.datetime(2021, 5, 10, 19, 20, 46)) {'thcl': {'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'carton_brun', 'carton_gris', 'cartonnette', 'kraft', 'autre_refus', 'metal', 'plastique', 'teint_dans_la_masse', 'environnement'], 'list_hashtags_csv': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'svm_hashtag_type_desc': 5309, 'photo_desc_type': 5309, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'carton_brun', 'carton_gris', 'cartonnette', 'kraft', 'autre_refus', 'metal', 'plastique', 'teint_dans_la_masse', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_convoyeur_qualipapia_nantes_poly_100521_1 NUM_CLASSES 10 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 Exception in mask_detect : OOM when allocating tensor with shape[3,3,512,512] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomUniform] we want to redo the detection Using TensorFlow backend. max_time_sub_proc : 3600 erreur pendant la detection Catched exception ! Connect or reconnect ! in case -12 caffe_path_current : About to save ! 2 After save, about to update current ! 4.87user 3.02system 0:42.31elapsed 18%CPU (0avgtext+0avgdata 1109728maxresident)k 1632inputs+4088outputs (66major+255324minor)pagefaults 0swaps