python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 ~/workarea/git/Velours/python/prod/datou.py -j batch_current -C 2930218' -s rattrapage -M 0 -S 0 -U 100,80,95 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/home/admin/workarea/git/apy', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3500540 load datou : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 0 init_dummy_multi_datou is not linked in the step_by_step architecture ! WARNING : step 1294 init_dummy_multi_datou is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : (photo_id, hashtag_id, score_max) was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 3669>1000 please execute split_portfolio.py -i 23235267 -l 1000 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4892, datou_cur_ids : ['2930218'] with mtr_portfolio_ids : ['23235267'] and first list_photo_ids : [] new path : /proc/3500540/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! List Step Type Loaded in datou : tfhub_classification2, argmax over limit max, limiting to limit_max 300 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 300 ; length of list_pids : 300 ; length of list_args : 300 time to download the photos : 60.42848777770996 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 2 step1:tfhub_classification2 Mon May 26 12:14:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou_step TFHub with tf2 ! nombre de thcls : 2 we are using the classfication for multi_thcl [3513, 3892] begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3096 l 3632 free memory gpu now : 60 wait 20 seconds inside check gpu memory inside check gpu memory inside check gpu memory inside check gpu memory inside check gpu memory 2025-05-26 12:14:41.567186: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-26 12:14:41.599028: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 12:14:41.599344: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 12:14:41.603018: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 12:14:41.605799: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 12:14:41.606830: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 12:14:41.610781: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 12:14:41.612410: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 12:14:41.620099: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 12:14:41.621426: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 12:14:41.621991: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-26 12:14:41.651135: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-26 12:14:41.653102: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7ff5f4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-26 12:14:41.653156: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-26 12:14:41.774432: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x34812630 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-26 12:14:41.774471: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-26 12:14:41.775144: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 12:14:41.775241: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 12:14:41.775264: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 12:14:41.775285: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 12:14:41.775305: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 12:14:41.775325: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 12:14:41.775345: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 12:14:41.775365: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 12:14:41.776387: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 12:14:41.776435: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 12:14:41.777101: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 12:14:41.777117: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 12:14:41.777127: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-26 12:14:41.778224: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3096 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) l 3637 free memory gpu now : 2855 max_wait_temp : 6 max_wait : 5 1 Physical GPUs, 1 Logical GPUs tagging for thcl : 3513 To do loadFromThcl(), then load ParamDescType : thcl3513 thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] thcl {'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'} Update svm_hashtag_type_desc : 5767 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5767, 'Rungis_amount_dechets_fall_2018_v2_tf', 2048, 2048, 'Rungis_amount_dechets_fall_2018_v2_tf', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 3, 16, 15, 52, 10), datetime.datetime(2023, 3, 16, 15, 52, 10)) model_name : Rungis_amount_dechets_fall_2018_v2_tf model_param file didn't exist model_name : Rungis_amount_dechets_fall_2018_v2_tf model_type : tf_classification2 list file need : ['Confusion_Matrix.png', 'Precision_Recall_05102018_Papier_non_papier_dense.jpg', 'Precision_Recall_05102018_Papier_non_papier_peu_dense.jpg', 'Precision_Recall_05102018_Papier_non_papier_presque_vide.jpg', 'Precision_Recall_05102018_Papier_non_papier_tres_dense.jpg', 'Precision_Recall_05102018_Papier_non_papier_tres_peu_dense.jpg', 'Result_Summary.txt', 'checkpoint', 'model_checkpoint.ckpt.data-00000-of-00001', 'model_checkpoint.ckpt.data-00000-of-00002', 'model_checkpoint.ckpt.data-00001-of-00002', 'model_checkpoint.ckpt.index', 'model_weights.h5'] file exist in s3 : ['Confusion_Matrix.png', 'Precision_Recall_05102018_Papier_non_papier_dense.jpg', 'Precision_Recall_05102018_Papier_non_papier_peu_dense.jpg', 'Precision_Recall_05102018_Papier_non_papier_presque_vide.jpg', 'Precision_Recall_05102018_Papier_non_papier_tres_dense.jpg', 'Precision_Recall_05102018_Papier_non_papier_tres_peu_dense.jpg', 'Result_Summary.txt', 'checkpoint', 'model_checkpoint.ckpt.data-00000-of-00001', 'model_checkpoint.ckpt.data-00000-of-00002', 'model_checkpoint.ckpt.data-00001-of-00002', 'model_checkpoint.ckpt.index', 'model_weights.h5'] file manque in s3 : [] 2025-05-26 12:14:48.835124: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.02G (3246391296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 12:14:48.835797: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.72G (2921752064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Confusion_Matrix.png size_local : 67810 size in s3 : 67810 create time local : 2023-10-30 16:21:37 create time in s3 : 2023-10-30 14:09:29 Confusion_Matrix.png already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Precision_Recall_05102018_Papier_non_papier_dense.jpg size_local : 73949 size in s3 : 73949 create time local : 2023-10-30 16:21:38 create time in s3 : 2023-10-30 14:09:30 Precision_Recall_05102018_Papier_non_papier_dense.jpg already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Precision_Recall_05102018_Papier_non_papier_peu_dense.jpg size_local : 85572 size in s3 : 85572 create time local : 2023-10-30 16:21:38 create time in s3 : 2023-10-30 14:09:39 Precision_Recall_05102018_Papier_non_papier_peu_dense.jpg already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Precision_Recall_05102018_Papier_non_papier_presque_vide.jpg size_local : 72361 size in s3 : 72361 create time local : 2023-10-30 16:21:38 create time in s3 : 2023-10-30 14:09:37 Precision_Recall_05102018_Papier_non_papier_presque_vide.jpg already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Precision_Recall_05102018_Papier_non_papier_tres_dense.jpg size_local : 83567 size in s3 : 83567 create time local : 2023-10-30 16:21:38 create time in s3 : 2023-10-30 14:09:48 Precision_Recall_05102018_Papier_non_papier_tres_dense.jpg already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Precision_Recall_05102018_Papier_non_papier_tres_peu_dense.jpg size_local : 71611 size in s3 : 71611 create time local : 2023-10-30 16:21:38 create time in s3 : 2023-10-30 14:09:29 Precision_Recall_05102018_Papier_non_papier_tres_peu_dense.jpg already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Result_Summary.txt size_local : 1058 size in s3 : 1058 create time local : 2023-10-30 16:21:38 create time in s3 : 2023-10-30 14:09:30 Result_Summary.txt already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/checkpoint size_local : 99 size in s3 : 99 create time local : 2023-10-30 16:21:38 create time in s3 : 2023-10-30 14:09:36 checkpoint already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/model_checkpoint.ckpt.data-00000-of-00001 size_local : 188538519 size in s3 : 188538519 create time local : 2023-10-30 16:21:41 create time in s3 : 2023-10-30 14:09:40 model_checkpoint.ckpt.data-00000-of-00001 already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/model_checkpoint.ckpt.data-00000-of-00002 size_local : 216572 size in s3 : 216572 create time local : 2023-10-30 16:21:41 create time in s3 : 2023-03-16 14:52:09 model_checkpoint.ckpt.data-00000-of-00002 already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/model_checkpoint.ckpt.data-00001-of-00002 size_local : 32279708 size in s3 : 32279708 create time local : 2023-10-30 16:21:42 create time in s3 : 2023-03-16 14:52:07 model_checkpoint.ckpt.data-00001-of-00002 already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/model_checkpoint.ckpt.index size_local : 28001 size in s3 : 28001 create time local : 2023-10-30 16:21:42 create time in s3 : 2023-10-30 14:09:30 model_checkpoint.ckpt.index already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/model_weights.h5 size_local : 94501976 size in s3 : 94501976 create time local : 2023-10-30 16:21:44 create time in s3 : 2023-10-30 14:09:37 model_weights.h5 already exist and didn't need to update desc size : 2048 Model: "sequential" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= module (KerasLayer) (None, 2048) 23561152 _________________________________________________________________ Rungis_amount_dechets_fall_2 (None, 5) 10245 ================================================================= Total params: 23,571,397 Trainable params: 10,245 Non-trainable params: 23,561,152 _________________________________________________________________ Loading Weights... time used to create the model : 8.566028118133545 time used to load_weights : 0.20795917510986328 0it [00:00, ?it/s] 32it [00:00, 318.76it/s] 64it [00:00, 298.78it/s] 94it [00:00, 288.17it/s]temp/1748254393_3500540_1360627638_4f687f7f1209b17ba439648ab5e9a363.jpg temp/1748254393_3500540_1360627325_f708185e2feea08ca32b6496be3b3843.jpg temp/1748254393_3500540_1360627284_6f303cca3d84e59e8c2cf28198476e5f.jpg temp/1748254393_3500540_1360627240_8ac458bfcfa0a41a01400c30a9313ac7.jpg temp/1748254393_3500540_1360627185_c30d686b256ba33b870aed2113fd6f39.jpg temp/1748254393_3500540_1360627112_11e808ba6aaf450e11752a2339b24d35.jpg temp/1748254393_3500540_1360627044_6635235c727d26f3d9aac9550b0c0ced.jpg temp/1748254393_3500540_1360626429_b68c493eddb428433095fecce396b28f.jpg temp/1748254393_3500540_1360626342_93911776d3d0c2285b941c4a3b37b0cf.jpg temp/1748254393_3500540_1360626290_22c337cf01efc61b682c55cefcc16087.jpg temp/1748254393_3500540_1360626255_062435278255dfb243c94d3da741872a.jpg temp/1748254393_3500540_1360626225_65de2821373c50f571fe574b6854042b.jpg temp/1748254393_3500540_1360626188_5d08746d6e44fea56bce6083fc5ea6b1.jpg temp/1748254393_3500540_1360625900_b731fb4268f081403d2b3d37dbbabaf0.jpg temp/1748254393_3500540_1360625856_1b9ca6cf8ef896c17cf062df5a27964e.jpg temp/1748254393_3500540_1360625803_7ce4a54aa474f7e67015bb788e2b47b5.jpg temp/1748254393_3500540_1360625778_c11203ef1188177fc6a3a5d998b94d34.jpg temp/1748254393_3500540_1360625752_eedccfe937efd37b922132a587aa678a.jpg temp/1748254393_3500540_1360625727_920b11552fb773729e5f98930cf4d763.jpg temp/1748254393_3500540_1360625642_19e539b801e5da4b54d5cd6318923bdf.jpg temp/1748254393_3500540_1360625616_58b4e746b6cdf4486e9f63c5dd312689.jpg temp/1748254393_3500540_1360625591_5cf18a97c56e67da36ada2004ab3bea8.jpg temp/1748254393_3500540_1360625565_b4e1aa818d172cc74d36a046d0e834ea.jpg temp/1748254393_3500540_1360625536_4c6b64625a5652d0efdd225386001363.jpg temp/1748254393_3500540_1360625505_1406b44600719275fcc144b3e9df7fee.jpg temp/1748254393_3500540_1360625430_6cbdd8a728882384a734e3d744454658.jpg temp/1748254393_3500540_1360625400_2322ca7cb88c41568a56c5364344411c.jpg temp/1748254393_3500540_1360625376_2e115444d32d8638c73aa54b8b6c02ca.jpg temp/1748254393_3500540_1360625350_f8f883b67a31f55bd06bee87ba477510.jpg temp/1748254393_3500540_1360625338_e8bc62fb7450ea747ca5c4cb4f97f641.jpg temp/1748254393_3500540_1360625335_e06b289979324e8b03d6203cf247bfc6.jpg temp/1748254393_3500540_1360625292_40d349ef452683d17752534461020c94.jpg temp/1748254393_3500540_1360625266_fe40b44093b04b34c9acbe754b76b284.jpg temp/1748254393_3500540_1360625239_31cee95f32216bf6ac60e7b94fb0546e.jpg temp/1748254393_3500540_1360625231_642c26ca5638851cb331b974f447b4f4.jpg temp/1748254393_3500540_1360625228_d73f9da5fdddf515987f971e079ba7df.jpg temp/1748254393_3500540_1360625218_f0825362052b6a19f70677905fc9d3fe.jpg temp/1748254393_3500540_1360625116_c214d865c769006bb9b4473bf56ea50b.jpg temp/1748254393_3500540_1360625091_1f413920a92ff6a8084d3db6733213a9.jpg temp/1748254393_3500540_1360625064_cfcb1a2ad8889d769660d0e42607a734.jpg temp/1748254393_3500540_1360625036_10f72f1a667f6183cdfb45cee5d9d3c0.jpg temp/1748254393_3500540_1360625007_acb21844d0564746346d09e9678f1fa4.jpg temp/1748254393_3500540_1360624998_21f2776b93c72d978db0b3bc14ed8ea0.jpg temp/1748254393_3500540_1360624979_a93344ec93d8da1b4d2e23ca5e63f592.jpg temp/1748254393_3500540_1360624968_9c3c8b458d01e6083f7130f9a06fe5f0.jpg temp/1748254393_3500540_1360624963_7fb21746da7207b643b9c850a1e4c70f.jpg temp/1748254393_3500540_1360624955_b4b83611ca3b45ab898febd12ad04678.jpg temp/1748254393_3500540_1360624952_f6ab501bc3ef1a2ea08443777a6411fa.jpg temp/1748254393_3500540_1360624949_be28de653428959c9d1ba7e03386ab80.jpg temp/1748254393_3500540_1360624945_478a1ebf7fd75495381c9f0036acd399.jpg temp/1748254393_3500540_1360624940_b318c8942a24f69aa1bd34917977293e.jpg temp/1748254393_3500540_1360624934_ec75605f702a16b34cf6641de7d2ffd9.jpg temp/1748254393_3500540_1360624929_a3a5aa6f77d4c5e4b61c69492cc67c7b.jpg temp/1748254393_3500540_1360624922_dbc119b624c3433ed3b26e2bb3efe8d1.jpg temp/1748254393_3500540_1360624913_e2450081e7049dce9407f08ad0ec4ce1.jpg temp/1748254393_3500540_1360624902_0892e5513ba02d64e5eb1eed3d36f4db.jpg temp/1748254393_3500540_1360624898_69f8a2e8331de6e2d998d50adf256c97.jpg temp/1748254393_3500540_1360624896_9f89543a55d2ec8e18bc447a0ae6b47f.jpg temp/1748254393_3500540_1360624894_ca85fdf2dcd072eca177d9e7c4316e5b.jpg temp/1748254393_3500540_1360624892_c3b674cfd66886874a52a977dd60714e.jpg temp/1748254393_3500540_1360624887_49c3fbb614a3301d8ad176771d88c847.jpg temp/1748254393_3500540_1360624872_019c80dc7f6d1a18c05733dcd19a954b.jpg temp/1748254393_3500540_1360624867_6376fb2210d281b734226c2009daf1f3.jpg temp/1748254393_3500540_1360624862_3c7fe42d1c630681c532efec7963c1be.jpg temp/1748254393_3500540_1360624837_0a2da2082629c16546324066c509505e.jpg temp/1748254393_3500540_1360624821_0f1222c8c2c71176b511f78a83cd3a61.jpg temp/1748254393_3500540_1360624817_5dabfc0a2b7796d57a818740db06653e.jpg temp/1748254393_3500540_1360624765_37e9120b6f5294de8ec9eee8f0996a90.jpg temp/1748254393_3500540_1360624739_764f8fbabd4d155c95d930242d46fbac.jpg temp/1748254393_3500540_1360624725_9e3714e3b6a7e6ca5aa3df88368d59c5.jpg temp/1748254393_3500540_1360624720_2e4e0dd4861ff929660e5cc14f42c2a3.jpg temp/1748254393_3500540_1360624704_3c1c15dc05f891a4b62f15e663301702.jpg temp/1748254393_3500540_1360624677_2de7d0f7abd89bdf1b552cef5b3667c2.jpg temp/1748254393_3500540_1360624597_7a926de8e454b4074db3066f94288366.jpg temp/1748254393_3500540_1360624594_0eafc8605a20e625eceaa57a7d472365.jpg temp/1748254393_3500540_1360624591_e30619e205b5b586cb0ac4476505b5d3.jpg temp/1748254393_3500540_1360624587_d19b81153eea05243e13af9633eeb5c3.jpg temp/1748254393_3500540_1360624582_f87ac98c257c233e40495638217e085d.jpg temp/1748254393_3500540_1360624576_ae3f045a1b1abe96840e7dc9af07ecc4.jpg temp/1748254393_3500540_1360624554_acf8533ef5382d08ec4d87c1a77ad64b.jpg temp/1748254393_3500540_1360624549_59a052fd21f352e815a94dafdb86363c.jpg temp/1748254393_3500540_1360624538_abbf51b7d892808add6a54da6514c681.jpg temp/1748254393_3500540_1360624512_fb5d9f8ce9eadee972e9bac094492691.jpg temp/1748254393_3500540_1360624487_9f9f056759ba639312008f4eeed845e2.jpg temp/1748254393_3500540_1360624469_82c5b5ad368baea3739152b9ce0fcfc7.jpg temp/1748254393_3500540_1360624414_7fb85aeec7ca15698a71d504c06c121e.jpg temp/1748254393_3500540_1360624390_695ff6b85bcf824d7b0472a696f9bea8.jpg temp/1748254393_3500540_1360624384_73f541b0c57780f1f9b953ef33ea165c.jpg temp/1748254393_3500540_1360624379_7e3fa1911630b2027fee1a5049b8f4ef.jpg temp/1748254393_3500540_1360624348_1534025cca48b206f2a910849f3aade0.jpg temp/1748254393_3500540_1360624319_683d38a5f8140beffd55bf2c6e6d692f.jpg temp/1748254393_3500540_1360624272_9cd915c7b53d6c889840c55028fed66d.jpg temp/1748254393_3500540_1360624268_178c97c71196f1cea7823c21855a7bde.jpg temp/1748254393_3500540_1360624262_e82b59bee78c204d6c4578e279c584f5.jpg temp/1748254393_3500540_1360624238_24d928c43b9ca1466a15c603d375f7ff.jpg temp/1748254393_3500540_1360624212_9dec50b194cf4f5f75f58ecaa5ee683f.jpg temp/1748254393_3500540_1360624185_01381e314044be836ff57d0596c4d8d0.jpg temp/1748254393_3500540_1360624158_4100113b566fcdadd8641ff03da9b45f.jpg temp/1748254393_3500540_1360624142_db713b14ddca521fc19d18e682129cde.jpg temp/1748254393_3500540_1360624127_9353d63be2decaf19ffabf5c75232af4.jpg temp/1748254393_3500540_1360624111_6a8b8240b84363a503ddef7409abc7ec.jpg temp/1748254393_3500540_1360624087_b0c5754beab57558006512a7a23350e7.jpg temp/1748254393_3500540_1360624061_1aad6fda418a87a63805dc952d492a18.jpg temp/1748254393_3500540_1360623969_9377a907839969997e71c37c1fd15091.jpg temp/1748254393_3500540_1360623948_1e9dd787d0ea6f5b5e47f99c14e4dc44.jpg temp/1748254393_3500540_1360623916_84ebbb184795209c176fa056279fe1bf.jpg temp/1748254393_3500540_1360623877_50b6a1acfb5f14cceb0bab87d4e007f5.jpg temp/1748254393_3500540_1360623835_827e5c62cf8ba0abdf18de989451eaa9.jpg temp/1748254393_3500540_1360623812_c8d7da496b3fa6c46b3486db1cb50a80.jpg temp/1748254393_3500540_1360623615_03f146747f74e651075b965ff5ec5cef.jpg temp/1748254393_3500540_1360623587_c71ec74dc1a1cce133d2d92505999320.jpg temp/1748254393_3500540_1360623560_77f947dbce7533eca5fe08fb92d7736e.jpg temp/1748254393_3500540_1360623528_b3a96dc87b5851846ce69ca0927a6533.jpg 129it [00:00, 308.38it/s] 160it [00:00, 307.89it/s] 191it [00:00, 306.41it/s] 222it [00:00, 268.75it/s]temp/1748254393_3500540_1360623517_0c83ef95cb07e1b300146ff8571f9503.jpg temp/1748254393_3500540_1360623514_4f891a76decb73bc5a6f00ead02135bc.jpg temp/1748254393_3500540_1360623491_8f105441e7168d6271cb199fa8b2b5dc.jpg temp/1748254393_3500540_1360623485_7fc8b4faac3c5f63cbce8ee6c26df6be.jpg temp/1748254393_3500540_1360623479_e346bb54404bc9e2c6f81b840a0adf8a.jpg temp/1748254393_3500540_1360623474_52e18dfef922168123a4c666b7b2bc87.jpg temp/1748254393_3500540_1360623469_7da00ce496731aa7ff4c29f16a3dc51a.jpg temp/1748254393_3500540_1360623464_cabbe7bcf9c4272a2bd9797265d2de6c.jpg temp/1748254393_3500540_1360623452_3b6db5f1debde290e68ad12ae546605b.jpg temp/1748254393_3500540_1360623449_b3c05a276753d99c2a787188ce754e3d.jpg temp/1748254393_3500540_1360623439_3c614a296d7d9eeaacc03a767be586ee.jpg temp/1748254393_3500540_1360623414_8e04a7e3914aba64f74f18dcaaae4d12.jpg temp/1748254393_3500540_1360623388_6b18959f2092a457d8b4b5b3ab1c7b1f.jpg temp/1748254393_3500540_1360623361_25384f15078d1334e11bf77e3953b9a7.jpg temp/1748254393_3500540_1360623202_9dbd60db13151b065d8a2d394d871eec.jpg temp/1748254393_3500540_1360623178_227324185d6645d801d5aa513e7cf524.jpg temp/1748254393_3500540_1360623149_3703b39838284d7534445b5acc184606.jpg temp/1748254393_3500540_1360623127_6a50903d2bcb78c04c56d949ca678b39.jpg temp/1748254393_3500540_1360623121_2f4e1bbd2a2d66db3c49af855ce8a1a2.jpg temp/1748254393_3500540_1360623116_68dc9c6060b5b3f57a969beb70b39eb4.jpg temp/1748254393_3500540_1360623101_13f6b0851abcb6a1286e64f6f944c9b1.jpg temp/1748254393_3500540_1360623095_c13bd88dc907eac6f44f43db30d084b9.jpg temp/1748254393_3500540_1360623090_a76c6c0e0171661db86540c08064c697.jpg temp/1748254393_3500540_1360623087_aeae12ea66dcab71abd59f7bc94ff09c.jpg temp/1748254393_3500540_1360623081_95092acaaff9e73cf68dfb2e9dabbaa0.jpg temp/1748254393_3500540_1360623073_de4a57de6233a07b662f272c4463aa71.jpg temp/1748254393_3500540_1360623007_57c286383485534aeda19faf37d35152.jpg temp/1748254393_3500540_1360622981_6964ce2229f6c5cf561580e942d11689.jpg temp/1748254393_3500540_1360622939_0919bda05b19db85bed04ac54327ef67.jpg temp/1748254393_3500540_1360622900_6cd349f31631003f84b20fbe7970ca31.jpg temp/1748254393_3500540_1360622873_171b6b0d1f2a63e5e146c760bf1e9fff.jpg temp/1748254393_3500540_1360622836_58568b12538bb870c0fa535c236c371a.jpg temp/1748254393_3500540_1360622740_ec83f371b1d8cca6469e63985a8aa3b4.jpg temp/1748254393_3500540_1360622701_9fc3aac4b461a932dd8da6366a8dbf2c.jpg temp/1748254393_3500540_1360622640_ab03f9263fead72b229f21e3513a00b9.jpg temp/1748254393_3500540_1360622577_2761840cf5dd060cb4b1f44e0ed043e4.jpg temp/1748254393_3500540_1360622537_3e7ecbb8830d752ac78c477dfcf1fe32.jpg temp/1748254393_3500540_1360622483_e97c9d5da4316f407890ae97a6e477f6.jpg temp/1748254393_3500540_1360622350_edf7babc958ac875424f9526eeb770ed.jpg temp/1748254393_3500540_1360622322_217ac87ddb0efc0b11c68520f16eb2c1.jpg temp/1748254393_3500540_1360622286_3033e221c3a0ec4ac987cc0d90ad9b9e.jpg temp/1748254393_3500540_1360622242_8e59ed2bef0da9ef53447f15f2b76755.jpg temp/1748254393_3500540_1360622194_422d4f26217c1466fd47e77e1431a99a.jpg temp/1748254393_3500540_1360622151_1e506de41a2bb0e4101312e494dc3ccc.jpg temp/1748254393_3500540_1360622052_c52839aef3565c76b62c92abf2100169.jpg temp/1748254393_3500540_1360622028_b70cc51a4777aa59180179659613313b.jpg temp/1748254393_3500540_1360621989_ee86a50a16b72a5768c3d512d371f504.jpg temp/1748254393_3500540_1360621970_05a339083bd94d9dcb144a4be9be25af.jpg temp/1748254393_3500540_1360621965_1f41f4522839eb8da4e1bdc3aa8f5e5e.jpg temp/1748254393_3500540_1360621938_9e975a28ec2f83bf1295a2684e270048.jpg temp/1748254393_3500540_1360621901_43148505a39ef97630b85df157dbbc5e.jpg temp/1748254393_3500540_1360621889_7284fa49a4aa41836fa4523ed2deed42.jpg temp/1748254393_3500540_1360621872_a5aa4c16622921721ec5a58d944b7d43.jpg temp/1748254393_3500540_1360621862_9f9b2a9649d4902905bc52d1496325dd.jpg temp/1748254393_3500540_1360621845_104d1925d12fb0ed1e564c1c0b26a0bd.jpg temp/1748254393_3500540_1360621819_3001292e6de787b12b4e4402d4a6b23c.jpg temp/1748254393_3500540_1360621754_5376a0e192ca501df20a6dce5905e7ec.jpg temp/1748254393_3500540_1360621752_990522920728e05b406a93464da37c71.jpg temp/1748254393_3500540_1360621746_9f461d455e2202805c198967215bb154.jpg temp/1748254393_3500540_1360621723_2404f1d4c0dde87f7ae6105eb7ca9845.jpg temp/1748254393_3500540_1360621694_252a3c3db2ad1ac8a671b36b786033dd.jpg temp/1748254393_3500540_1360621641_547ba1f6d46108661d0dbd54c7e9f1ad.jpg temp/1748254393_3500540_1360621508_650e73b6b04d4a8833d7c1b34cc1842c.jpg temp/1748254393_3500540_1360621465_cdd1f7e81796553e34f92396b49795f2.jpg temp/1748254393_3500540_1360621411_eee3241e6d48547a9be3533745129ef3.jpg temp/1748254393_3500540_1360621347_5f84eabd274d469ca47309d7c5a10b95.jpg temp/1748254393_3500540_1360621282_a4821335818d7a32db972f221b4722d6.jpg temp/1748254393_3500540_1360621238_bf0ade36f5dba52933cf885ed866a727.jpg temp/1748254393_3500540_1360621129_32830da97aa23097fb8f1d4ea577f5a3.jpg temp/1748254393_3500540_1360621059_3a1cb31530c22dbe7932b0bcaf25e9ae.jpg temp/1748254393_3500540_1360620978_308e7f94cf690a5e30a74573c3da440a.jpg temp/1748254393_3500540_1360620926_9010f98f6bf5338eed8866baea4ffb59.jpg temp/1748254393_3500540_1360620899_ae83068ec888c5e990a07a55c77b1352.jpg temp/1748254393_3500540_1360620872_d46aaa45e9bbf57bd23301de3723ab20.jpg temp/1748254393_3500540_1360620730_abdc730d3b3b19c3fd98a5362bdf526a.jpg temp/1748254393_3500540_1360620674_6005702f0a9544b746be5c3900509c3d.jpg temp/1748254393_3500540_1360620606_b428197c5fc2fcdc559aae3ac707da3a.jpg temp/1748254393_3500540_1360620540_372f501baf3b428f626b715116ef9a1e.jpg temp/1748254393_3500540_1360620472_1774f14da8d3203392241ddeb260757a.jpg temp/1748254393_3500540_1360620409_9a9f27f71152db7370c1b0f8bc1461c1.jpg temp/1748254393_3500540_1360620321_d05065f7c703821ebc4759c9a7ef14f6.jpg temp/1748254393_3500540_1360620292_bcf097d3787e03c642bf5e8fdbd5528a.jpg temp/1748254393_3500540_1360620246_c9ad29d927e941d9e58e26b411967a16.jpg temp/1748254393_3500540_1360620200_c85715a0b335122bbfb90ea02864198d.jpg temp/1748254393_3500540_1360620154_c6873d018b33dd6460bb1be59f6225f4.jpg temp/1748254393_3500540_1360620106_4307f322702721ec7fd4cc4251076990.jpg temp/1748254393_3500540_1360619965_61d08593b23d70452d2e65feef8f8e07.jpg temp/1748254393_3500540_1360619915_f76162eebeb041c6d8c2c72417e30adb.jpg temp/1748254393_3500540_1360619888_fdba6ea9bc21eb494a9fde23b9033bce.jpg temp/1748254393_3500540_1360619865_78c3ebb9bb81ac2f5b6bafbfa7b72190.jpg temp/1748254393_3500540_1360619840_c736f54d9e1ecaac1cb8ce0cc9027d32.jpg temp/1748254393_3500540_1360619833_5a5d3ccd8c4543895c13c0e37369fc88.jpg temp/1748254393_3500540_1360619827_90fbdc245f02f5ed16dc15723668d37c.jpg temp/1748254393_3500540_1360619823_69e3dfee54b3abfdc9e7aa9e1854d7b6.jpg temp/1748254393_3500540_1360619819_d8638de537940cb72f74e78152fdc647.jpg temp/1748254393_3500540_1360619812_51c06b6d50127e31e6f1fc1212e4703c.jpg temp/1748254393_3500540_1360619807_ecb390aa7cab52e1b0e90cf87da3a634.jpg temp/1748254393_3500540_1360619804_66318d5efc37c1b4da7e65700e999be1.jpg temp/1748254393_3500540_1360619793_9edfbb8a25e582ed08a2b0fc66ccf360.jpg temp/1748254393_3500540_1360619784_f98824b7f9b43be12bee0a2d4dee9979.jpg temp/1748254393_3500540_1360619782_c3c2415c4d48711ef796f78da578eb0f.jpg temp/1748254393_3500540_1360619779_d530f1780c62dd91af16a90cf3094108.jpg temp/1748254393_3500540_1360619774_1778c81c615a380300c8fa9dbf0a20c5.jpg temp/1748254393_3500540_1360619769_ad01dad392656a68c7baf4d9f894743f.jpg temp/1748254393_3500540_1360619751_51cdff2c215373d0a66931d2f961e7cd.jpg temp/1748254393_3500540_1360619746_b0896d65a4f4e11e25b242c41f8fdf75.jpg temp/1748254393_3500540_1360619743_bda53d8d6e4204c1d998413484bb8a64.jpg temp/1748254393_3500540_1360619736_dc2d05c17d13f52c61276c96e0b8ad70.jpg temp/1748254393_3500540_1360619734_04db14b51c5af4c0e8430544af14e5ec.jpg temp/1748254393_3500540_1360619732_eae6da740325c63682831384d99231f7.jpg temp/1748254393_3500540_1360619727_8cdcbceaf23c3f0a20bd08bcf380fc51.jpg temp/1748254393_3500540_1360619723_73c4f4e86e13b6a2f2c1c094411251a3.jpg temp/1748254393_3500540_1360619719_30d1b4b3ea7fcf8bc9c1557be66e5ae1.jpg 253it [00:00, 279.44it/s] 282it [00:00, 278.18it/s] 300it [00:01, 290.08it/s]2025-05-26 12:14:53.512060: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 12:14:53.642184: E tensorflow/stream_executor/cuda/cuda_blas.cc:238] failed to create cublas handle: CUBLAS_STATUS_NOT_INITIALIZED 2025-05-26 12:14:53.728942: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 12:14:53.732270: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-26 12:14:53.734653: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR temp/1748254393_3500540_1360619713_f06033a0920becef1ad4cbf864f7c892.jpg temp/1748254393_3500540_1360619707_1170707427bc44f99c655ccaab87caf0.jpg temp/1748254393_3500540_1360619703_97fcd36dd2621cf4ad7dc3bc59c26842.jpg temp/1748254393_3500540_1360619657_3ed8eebe754321bbed0825eef516e634.jpg temp/1748254393_3500540_1360619631_ff8a698c7fcde60199c37bb0c10ee0c3.jpg temp/1748254393_3500540_1360619614_ceb5631a75140a1e942e8a2fe709339b.jpg temp/1748254393_3500540_1360619601_1e25c80e14c3f9deb1ac98ce8d417c6f.jpg temp/1748254393_3500540_1360619589_eeb501e6891832c8b08f17044b9c903a.jpg temp/1748254393_3500540_1360619559_ce2f62f0d7ce5272f406f9934dd3ad08.jpg temp/1748254393_3500540_1360619500_8854355622a4d6210ba98c1eecf3f8a2.jpg temp/1748254393_3500540_1360619467_3d9f2d86953e5e070b6bcf730715866e.jpg temp/1748254393_3500540_1360619353_61a2a3184c0d9f16121f1576b0664da9.jpg temp/1748254393_3500540_1360619328_9ae673965545884d92eb672a4dfadc04.jpg temp/1748254393_3500540_1360619310_118b91fb9086e1d4a02699d2ec3eaf51.jpg temp/1748254393_3500540_1360619278_55cd78a45954ed17695255d5adad6cd4.jpg temp/1748254393_3500540_1360619237_b461eff64345214b7bf84db8b433c176.jpg temp/1748254393_3500540_1360619215_6a5c6e30d1205a5901c8890862b2de82.jpg temp/1748254393_3500540_1360619188_5a065a8de91d2771f517aeee5bd86ddf.jpg temp/1748254393_3500540_1360619145_5c55498ded5b74a6c4ad4864e2eac67b.jpg temp/1748254393_3500540_1360619115_0a7df5cd87575f65cbcfbe7b37b2a0a3.jpg temp/1748254393_3500540_1360619091_516d10c9db3b470bffe82d6e1af798eb.jpg temp/1748254393_3500540_1360619052_b0741e9460fd8f916713262c7223ba4d.jpg temp/1748254393_3500540_1360619045_db2d27ade99e60877c4e1afe4823960f.jpg temp/1748254393_3500540_1360619014_6db5247f724c4f19769523b98a473d99.jpg temp/1748254393_3500540_1360618984_f892e0af48fef739c7ff76ab754976d3.jpg temp/1748254393_3500540_1360618949_f3e49d6c8d0f56f6c91738918ec47be1.jpg temp/1748254393_3500540_1360618912_6cc67c49f85ef44a196a7edaf2e77b32.jpg temp/1748254393_3500540_1360618793_fd01edf3eb412b017877efe44cea2b1e.jpg temp/1748254393_3500540_1360618791_d0cdd475aef35364de17f06f021f2aee.jpg temp/1748254393_3500540_1360618787_148223f77a127624f91917c07882d1b4.jpg temp/1748254393_3500540_1360618783_04d006892977cb817a6aa5d3311fa459.jpg temp/1748254393_3500540_1360618777_56c824d055c02c0610a805be879e395e.jpg temp/1748254393_3500540_1360618730_e02225f3d3317a3fc1aebc5ea8bd7f96.jpg temp/1748254393_3500540_1360618635_d9abf8e976a3323aa38cafa46d165479.jpg temp/1748254393_3500540_1360618630_b4ede212e1bd19c4b9fac3cbb70fdaf3.jpg temp/1748254393_3500540_1360618603_bf7675a63003bc4624732a4d12a26d41.jpg temp/1748254393_3500540_1360618580_ba719f4e09925a3fde3cbce6c02cc103.jpg temp/1748254393_3500540_1360618549_b9db0107eeec8ff9585d784af0241bf6.jpg temp/1748254393_3500540_1360618504_91fef1aa238601d34839d9ff9eb2dd44.jpg temp/1748254393_3500540_1360618386_fd971badbbea749b05db4709a76bf888.jpg temp/1748254393_3500540_1360618338_7dc830ed756f825d391cbef6c2cc8106.jpg temp/1748254393_3500540_1360618299_81850a4ad59aa6b8b2a28baa6bb6653a.jpg temp/1748254393_3500540_1360618262_39c35bbeb835533caa85cbfe232c2622.jpg temp/1748254393_3500540_1360618211_cdc533e8f7b9b0fea71db595f5a38e7c.jpg temp/1748254393_3500540_1360618155_6c93350d34e5275d3a97d671986ba487.jpg temp/1748254393_3500540_1360618046_4fe4cdb1621e3f2f96c2ef35de2e6d8a.jpg temp/1748254393_3500540_1360618021_834cc53a16e21f12d0b36fc1919778b9.jpg temp/1748254393_3500540_1360617994_2d35893df7759ccef874dac07d3e5014.jpg temp/1748254393_3500540_1360617968_695b9a8e2815399a29c0f00b43f49f7e.jpg temp/1748254393_3500540_1360617943_6833b81f60af4a517696b2281eb20fc7.jpg temp/1748254393_3500540_1360617908_d6cf6a5fff6b5f5d1ebeb25d19fadf7c.jpg temp/1748254393_3500540_1360617762_95bbf8421de84fe399916b4be23cab15.jpg temp/1748254393_3500540_1360617727_64ec04f2aff8967b20ed2c46841704e9.jpg temp/1748254393_3500540_1360617673_a38a404513ca2f0720d0d768d28de1dc.jpg temp/1748254393_3500540_1360617634_53fdda051d1aae5a65c9c5c6f5719aaf.jpg temp/1748254393_3500540_1360617606_9fc486db30cef7965a8aaf7a23ab5365.jpg temp/1748254393_3500540_1360617578_fc3e079ee721300dbfbaa0313ce9a479.jpg temp/1748254393_3500540_1360617492_5419e35af27a01424e9836b520c21dd7.jpg temp/1748254393_3500540_1360617466_8f904752eba54035b613e047c4bfd0a3.jpg temp/1748254393_3500540_1360617442_edaa5a9bb42122ea1d9020d1b5dd3374.jpg temp/1748254393_3500540_1360617435_c960143feaf39a5b392da82b5105e2ef.jpg temp/1748254393_3500540_1360617432_d3d26456de9bd40ac8285d2074c19048.jpg temp/1748254393_3500540_1360617428_28ca20d26dbc5edb973f41e1e933506f.jpg temp/1748254393_3500540_1360617421_784fa6303f143bb13a07974a7055b70d.jpg temp/1748254393_3500540_1360617417_0a6bda66da09dee5664e629a03dc658d.jpg temp/1748254393_3500540_1360617412_8e69fbabd8381aaa604cb3b118eaf995.jpg temp/1748254393_3500540_1360617396_d384035fb5a3e9e858885b0fc9d1c91a.jpg temp/1748254393_3500540_1360617385_f4679b50fde0d40e926f325f1ea2c36d.jpg temp/1748254393_3500540_1360617380_4dbf5679865ab0042465f0c44c972e4f.jpg temp/1748254393_3500540_1360617372_9a0c12f535f2d1a2470b16316f375861.jpg temp/1748254393_3500540_1360617369_e1ece70de9b7651d688282bec68bd369.jpg temp/1748254393_3500540_1360617366_6dd2a8c478b61bab3ae30137c6884eb7.jpg temp/1748254393_3500540_1360617363_ef9d73a134cb6a58d54aea554e97f7e4.jpg temp/1748254393_3500540_1360617357_86c5a3d632a1da2d3f0c402203b6cf7d.jpg Found 300 images belonging to 1 classes. begin to do the prediction : ERROR in datou_step_exec, will save and exit ! Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[{{node model/module/StatefulPartitionedCall/StatefulPartitionedCall/StatefulPartitionedCall/conv1/StatefulPartitionedCall/Conv2D}}]] [Op:__inference_predict_function_34490] Function call stack: predict_function File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2329, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2523, in datou_step_exec return lib_process.datou_step_tfhub2(param, json_param, args, cache, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_process.py", line 3147, in datou_step_tfhub2 classes, outputs, features = this_model.predict_image_paths(list_paths, keep_aspect_ratio=keep_aspect_ratio, File "/home/admin/workarea/git/Velours/python/mtr/tfhub2/evaluate.py", line 288, in predict_image_paths Y_pred, F_pred = self.model.predict(valid_generator, validation_steps) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 88, in _method_wrapper return method(self, *args, **kwargs) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 1268, in predict tmp_batch_outputs = predict_function(iterator) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/def_function.py", line 580, in __call__ result = self._call(*args, **kwds) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/def_function.py", line 650, in _call return self._concrete_stateful_fn._filtered_call(canon_args, canon_kwds) # pylint: disable=protected-access File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 1661, in _filtered_call return self._call_flat( File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 1745, in _call_flat return self._build_call_outputs(self._inference_function.call( File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 593, in call outputs = execute.execute( File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/execute.py", line 59, in quick_execute tensors = pywrap_tfe.TFE_Py_Execute(ctx._handle, device_name, op_name, [1360627638, 1360627325, 1360627284, 1360627240, 1360627185, 1360627112, 1360627044, 1360626429, 1360626342, 1360626290, 1360626255, 1360626225, 1360626188, 1360625900, 1360625856, 1360625803, 1360625778, 1360625752, 1360625727, 1360625642, 1360625616, 1360625591, 1360625565, 1360625536, 1360625505, 1360625430, 1360625400, 1360625376, 1360625350, 1360625338, 1360625335, 1360625292, 1360625266, 1360625239, 1360625231, 1360625228, 1360625218, 1360625116, 1360625091, 1360625064, 1360625036, 1360625007, 1360624998, 1360624979, 1360624968, 1360624963, 1360624955, 1360624952, 1360624949, 1360624945, 1360624940, 1360624934, 1360624929, 1360624922, 1360624913, 1360624902, 1360624898, 1360624896, 1360624894, 1360624892, 1360624887, 1360624872, 1360624867, 1360624862, 1360624837, 1360624821, 1360624817, 1360624765, 1360624739, 1360624725, 1360624720, 1360624704, 1360624677, 1360624597, 1360624594, 1360624591, 1360624587, 1360624582, 1360624576, 1360624554, 1360624549, 1360624538, 1360624512, 1360624487, 1360624469, 1360624414, 1360624390, 1360624384, 1360624379, 1360624348, 1360624319, 1360624272, 1360624268, 1360624262, 1360624238, 1360624212, 1360624185, 1360624158, 1360624142, 1360624127, 1360624111, 1360624087, 1360624061, 1360623969, 1360623948, 1360623916, 1360623877, 1360623835, 1360623812, 1360623615, 1360623587, 1360623560, 1360623528, 1360623517, 1360623514, 1360623491, 1360623485, 1360623479, 1360623474, 1360623469, 1360623464, 1360623452, 1360623449, 1360623439, 1360623414, 1360623388, 1360623361, 1360623202, 1360623178, 1360623149, 1360623127, 1360623121, 1360623116, 1360623101, 1360623095, 1360623090, 1360623087, 1360623081, 1360623073, 1360623007, 1360622981, 1360622939, 1360622900, 1360622873, 1360622836, 1360622740, 1360622701, 1360622640, 1360622577, 1360622537, 1360622483, 1360622350, 1360622322, 1360622286, 1360622242, 1360622194, 1360622151, 1360622052, 1360622028, 1360621989, 1360621970, 1360621965, 1360621938, 1360621901, 1360621889, 1360621872, 1360621862, 1360621845, 1360621819, 1360621754, 1360621752, 1360621746, 1360621723, 1360621694, 1360621641, 1360621508, 1360621465, 1360621411, 1360621347, 1360621282, 1360621238, 1360621129, 1360621059, 1360620978, 1360620926, 1360620899, 1360620872, 1360620730, 1360620674, 1360620606, 1360620540, 1360620472, 1360620409, 1360620321, 1360620292, 1360620246, 1360620200, 1360620154, 1360620106, 1360619965, 1360619915, 1360619888, 1360619865, 1360619840, 1360619833, 1360619827, 1360619823, 1360619819, 1360619812, 1360619807, 1360619804, 1360619793, 1360619784, 1360619782, 1360619779, 1360619774, 1360619769, 1360619751, 1360619746, 1360619743, 1360619736, 1360619734, 1360619732, 1360619727, 1360619723, 1360619719, 1360619713, 1360619707, 1360619703, 1360619657, 1360619631, 1360619614, 1360619601, 1360619589, 1360619559, 1360619500, 1360619467, 1360619353, 1360619328, 1360619310, 1360619278, 1360619237, 1360619215, 1360619188, 1360619145, 1360619115, 1360619091, 1360619052, 1360619045, 1360619014, 1360618984, 1360618949, 1360618912, 1360618793, 1360618791, 1360618787, 1360618783, 1360618777, 1360618730, 1360618635, 1360618630, 1360618603, 1360618580, 1360618549, 1360618504, 1360618386, 1360618338, 1360618299, 1360618262, 1360618211, 1360618155, 1360618046, 1360618021, 1360617994, 1360617968, 1360617943, 1360617908, 1360617762, 1360617727, 1360617673, 1360617634, 1360617606, 1360617578, 1360617492, 1360617466, 1360617442, 1360617435, 1360617432, 1360617428, 1360617421, 1360617417, 1360617412, 1360617396, 1360617385, 1360617380, 1360617372, 1360617369, 1360617366, 1360617363, 1360617357] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 300 time used for this insertion : 0.13805270195007324 save_final ERROR in last step tfhub_classification2, Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[{{node model/module/StatefulPartitionedCall/StatefulPartitionedCall/StatefulPartitionedCall/conv1/StatefulPartitionedCall/Conv2D}}]] [Op:__inference_predict_function_34490] Function call stack: predict_function time spend for datou_step_exec : 40.31964921951294 time spend to save output : 0.14675188064575195 total time spend for step 0 : 40.46640110015869 need to delete datou_research and reload, so keep current state 1 caffe_path_current : About to save ! 2 After save, about to update current ! 14.94user 6.09system 1:46.03elapsed 19%CPU (0avgtext+0avgdata 1860360maxresident)k 673952inputs+1302144outputs (1296major+656429minor)pagefaults 0swaps