python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 ~/workarea/git/Velours/python/prod/datou.py -j batch_current -C 2939110' -s rattrapage -M 0 -S 0 -U 100,80,95 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/home/admin/workarea/git/apy', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3500021 load datou : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 0 init_dummy_multi_datou is not linked in the step_by_step architecture ! WARNING : step 1294 init_dummy_multi_datou is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : (photo_id, hashtag_id, score_max) was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 4243>1000 please execute split_portfolio.py -i 23282139 -l 1000 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4892, datou_cur_ids : ['2939110'] with mtr_portfolio_ids : ['23282139'] and first list_photo_ids : [] new path : /proc/3500021/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! List Step Type Loaded in datou : tfhub_classification2, argmax over limit max, limiting to limit_max 300 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 300 ; length of list_pids : 300 ; length of list_args : 300 time to download the photos : 59.49963068962097 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 2 step1:tfhub_classification2 Mon May 26 12:14:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou_step TFHub with tf2 ! nombre de thcls : 2 we are using the classfication for multi_thcl [3513, 3892] begin to check gpu status inside check gpu memory 2025-05-26 12:14:03.998799: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-26 12:14:04.031541: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 12:14:04.031849: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 12:14:04.034236: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 12:14:04.036309: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 12:14:04.036681: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 12:14:04.039320: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 12:14:04.040561: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 12:14:04.044842: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 12:14:04.045974: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 12:14:04.046368: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-26 12:14:04.071152: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-26 12:14:04.072888: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4c90000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-26 12:14:04.072923: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-26 12:14:04.192449: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x4346cf10 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-26 12:14:04.192494: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-26 12:14:04.193355: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 12:14:04.193434: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 12:14:04.193463: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 12:14:04.193491: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 12:14:04.193517: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 12:14:04.193544: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 12:14:04.193570: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 12:14:04.193597: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 12:14:04.195035: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 12:14:04.195112: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 12:14:04.195956: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 12:14:04.195981: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 12:14:04.195995: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-26 12:14:04.197446: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3096 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) l 3637 free memory gpu now : 3249 max_wait_temp : 1 max_wait : 5 1 Physical GPUs, 1 Logical GPUs tagging for thcl : 3513 To do loadFromThcl(), then load ParamDescType : thcl3513 thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] thcl {'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'} Update svm_hashtag_type_desc : 5767 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5767, 'Rungis_amount_dechets_fall_2018_v2_tf', 2048, 2048, 'Rungis_amount_dechets_fall_2018_v2_tf', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 3, 16, 15, 52, 10), datetime.datetime(2023, 3, 16, 15, 52, 10)) model_name : Rungis_amount_dechets_fall_2018_v2_tf model_param file didn't exist model_name : Rungis_amount_dechets_fall_2018_v2_tf model_type : tf_classification2 list file need : ['Confusion_Matrix.png', 'Precision_Recall_05102018_Papier_non_papier_dense.jpg', 'Precision_Recall_05102018_Papier_non_papier_peu_dense.jpg', 'Precision_Recall_05102018_Papier_non_papier_presque_vide.jpg', 'Precision_Recall_05102018_Papier_non_papier_tres_dense.jpg', 'Precision_Recall_05102018_Papier_non_papier_tres_peu_dense.jpg', 'Result_Summary.txt', 'checkpoint', 'model_checkpoint.ckpt.data-00000-of-00001', 'model_checkpoint.ckpt.data-00000-of-00002', 'model_checkpoint.ckpt.data-00001-of-00002', 'model_checkpoint.ckpt.index', 'model_weights.h5'] file exist in s3 : ['Confusion_Matrix.png', 'Precision_Recall_05102018_Papier_non_papier_dense.jpg', 'Precision_Recall_05102018_Papier_non_papier_peu_dense.jpg', 'Precision_Recall_05102018_Papier_non_papier_presque_vide.jpg', 'Precision_Recall_05102018_Papier_non_papier_tres_dense.jpg', 'Precision_Recall_05102018_Papier_non_papier_tres_peu_dense.jpg', 'Result_Summary.txt', 'checkpoint', 'model_checkpoint.ckpt.data-00000-of-00001', 'model_checkpoint.ckpt.data-00000-of-00002', 'model_checkpoint.ckpt.data-00001-of-00002', 'model_checkpoint.ckpt.index', 'model_weights.h5'] file manque in s3 : [] 2025-05-26 12:14:11.538376: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.02G (3246391296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 12:14:11.539051: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.72G (2921752064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Confusion_Matrix.png size_local : 67810 size in s3 : 67810 create time local : 2023-10-30 16:21:37 create time in s3 : 2023-10-30 14:09:29 Confusion_Matrix.png already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Precision_Recall_05102018_Papier_non_papier_dense.jpg size_local : 73949 size in s3 : 73949 create time local : 2023-10-30 16:21:38 create time in s3 : 2023-10-30 14:09:30 Precision_Recall_05102018_Papier_non_papier_dense.jpg already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Precision_Recall_05102018_Papier_non_papier_peu_dense.jpg size_local : 85572 size in s3 : 85572 create time local : 2023-10-30 16:21:38 create time in s3 : 2023-10-30 14:09:39 Precision_Recall_05102018_Papier_non_papier_peu_dense.jpg already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Precision_Recall_05102018_Papier_non_papier_presque_vide.jpg size_local : 72361 size in s3 : 72361 create time local : 2023-10-30 16:21:38 create time in s3 : 2023-10-30 14:09:37 Precision_Recall_05102018_Papier_non_papier_presque_vide.jpg already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Precision_Recall_05102018_Papier_non_papier_tres_dense.jpg size_local : 83567 size in s3 : 83567 create time local : 2023-10-30 16:21:38 create time in s3 : 2023-10-30 14:09:48 Precision_Recall_05102018_Papier_non_papier_tres_dense.jpg already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Precision_Recall_05102018_Papier_non_papier_tres_peu_dense.jpg size_local : 71611 size in s3 : 71611 create time local : 2023-10-30 16:21:38 create time in s3 : 2023-10-30 14:09:29 Precision_Recall_05102018_Papier_non_papier_tres_peu_dense.jpg already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Result_Summary.txt size_local : 1058 size in s3 : 1058 create time local : 2023-10-30 16:21:38 create time in s3 : 2023-10-30 14:09:30 Result_Summary.txt already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/checkpoint size_local : 99 size in s3 : 99 create time local : 2023-10-30 16:21:38 create time in s3 : 2023-10-30 14:09:36 checkpoint already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/model_checkpoint.ckpt.data-00000-of-00001 size_local : 188538519 size in s3 : 188538519 create time local : 2023-10-30 16:21:41 create time in s3 : 2023-10-30 14:09:40 model_checkpoint.ckpt.data-00000-of-00001 already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/model_checkpoint.ckpt.data-00000-of-00002 size_local : 216572 size in s3 : 216572 create time local : 2023-10-30 16:21:41 create time in s3 : 2023-03-16 14:52:09 model_checkpoint.ckpt.data-00000-of-00002 already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/model_checkpoint.ckpt.data-00001-of-00002 size_local : 32279708 size in s3 : 32279708 create time local : 2023-10-30 16:21:42 create time in s3 : 2023-03-16 14:52:07 model_checkpoint.ckpt.data-00001-of-00002 already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/model_checkpoint.ckpt.index size_local : 28001 size in s3 : 28001 create time local : 2023-10-30 16:21:42 create time in s3 : 2023-10-30 14:09:30 model_checkpoint.ckpt.index already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/model_weights.h5 size_local : 94501976 size in s3 : 94501976 create time local : 2023-10-30 16:21:44 create time in s3 : 2023-10-30 14:09:37 model_weights.h5 already exist and didn't need to update desc size : 2048 Model: "sequential" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= module (KerasLayer) (None, 2048) 23561152 _________________________________________________________________ Rungis_amount_dechets_fall_2 (None, 5) 10245 ================================================================= Total params: 23,571,397 Trainable params: 10,245 Non-trainable params: 23,561,152 _________________________________________________________________ Loading Weights... time used to create the model : 8.626014709472656 time used to load_weights : 0.28856682777404785 0it [00:00, ?it/s] 34it [00:00, 332.19it/s] 69it [00:00, 337.12it/s] 103it [00:00, 297.75it/s]temp/1748254381_3500021_1360856013_75350ab3b91470d63a3ba662f92a6f77.jpg temp/1748254381_3500021_1360855766_29f40b845eeda20a76d1947f0001f325.jpg temp/1748254381_3500021_1360855734_edd68117846439397a8ab17826b44095.jpg temp/1748254381_3500021_1360855721_3713b68b8d5735595ab1035dac81dec5.jpg temp/1748254381_3500021_1360855718_c0839bea1ef10cf3e13c1e926130bf0a.jpg temp/1748254381_3500021_1360855693_de683be5be09e647038cd5485efe99ee.jpg temp/1748254381_3500021_1360855690_8e6b09d163130a9cde5ad20a7e041fa0.jpg temp/1748254381_3500021_1360855663_0edd3079cfd55351a987bfb16f65258c.jpg temp/1748254381_3500021_1360855633_fc54feaa9aba33c47c42bfc66bf678a4.jpg temp/1748254381_3500021_1360855604_6302b3c86dc6b11dd97dbbfdb136b103.jpg temp/1748254381_3500021_1360855575_f691cff577ed055cbb70d7e9c3983fe3.jpg temp/1748254381_3500021_1360855443_44267d8119752ab48b0e2a6cf699a3a0.jpg temp/1748254381_3500021_1360855440_99242b1470432b83b0de0c13ef56a1da.jpg temp/1748254381_3500021_1360855426_17f466f2ccab653d2851787ac60c5f1c.jpg temp/1748254381_3500021_1360855407_1a84a478bd8f667262d90a52fca22627.jpg temp/1748254381_3500021_1360855377_c5801c2d56a636b44507c74f444103c7.jpg temp/1748254381_3500021_1360855342_d4a41cf940bfcfbe2fb900c4cd5dd4d6.jpg temp/1748254381_3500021_1360855086_96f288f96942b882f2a3f6d8135f5a6f.jpg temp/1748254381_3500021_1360855054_a73743425ec51a17f2468d83a54ed90e.jpg temp/1748254381_3500021_1360855018_2441d731d5a2be941fce4bc82c75af6e.jpg temp/1748254381_3500021_1360855012_d6750c5ee65174a907ebd08c988a293b.jpg temp/1748254381_3500021_1360855001_53a52940ebc8a2f783a64435ccda3b06.jpg temp/1748254381_3500021_1360854982_b6b47714d112fe274e79aaa1453f3a2d.jpg temp/1748254381_3500021_1360854951_ea420427f7ca046e48c15e3fc205b1e9.jpg temp/1748254381_3500021_1360854950_25b0893a2bfe71012e289b14684a4409.jpg temp/1748254381_3500021_1360854948_3ab91f542065d1c33a3cad024ae42b91.jpg temp/1748254381_3500021_1360854595_e3ed211306f8eecf6767f9922a163be2.jpg temp/1748254381_3500021_1360854564_0a03ca217c005dbc4243cabdfbc549f7.jpg temp/1748254381_3500021_1360854178_9ad3ff71e734db6f1b63b32a0694c7c1.jpg temp/1748254381_3500021_1360854149_d39c20744c2cfd351ecd891bb4a1b52c.jpg temp/1748254381_3500021_1360854019_31332205b64cc7f5159b3c46cae98908.jpg temp/1748254381_3500021_1360854015_da60fcafbdadfa5999cb850b8b3b8300.jpg temp/1748254381_3500021_1360854005_c2290d1b8244c457f138fb75ed69492f.jpg temp/1748254381_3500021_1360853850_1b46087796116833a22456d44bf148e3.jpg temp/1748254381_3500021_1360853820_41a6ea1590380a230e6e3974fce20f18.jpg temp/1748254381_3500021_1360853791_7042fa7b96a50590010cc8937e173e13.jpg temp/1748254381_3500021_1360853645_577c911f1130bae405e41bdfda67df64.jpg temp/1748254381_3500021_1360853641_4b54abad96197712b7437824d0027762.jpg temp/1748254381_3500021_1360853638_40cccdb654de0ad0a81ad17f14a2f441.jpg temp/1748254381_3500021_1360851563_65db6df40a71c764fd32ce87293912cc.jpg temp/1748254381_3500021_1360851478_2f2fd619aff02fb850d364c5d9ba3be4.jpg temp/1748254381_3500021_1360851390_20605114382f07f43c93b34534bc7796.jpg temp/1748254381_3500021_1360850875_fd2aaf18d4bf2322d19479cec58cbbff.jpg temp/1748254381_3500021_1360850851_cf2532900e848da45208e80dbf3b4f77.jpg temp/1748254381_3500021_1360850848_f5da88e8d6027ac38f3ae30e03085a65.jpg temp/1748254381_3500021_1360850847_99032b8d172a57a3956e4883f57d6568.jpg temp/1748254381_3500021_1360850845_a4ee69fc4b375c9c18bc0ec99d584cbb.jpg temp/1748254381_3500021_1360850810_49790ec174ca764b7713a4e10b19c945.jpg temp/1748254381_3500021_1360850805_7b969878f574bf068b553eaa4f4fd5ef.jpg temp/1748254381_3500021_1360850803_0a160804f99ec82030656fa8038effca.jpg temp/1748254381_3500021_1360850801_8fdf8f6fdbe1f9d77517caf7c8931b47.jpg temp/1748254381_3500021_1360850790_3064a985e0292d699d6cd9e5d5f054ba.jpg temp/1748254381_3500021_1360850772_26a5492c342513f56fa78d1b401f5a1c.jpg temp/1748254381_3500021_1360850770_8f812b0836f8542e9134ccfbb911315d.jpg temp/1748254381_3500021_1360850647_bb0ec7debc42fa47b8aab705a5ab5103.jpg temp/1748254381_3500021_1360850645_36790610313bc6065deeeb52555ef8ff.jpg temp/1748254381_3500021_1360850644_fada2888c55a6e7edfa2aca1f8e8a2ea.jpg temp/1748254381_3500021_1360850639_bb93e38b86cf86ba561cb4252d66e1b7.jpg temp/1748254381_3500021_1360850366_51fa65003f155bb3ea62f00cd01e5018.jpg temp/1748254381_3500021_1360850362_0efd4e3a83ea55239507f639ba158bea.jpg temp/1748254381_3500021_1360850357_207cee529a7317eda7d327f780d8a4e7.jpg temp/1748254381_3500021_1360850352_303920b20372433b3796a5f943bab711.jpg temp/1748254381_3500021_1360850348_6637c76f752ae35fb92dfdeef78a63de.jpg temp/1748254381_3500021_1360850268_13fffd1ee2cf2b5c54f0296ff3a22acd.jpg temp/1748254381_3500021_1360850266_e8947c513355c6e9237d05dbaccb40df.jpg temp/1748254381_3500021_1360850241_cd92c8ed5fefe4ac2adc12ce4791507c.jpg temp/1748254381_3500021_1360850239_7802d48c28f8a4e15069a8c3810f84d9.jpg temp/1748254381_3500021_1360850236_94b203f6421a0c56fea677c65b82e1c0.jpg temp/1748254381_3500021_1360850234_7774d7b6e992dac03d086f3eeceec46c.jpg temp/1748254381_3500021_1360850232_2628fcac5a04824ce8e799f7907735b0.jpg temp/1748254381_3500021_1360850229_1844f5b459a53a7372e0851d2da0b420.jpg temp/1748254381_3500021_1360850203_c34bf9bd476b2bbd623a8c28310db58f.jpg temp/1748254381_3500021_1360850200_af0f5185a5fb7dee60ff794c76b1a5f7.jpg temp/1748254381_3500021_1360850196_9981e3f84f73f5ca95c3c9180fe57c8f.jpg temp/1748254381_3500021_1360850190_212a1280dd6a3738ec934539fb527153.jpg temp/1748254381_3500021_1360850187_d512ee1aa69fa2bdad4d9fc82a5b5651.jpg temp/1748254381_3500021_1360850183_3585de9f54e72e7e6ae1913d07372395.jpg temp/1748254381_3500021_1360849987_dc0c05684aa5cc7c532a2b5bfd59c728.jpg temp/1748254381_3500021_1360849956_1439754ccb4af9eed3a1bd0c347c5476.jpg temp/1748254381_3500021_1360849925_323b4e7abf8c0e4e2001bf8479baef60.jpg temp/1748254381_3500021_1360849905_41868fc4b519743b0ba699749133391b.jpg temp/1748254381_3500021_1360849904_e4d61edba4b19d418dc1a73e5c1ba042.jpg temp/1748254381_3500021_1360849901_a7137058d1811e5a9e0b0826f707a777.jpg temp/1748254381_3500021_1360849878_73d69246e716fd0b597c8e7df380e135.jpg temp/1748254381_3500021_1360849874_51d88d7997dcec88e661578f57df65cd.jpg temp/1748254381_3500021_1360849853_96a6d04968c6a06dfe59e98f45731413.jpg temp/1748254381_3500021_1360849798_410c3c27f7089361e845dbe032b92f8a.jpg temp/1748254381_3500021_1360849737_5ced69a09d730af8a64afd9d502b37fa.jpg temp/1748254381_3500021_1360849692_3f1274bc8633e7d0ac1aca0590145575.jpg temp/1748254381_3500021_1360849602_b6a8357adfe63c76d4cd329619d2ae40.jpg temp/1748254381_3500021_1360849592_e34a1c36bc549f9e876ba090b1720202.jpg temp/1748254381_3500021_1360849562_9e1f6d96b805f5dcc385282381fed197.jpg temp/1748254381_3500021_1360849532_a65bdf4ae6f89f9a0d42e352cd9f7483.jpg temp/1748254381_3500021_1360849500_ca1861d38b313822a1ed0209486c2760.jpg temp/1748254381_3500021_1360849468_e08ec925c9a5fb131c0f12ebe300e8e2.jpg temp/1748254381_3500021_1360849253_2a370ba6475c4d922ed26e73339cbf41.jpg temp/1748254381_3500021_1360849252_49119b1d60850522d5c04dbff780339f.jpg temp/1748254381_3500021_1360848987_067e229658b56b1e0b703e6a08637865.jpg temp/1748254381_3500021_1360848602_e7c56d81ad1831f52b689103f65bd57e.jpg temp/1748254381_3500021_1360848574_6cac96dd7d0452fb9eaecf2e01a23b12.jpg temp/1748254381_3500021_1360848378_a952e4a8b34c5276ac35276e01ee4db5.jpg temp/1748254381_3500021_1360848374_92dc86598179858bbdda7ac835423e7f.jpg temp/1748254381_3500021_1360848369_4e4e0daf59bf2bc372ae53c3c6b67876.jpg temp/1748254381_3500021_1360848366_b2ff4dc6f184b2e8654b13897d8f0184.jpg temp/1748254381_3500021_1360848363_047c326c231e63310ffa464e14567f40.jpg temp/1748254381_3500021_1360848342_5f43371582e9537dd521fe54ee74aa9f.jpg temp/1748254381_3500021_1360848339_d16b522cca7b590a167bee94b2f07e85.jpg temp/1748254381_3500021_1360848335_e991d634634baeaafbcd2be43a678188.jpg temp/1748254381_3500021_1360848331_52612b347d360067aabcbb279bbf8a8f.jpg temp/1748254381_3500021_1360848329_44104a0617627ac071e6a1b91e39037e.jpg temp/1748254381_3500021_1360848326_d9b1381482be886b57663d33872ca269.jpg temp/1748254381_3500021_1360848294_26f54861650ab6533de636683efb08bb.jpg temp/1748254381_3500021_1360848265_4140e0fdcc6e5a5e241e94281eee4544.jpg 147it [00:00, 348.31it/s] 212it [00:00, 449.26it/s]temp/1748254381_3500021_1360848261_772c5a4c7d00c20801e900ae2caba9c0.jpg temp/1748254381_3500021_1360848257_84f962d6ecbf8e7eff95d1c341febc6d.jpg temp/1748254381_3500021_1360848254_f49561bc983ea37330bb3ad54b7c68d5.jpg temp/1748254381_3500021_1360848251_3197381772d8e23ac7a3275f01c6f9d6.jpg temp/1748254381_3500021_1360848223_2c4a8079d0dfcb8bbcb2111ffb9b8d2b.jpg temp/1748254381_3500021_1360848220_78bec8abf5b2e0607dd0e543d56564f4.jpg temp/1748254381_3500021_1360848215_c964fa008edb58b82b8f11878a433098.jpg temp/1748254381_3500021_1360848214_d8687f56bd16f790b61a867b526b4f0a.jpg temp/1748254381_3500021_1360848213_207f722853ba9a21096ea9fd33a900c1.jpg temp/1748254381_3500021_1360848182_c908cc522cf4a43178b136bf097c554b.jpg temp/1748254381_3500021_1360848180_2eb2e2b634acff6348258fbca95a8abe.jpg temp/1748254381_3500021_1360848178_467752d66f8da060959f9eb4667c0d81.jpg temp/1748254381_3500021_1360848176_0be4f8cc9cadb3fde77393394a11bc0c.jpg temp/1748254381_3500021_1360848174_065fe9c8dfbe49b8ded5a76581e040a8.jpg temp/1748254381_3500021_1360848151_2b6930c629f10f5eb0f26ffb91d02850.jpg temp/1748254381_3500021_1360848146_bcd6528c19c8d06195637929cae33dbe.jpg temp/1748254381_3500021_1360848144_7aa46bb97095f2451b024a7562effeb4.jpg temp/1748254381_3500021_1360848138_58ba439a74f397f0521a1ebffbabee06.jpg temp/1748254381_3500021_1360848119_9d4fc5aa198ad02aaba84338353c2185.jpg temp/1748254381_3500021_1360848116_9d7ab067b43c830635b15d846a210c29.jpg temp/1748254381_3500021_1360848111_e41802d1cba919d12212e46fcd2a459b.jpg temp/1748254381_3500021_1360848107_1c2822aedb57ea14df7602fd41900496.jpg temp/1748254381_3500021_1360848091_0f9b61a96ceda294b184109ae35b9a18.jpg temp/1748254381_3500021_1360848070_295eb23595d5fe197f1bdc01bfe5e6a1.jpg temp/1748254381_3500021_1360848066_0b5b794a1ffb67ff3eab37cfcad2f089.jpg temp/1748254381_3500021_1360848061_868e88dc62611c41427038e1a59f13cf.jpg temp/1748254381_3500021_1360848038_8ed43d54ca8174e40c69d6c8dffa34ee.jpg temp/1748254381_3500021_1360848034_bbb949045cf78f6d84642abdfcc8b8ed.jpg temp/1748254381_3500021_1360848029_cdd464b4b55cd5fec94fb415a7ffe8c1.jpg temp/1748254381_3500021_1360848024_e625d41c726f67c22fb4a7209b60bacb.jpg temp/1748254381_3500021_1360848022_7bf78bc0f01b4d240d105e4240f89e37.jpg temp/1748254381_3500021_1360848019_ed0bc33325aa174294c8c67f557fc5a3.jpg temp/1748254381_3500021_1360847991_ee55d793fdcec1170932266338ddf88f.jpg temp/1748254381_3500021_1360847989_49ceda2298297a40a5bfd1d389e57bb2.jpg temp/1748254381_3500021_1360847987_90c6bdb9b4c38d948188d46c44f53b94.jpg temp/1748254381_3500021_1360847986_0c783e125827815a2d1843c194c71b20.jpg temp/1748254381_3500021_1360847984_d38f759f355b402a0c3edcf8fdc96212.jpg temp/1748254381_3500021_1360847960_bb0a693abb7fe364f0bd9ad22aa5c13d.jpg temp/1748254381_3500021_1360847958_824269bd1d1be267c69305f6caae5ed8.jpg temp/1748254381_3500021_1360847954_b969f0dcf1c213197883075eacdae0ca.jpg temp/1748254381_3500021_1360847923_679e724e43758af754116c89764f9288.jpg temp/1748254381_3500021_1360847922_229da67e9a0c3e73337181b7818e3ac6.jpg temp/1748254381_3500021_1360847918_09b248f7af2be5a1568ad40dddfdd954.jpg temp/1748254381_3500021_1360847887_3ca8ae5fe8b2bbd745e467d024bb414a.jpg temp/1748254381_3500021_1360847883_aba6bdbb2c2261f28f6c532c9fedc319.jpg temp/1748254381_3500021_1360847847_2f2ae4f13c00357c67c8da76234f8d49.jpg temp/1748254381_3500021_1360847843_45501546e4b716d01cf40fe3fe57f247.jpg temp/1748254381_3500021_1360847811_bb5f8b564b9981ffb5cb6132f19da3e5.jpg temp/1748254381_3500021_1360847807_7665d3695cfa9490ea1a78fdc1f16795.jpg temp/1748254381_3500021_1360847805_0864cff1dc00e4f36cd023fea1aaf716.jpg temp/1748254381_3500021_1360847802_9959b4d5e8cd07f2df320445d620ba38.jpg temp/1748254381_3500021_1360847771_e45329369234b55533cdcd8f8514c81d.jpg temp/1748254381_3500021_1360847769_bd7307b6b3e84186d2d89bda85cd89ea.jpg temp/1748254381_3500021_1360847767_2dc75442302432a40af85939e5f792a0.jpg temp/1748254381_3500021_1360847765_d393eb862e8d071ae40f3a40b3d69625.jpg temp/1748254381_3500021_1360847741_0b56116bfbf9edd7f83e391ec630aacb.jpg temp/1748254381_3500021_1360847738_16445a1f7a6739d53065ef77a27f62e1.jpg temp/1748254381_3500021_1360847736_c53835f914600368a1473875b72d5a2d.jpg temp/1748254381_3500021_1360847733_857cb7b7649dc0f3324d9dec897a08b6.jpg temp/1748254381_3500021_1360847729_8c5a474db361b69264d288d02011f438.jpg temp/1748254381_3500021_1360847726_624d1b02fc64b2be78fcb3d58be843f1.jpg temp/1748254381_3500021_1360847706_b460d086298dbd5b0187e8c6316881c6.jpg temp/1748254381_3500021_1360847703_57d8c70e046901ce90e156a2fd2b90b6.jpg temp/1748254381_3500021_1360847701_052d4fff71de3650f62ace3ff3777f4a.jpg temp/1748254381_3500021_1360847670_52a9199965ac7eb3258d5493c8732aad.jpg temp/1748254381_3500021_1360847665_9560f9efa42b05d45d600ad1f2573841.jpg temp/1748254381_3500021_1360847662_8a249ba4d17c461a31e928b7a1db9507.jpg temp/1748254381_3500021_1360847635_d8b139e5c4cc4082a24b680350723271.jpg temp/1748254381_3500021_1360847630_3cafd19a8f2d96fd65b82bdb218d564a.jpg temp/1748254381_3500021_1360847623_0219cdacf5c77af7921137c53e819a51.jpg temp/1748254381_3500021_1360847619_4ce13b22b6de480ac4a825c2dec2d7c3.jpg temp/1748254381_3500021_1360846832_46ed18bd7ecc549d5b5f400b82e23984.jpg temp/1748254381_3500021_1360846730_a4c8e2f335e9b5f770747a07eda16d54.jpg temp/1748254381_3500021_1360846725_30626b1d17e99ed596925fe920507456.jpg temp/1748254381_3500021_1360846719_92f0bc21b300d5dd241ae7e87741793d.jpg temp/1748254381_3500021_1360846717_23442173fecf88a73158d3293b70eee3.jpg temp/1748254381_3500021_1360846715_ca741bd45b63547542532009dd270fdd.jpg temp/1748254381_3500021_1360846712_a8e5d979472872cb16ab0e30832025b1.jpg temp/1748254381_3500021_1360846555_2a3561f6747dbca44d300228ebbf3f3c.jpg temp/1748254381_3500021_1360846520_b9614757d2b6b895f483f320b20a3c98.jpg temp/1748254381_3500021_1360846487_3b055f957e1439bbe6754c87f8b4f2f0.jpg temp/1748254381_3500021_1360846447_cbc333e20e1da0307b232728366e1a79.jpg temp/1748254381_3500021_1360846244_56583f684f82f5991ed285d13089a5e4.jpg temp/1748254381_3500021_1360846188_4d2a7ec2043dc2e6f5d98d0b67324892.jpg temp/1748254381_3500021_1360846144_eff26a1051c40c487ed255f14dea632d.jpg temp/1748254381_3500021_1360846101_4e32108be5dc8ba4cf608591997f4580.jpg temp/1748254381_3500021_1360846069_bc9418cbeb9b17cce91c9f6d4e1a74f3.jpg temp/1748254381_3500021_1360846038_35baf8fb16983cbceff81d641afd6f84.jpg temp/1748254381_3500021_1360845690_e4ce4b982f0f37a722380a00f671dac1.jpg temp/1748254381_3500021_1360845654_084eaf82b312dd9f66a0ac27ee0adf7c.jpg temp/1748254381_3500021_1360845651_f7a9705c0bce03b877ad52ac1b8bdfe8.jpg temp/1748254381_3500021_1360845477_5518b8c7426f09ee69f8da5558560568.jpg temp/1748254381_3500021_1360845475_028c9404f5305c7dd296d0b29458b0b0.jpg temp/1748254381_3500021_1360845457_6efb2ab7ef2db98988efe2e2b5df3fab.jpg temp/1748254381_3500021_1360845426_8ae64a493b2b3efddbadb23ef762076b.jpg temp/1748254381_3500021_1360845404_d809fbbdd6cec75c9a88c8f20588740d.jpg temp/1748254381_3500021_1360845316_48cd0345b66cc428974cc34fbb342bec.jpg temp/1748254381_3500021_1360845312_7800659589d9f46a2bfc7e6d406ee4cc.jpg temp/1748254381_3500021_1360845288_296dcc3fc54836d6818e32e56cfda953.jpg temp/1748254381_3500021_1360845247_3cdf92002422577885812aba71f77565.jpg temp/1748254381_3500021_1360845213_e5a71da64337e79e105e6dd5edc077e9.jpg temp/1748254381_3500021_1360845084_04108144911511a69c651e8b50d43924.jpg temp/1748254381_3500021_1360845042_3f59c7cfe0389b450ce6a39c51a9b34b.jpg temp/1748254381_3500021_1360845038_beb3c5786faacba70b9ab18627b5876d.jpg temp/1748254381_3500021_1360845035_d2e35731b79d62ce9e2520fb3286cc8c.jpg temp/1748254381_3500021_1360845031_3247aaac40dbbf07b0a6725f5677a2c2.jpg temp/1748254381_3500021_1360845028_83961c580d91175d1f1f8bc31e11ebf7.jpg temp/1748254381_3500021_1360845023_b6e4fb3653eaf3478922d0dd0b47d684.jpg temp/1748254381_3500021_1360844902_de1b65d3131fcb5c8109838a038c48d6.jpg temp/1748254381_3500021_1360844865_998a31987e154e443a9d49146bc8376e.jpg temp/1748254381_3500021_1360844830_6008162a3e11ae8f0b2b7dc98ce79a7f.jpg temp/1748254381_3500021_1360844789_a015458b40ba3341e6f26062c5d66b8c.jpg temp/1748254381_3500021_1360844753_575d7f0adfc2ff4f33461610f87baea1.jpg 281it [00:00, 526.70it/s] 300it [00:00, 448.98it/s]2025-05-26 12:14:15.920692: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 12:14:16.046441: E tensorflow/stream_executor/cuda/cuda_blas.cc:238] failed to create cublas handle: CUBLAS_STATUS_NOT_INITIALIZED 2025-05-26 12:14:16.126065: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 12:14:16.131367: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-26 12:14:16.133659: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR temp/1748254381_3500021_1360844662_e60977a8aef2f339d72a30ac29bc646b.jpg temp/1748254381_3500021_1360844375_0e8cbed13b14da2e7303a070f352e58e.jpg temp/1748254381_3500021_1360844300_9081727a8830bce26911c2b5be349713.jpg temp/1748254381_3500021_1360844238_5811970d5983c8971622eaac9c3d6792.jpg temp/1748254381_3500021_1360844176_0b85e98efffb3e520153de79e6759d53.jpg temp/1748254381_3500021_1360844103_86f108662c8a4bbfc07c5907c0f7b421.jpg temp/1748254381_3500021_1360843990_ff4261b630a153ed6fd4035b7a7eabf6.jpg temp/1748254381_3500021_1360843624_7482041aee535dbf7506335875901615.jpg temp/1748254381_3500021_1360843565_9008523b08122a037ae40f6deb6d65f5.jpg temp/1748254381_3500021_1360843501_364d66ff85abf3bbee5b2fd5ce6de777.jpg temp/1748254381_3500021_1360843437_9862c2e3d34c9b1ad00a56c7ae5d1edf.jpg temp/1748254381_3500021_1360843374_e84ac94cbc35c5df0e968b72921c246d.jpg temp/1748254381_3500021_1360843322_6a0d5437d51eaf0c5bcac64c44434c2e.jpg temp/1748254381_3500021_1360843162_89ab7f2402a13c3719cf9a23d5b68a9b.jpg temp/1748254381_3500021_1360843142_11b48217105775cdbf4ee6b13f570a18.jpg temp/1748254381_3500021_1360843137_f470ab168a43459d6276d7515600a7ed.jpg temp/1748254381_3500021_1360843082_44621e3d74395f6defbc1c540bc6acf2.jpg temp/1748254381_3500021_1360842533_6a6b15f13939b719a60de1609a878c1f.jpg temp/1748254381_3500021_1360842526_9f212251dfc950127c7030086d93df93.jpg temp/1748254381_3500021_1360842524_22c0b0c39b44041b7614708468a489fc.jpg temp/1748254381_3500021_1360842502_aeaa7d8a7aea5e93cf27f6949fd05aa9.jpg temp/1748254381_3500021_1360842495_f69f318d49e385630a44d1f335461d04.jpg temp/1748254381_3500021_1360842357_b1125093a072fb3b7ae51cfdef04fe85.jpg temp/1748254381_3500021_1360842312_8b5990fb47349d5cd80f73af4a16b7be.jpg temp/1748254381_3500021_1360842275_002975e5e94dab6bb52ca92327058814.jpg temp/1748254381_3500021_1360842240_ffde60e129fcd841c406901831c36edc.jpg temp/1748254381_3500021_1360842186_4823c99328d0336bb8346029fe148c0c.jpg temp/1748254381_3500021_1360842183_59c01c120d0510b4353cc94c4c0d5f88.jpg temp/1748254381_3500021_1360842180_54495a1f39d092c903a179a7f308d70c.jpg temp/1748254381_3500021_1360842177_f99f3eb790d7ef0c2df51bd48afabb23.jpg temp/1748254381_3500021_1360842170_f5ac042d4a5d195df3de5d1374187395.jpg temp/1748254381_3500021_1360842166_b850715ebc4bc89ee2d7d1167751eab7.jpg temp/1748254381_3500021_1360842146_6970419e77fea65d9c20dfb5ae534009.jpg temp/1748254381_3500021_1360842141_f4bf6dcce4d2eabd3db12c12062b60dd.jpg temp/1748254381_3500021_1360842137_a5647a746f696d7e17378b04073b6af0.jpg temp/1748254381_3500021_1360842133_2a1745c7c6c89fbe0ab40a09dbc2d689.jpg temp/1748254381_3500021_1360842130_652160855c5cfc6465bddc6a0a2e9906.jpg temp/1748254381_3500021_1360842113_b990f32e20c54f6e0447a25577fd1cee.jpg temp/1748254381_3500021_1360842109_9bba5350440e3b0d8411d568f20da2b1.jpg temp/1748254381_3500021_1360842105_45cad7219e92b36521fd637fda2ccf5f.jpg temp/1748254381_3500021_1360842100_bfc2942d3ca89b6c5121de3bee46308d.jpg temp/1748254381_3500021_1360842098_3d3c64030ce825458b3113a4f3e84894.jpg temp/1748254381_3500021_1360842094_cd44ab3483bac0c2ecbc7a5b79e4c154.jpg temp/1748254381_3500021_1360842067_ef0b338843b8fb969beb179d69900f03.jpg temp/1748254381_3500021_1360842062_9811bda9557eee77703971937803f349.jpg temp/1748254381_3500021_1360842028_294c8dbc9e59e13b38e187a54f03d153.jpg temp/1748254381_3500021_1360842025_02131921e2fa150d9df30dcdb8c52423.jpg temp/1748254381_3500021_1360842023_71173c9d0666b29259778b9e9c410a2d.jpg temp/1748254381_3500021_1360841985_5d62832b23659f146a7db80e13c689ed.jpg temp/1748254381_3500021_1360841982_93c4a512a6207c327840139df50b859b.jpg temp/1748254381_3500021_1360841979_b4f3247cefeca6b413c435f31658094b.jpg temp/1748254381_3500021_1360841957_478fd5f9aef57656b8a20f880e43204d.jpg temp/1748254381_3500021_1360841953_267aa4677fb02c6aaccf3c2110c98665.jpg temp/1748254381_3500021_1360841949_33435b4659310d190ff412ffe24b2c1d.jpg temp/1748254381_3500021_1360841946_8754c3b0cbb203e7cf0e2ff7d1fd3ee2.jpg temp/1748254381_3500021_1360841943_cdc45a56f8534e22e143291f630f5929.jpg temp/1748254381_3500021_1360841918_510e7a80d8837a001debcdd4ac35b9b3.jpg temp/1748254381_3500021_1360841915_29bda8aacb76d44a223d56ccf66d4ba4.jpg temp/1748254381_3500021_1360841911_e56f6e6c4b0c6ca6bc4c89bc66587fb3.jpg temp/1748254381_3500021_1360841904_39662570ef9809a217da4203a2f517bc.jpg temp/1748254381_3500021_1360841903_e7337488e4b79433d15e7173ef11da0f.jpg temp/1748254381_3500021_1360841901_fa074c69b72bc2f9004ea9d45a55f926.jpg temp/1748254381_3500021_1360841872_a3e9253ed06e4d40a28ce68ab353b13f.jpg temp/1748254381_3500021_1360841868_7f7865b9587374090646fea3adfb01fa.jpg temp/1748254381_3500021_1360841865_871a8cbff4ff9eed66f9f166dbbdc92f.jpg temp/1748254381_3500021_1360841862_95d5718cf753930c99d6d444cb59152f.jpg temp/1748254381_3500021_1360841859_e7b62007477743c67a0a5da63855056b.jpg temp/1748254381_3500021_1360841856_ce47b19aca751d92d6e8edd40b05d1c0.jpg temp/1748254381_3500021_1360841846_8cd5443a4023893e0c46095c5e47a054.jpg temp/1748254381_3500021_1360841841_a5b6d61752852f10b8e62f6fc30bf142.jpg temp/1748254381_3500021_1360841838_5fe354c9014098be1377bcf18de0acd8.jpg temp/1748254381_3500021_1360841835_c8b2e2bc02d17a9ddd16b1e259e8f66f.jpg temp/1748254381_3500021_1360841832_89670da137df1ec46c03cd07ad99d654.jpg temp/1748254381_3500021_1360841828_c62bed4a742c11e6cc6592e1eefdeb76.jpg Found 300 images belonging to 1 classes. begin to do the prediction : ERROR in datou_step_exec, will save and exit ! Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[{{node model/module/StatefulPartitionedCall/StatefulPartitionedCall/StatefulPartitionedCall/conv1/StatefulPartitionedCall/Conv2D}}]] [Op:__inference_predict_function_34490] Function call stack: predict_function File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2329, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2523, in datou_step_exec return lib_process.datou_step_tfhub2(param, json_param, args, cache, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_process.py", line 3147, in datou_step_tfhub2 classes, outputs, features = this_model.predict_image_paths(list_paths, keep_aspect_ratio=keep_aspect_ratio, File "/home/admin/workarea/git/Velours/python/mtr/tfhub2/evaluate.py", line 288, in predict_image_paths Y_pred, F_pred = self.model.predict(valid_generator, validation_steps) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 88, in _method_wrapper return method(self, *args, **kwargs) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 1268, in predict tmp_batch_outputs = predict_function(iterator) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/def_function.py", line 580, in __call__ result = self._call(*args, **kwds) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/def_function.py", line 650, in _call return self._concrete_stateful_fn._filtered_call(canon_args, canon_kwds) # pylint: disable=protected-access File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 1661, in _filtered_call return self._call_flat( File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 1745, in _call_flat return self._build_call_outputs(self._inference_function.call( File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 593, in call outputs = execute.execute( File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/execute.py", line 59, in quick_execute tensors = pywrap_tfe.TFE_Py_Execute(ctx._handle, device_name, op_name, [1360856013, 1360855766, 1360855734, 1360855721, 1360855718, 1360855693, 1360855690, 1360855663, 1360855633, 1360855604, 1360855575, 1360855443, 1360855440, 1360855426, 1360855407, 1360855377, 1360855342, 1360855086, 1360855054, 1360855018, 1360855012, 1360855001, 1360854982, 1360854951, 1360854950, 1360854948, 1360854595, 1360854564, 1360854178, 1360854149, 1360854019, 1360854015, 1360854005, 1360853850, 1360853820, 1360853791, 1360853645, 1360853641, 1360853638, 1360851563, 1360851478, 1360851390, 1360850875, 1360850851, 1360850848, 1360850847, 1360850845, 1360850810, 1360850805, 1360850803, 1360850801, 1360850790, 1360850772, 1360850770, 1360850647, 1360850645, 1360850644, 1360850639, 1360850366, 1360850362, 1360850357, 1360850352, 1360850348, 1360850268, 1360850266, 1360850241, 1360850239, 1360850236, 1360850234, 1360850232, 1360850229, 1360850203, 1360850200, 1360850196, 1360850190, 1360850187, 1360850183, 1360849987, 1360849956, 1360849925, 1360849905, 1360849904, 1360849901, 1360849878, 1360849874, 1360849853, 1360849798, 1360849737, 1360849692, 1360849602, 1360849592, 1360849562, 1360849532, 1360849500, 1360849468, 1360849253, 1360849252, 1360848987, 1360848602, 1360848574, 1360848378, 1360848374, 1360848369, 1360848366, 1360848363, 1360848342, 1360848339, 1360848335, 1360848331, 1360848329, 1360848326, 1360848294, 1360848265, 1360848261, 1360848257, 1360848254, 1360848251, 1360848223, 1360848220, 1360848215, 1360848214, 1360848213, 1360848182, 1360848180, 1360848178, 1360848176, 1360848174, 1360848151, 1360848146, 1360848144, 1360848138, 1360848119, 1360848116, 1360848111, 1360848107, 1360848091, 1360848070, 1360848066, 1360848061, 1360848038, 1360848034, 1360848029, 1360848024, 1360848022, 1360848019, 1360847991, 1360847989, 1360847987, 1360847986, 1360847984, 1360847960, 1360847958, 1360847954, 1360847923, 1360847922, 1360847918, 1360847887, 1360847883, 1360847847, 1360847843, 1360847811, 1360847807, 1360847805, 1360847802, 1360847771, 1360847769, 1360847767, 1360847765, 1360847741, 1360847738, 1360847736, 1360847733, 1360847729, 1360847726, 1360847706, 1360847703, 1360847701, 1360847670, 1360847665, 1360847662, 1360847635, 1360847630, 1360847623, 1360847619, 1360846832, 1360846730, 1360846725, 1360846719, 1360846717, 1360846715, 1360846712, 1360846555, 1360846520, 1360846487, 1360846447, 1360846244, 1360846188, 1360846144, 1360846101, 1360846069, 1360846038, 1360845690, 1360845654, 1360845651, 1360845477, 1360845475, 1360845457, 1360845426, 1360845404, 1360845316, 1360845312, 1360845288, 1360845247, 1360845213, 1360845084, 1360845042, 1360845038, 1360845035, 1360845031, 1360845028, 1360845023, 1360844902, 1360844865, 1360844830, 1360844789, 1360844753, 1360844662, 1360844375, 1360844300, 1360844238, 1360844176, 1360844103, 1360843990, 1360843624, 1360843565, 1360843501, 1360843437, 1360843374, 1360843322, 1360843162, 1360843142, 1360843137, 1360843082, 1360842533, 1360842526, 1360842524, 1360842502, 1360842495, 1360842357, 1360842312, 1360842275, 1360842240, 1360842186, 1360842183, 1360842180, 1360842177, 1360842170, 1360842166, 1360842146, 1360842141, 1360842137, 1360842133, 1360842130, 1360842113, 1360842109, 1360842105, 1360842100, 1360842098, 1360842094, 1360842067, 1360842062, 1360842028, 1360842025, 1360842023, 1360841985, 1360841982, 1360841979, 1360841957, 1360841953, 1360841949, 1360841946, 1360841943, 1360841918, 1360841915, 1360841911, 1360841904, 1360841903, 1360841901, 1360841872, 1360841868, 1360841865, 1360841862, 1360841859, 1360841856, 1360841846, 1360841841, 1360841838, 1360841835, 1360841832, 1360841828] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 300 time used for this insertion : 0.1377120018005371 save_final ERROR in last step tfhub_classification2, Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[{{node model/module/StatefulPartitionedCall/StatefulPartitionedCall/StatefulPartitionedCall/conv1/StatefulPartitionedCall/Conv2D}}]] [Op:__inference_predict_function_34490] Function call stack: predict_function time spend for datou_step_exec : 15.000043869018555 time spend to save output : 0.16527247428894043 total time spend for step 0 : 15.165316343307495 need to delete datou_research and reload, so keep current state 1 caffe_path_current : About to save ! 2 After save, about to update current ! 14.91user 5.45system 1:19.23elapsed 25%CPU (0avgtext+0avgdata 1862052maxresident)k 178536inputs+1305416outputs (19major+555020minor)pagefaults 0swaps