python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 12 -a ' -a 533 -l 200 --rand=1 ' -s datou_current_533 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3623643 load datou : 533 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 268>200 please execute split_portfolio.py -i 31008807 -l 200 size over we load limit photo not treated list_input_json: {} Date 2026-04-21 18:00:28.474588 Current got : datou_id : 533, datou_cur_ids : ['4376248'] with mtr_portfolio_ids : ['31008807'] and first list_photo_ids : [] new path : /proc/3623643/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! List Step Type Loaded in datou : tfhub_classification2, argmax list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 150 ; length of list_pids : 150 ; length of list_args : 150 time to download the photos : 35.37209439277649 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 2 step1:tfhub_classification2 Tue Apr 21 18:01:03 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou_step TFHub with tf2 ! nombre de thcls : 3 we are using the classfication for multi_thcl [3513, 3379, 3847] begin to check gpu status inside check gpu memory 2026-04-21 18:01:06.646908: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2026-04-21 18:01:06.655192: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-04-21 18:01:06.655417: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-04-21 18:01:06.657135: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-04-21 18:01:06.658970: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-04-21 18:01:06.659276: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-04-21 18:01:06.661618: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-04-21 18:01:06.662737: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-04-21 18:01:06.666709: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-04-21 18:01:06.667845: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-04-21 18:01:06.668187: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2026-04-21 18:01:06.694479: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2026-04-21 18:01:06.696218: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f02b4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2026-04-21 18:01:06.696246: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2026-04-21 18:01:06.901352: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2ad25620 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2026-04-21 18:01:06.901395: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2026-04-21 18:01:06.902357: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-04-21 18:01:06.902432: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-04-21 18:01:06.902462: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-04-21 18:01:06.902489: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-04-21 18:01:06.902515: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-04-21 18:01:06.902542: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-04-21 18:01:06.902568: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-04-21 18:01:06.902594: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-04-21 18:01:06.904134: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-04-21 18:01:06.904200: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-04-21 18:01:06.905111: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-04-21 18:01:06.905134: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-04-21 18:01:06.905148: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-04-21 18:01:06.906753: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3096 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) l 3637 free memory gpu now : 4513 max_wait_temp : 1 max_wait : 5 1 Physical GPUs, 1 Logical GPUs tagging for thcl : 3513 To do loadFromThcl(), then load ParamDescType : thcl3513 thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] thcl {'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'} Update svm_hashtag_type_desc : 5767 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5767, 'Rungis_amount_dechets_fall_2018_v2_tf', 2048, 2048, 'Rungis_amount_dechets_fall_2018_v2_tf', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 3, 16, 15, 52, 10), datetime.datetime(2023, 3, 16, 15, 52, 10)) model_name : Rungis_amount_dechets_fall_2018_v2_tf model_param file didn't exist model_name : Rungis_amount_dechets_fall_2018_v2_tf model_type : tf_classification2 list file need : ['Confusion_Matrix.png', 'Precision_Recall_05102018_Papier_non_papier_dense.jpg', 'Precision_Recall_05102018_Papier_non_papier_peu_dense.jpg', 'Precision_Recall_05102018_Papier_non_papier_presque_vide.jpg', 'Precision_Recall_05102018_Papier_non_papier_tres_dense.jpg', 'Precision_Recall_05102018_Papier_non_papier_tres_peu_dense.jpg', 'Result_Summary.txt', 'checkpoint', 'model_checkpoint.ckpt.data-00000-of-00001', 'model_checkpoint.ckpt.data-00000-of-00002', 'model_checkpoint.ckpt.data-00001-of-00002', 'model_checkpoint.ckpt.index', 'model_weights.h5'] file exist in s3 : ['Confusion_Matrix.png', 'Precision_Recall_05102018_Papier_non_papier_dense.jpg', 'Precision_Recall_05102018_Papier_non_papier_peu_dense.jpg', 'Precision_Recall_05102018_Papier_non_papier_presque_vide.jpg', 'Precision_Recall_05102018_Papier_non_papier_tres_dense.jpg', 'Precision_Recall_05102018_Papier_non_papier_tres_peu_dense.jpg', 'Result_Summary.txt', 'checkpoint', 'model_checkpoint.ckpt.data-00000-of-00001', 'model_checkpoint.ckpt.data-00000-of-00002', 'model_checkpoint.ckpt.data-00001-of-00002', 'model_checkpoint.ckpt.index', 'model_weights.h5'] file manque in s3 : [] local folder : /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Confusion_Matrix.png size_local : 67810 size in s3 : 67810 create time local : 2026-03-04 13:31:58 create time in s3 : 2026-03-04 12:24:14 Confusion_Matrix.png already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Precision_Recall_05102018_Papier_non_papier_dense.jpg size_local : 73949 size in s3 : 73949 create time local : 2026-03-04 13:31:58 create time in s3 : 2026-03-04 12:24:15 Precision_Recall_05102018_Papier_non_papier_dense.jpg already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Precision_Recall_05102018_Papier_non_papier_peu_dense.jpg size_local : 85572 size in s3 : 85572 create time local : 2026-03-04 13:31:58 create time in s3 : 2026-03-04 12:24:15 Precision_Recall_05102018_Papier_non_papier_peu_dense.jpg already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Precision_Recall_05102018_Papier_non_papier_presque_vide.jpg size_local : 72361 size in s3 : 72361 create time local : 2026-03-04 13:31:58 create time in s3 : 2026-03-04 12:24:16 Precision_Recall_05102018_Papier_non_papier_presque_vide.jpg already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Precision_Recall_05102018_Papier_non_papier_tres_dense.jpg size_local : 83567 size in s3 : 83567 create time local : 2026-03-04 13:31:58 create time in s3 : 2026-03-04 12:24:16 Precision_Recall_05102018_Papier_non_papier_tres_dense.jpg already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Precision_Recall_05102018_Papier_non_papier_tres_peu_dense.jpg size_local : 71611 size in s3 : 71611 create time local : 2026-03-04 13:31:58 create time in s3 : 2026-03-04 12:24:16 Precision_Recall_05102018_Papier_non_papier_tres_peu_dense.jpg already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/Result_Summary.txt size_local : 1058 size in s3 : 1058 create time local : 2026-03-04 13:31:58 create time in s3 : 2026-03-04 12:24:17 Result_Summary.txt already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/checkpoint size_local : 99 size in s3 : 99 create time local : 2026-03-04 13:31:58 create time in s3 : 2026-03-04 12:24:17 checkpoint already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/model_checkpoint.ckpt.data-00000-of-00001 size_local : 188538519 size in s3 : 188538519 create time local : 2026-03-04 13:32:01 create time in s3 : 2026-03-04 12:24:27 model_checkpoint.ckpt.data-00000-of-00001 already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/model_checkpoint.ckpt.data-00000-of-00002 size_local : 216572 size in s3 : 216572 create time local : 2026-03-04 13:32:01 create time in s3 : 2026-03-04 12:24:28 model_checkpoint.ckpt.data-00000-of-00002 already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/model_checkpoint.ckpt.data-00001-of-00002 size_local : 32279708 size in s3 : 32279708 create time local : 2026-03-04 13:32:02 create time in s3 : 2026-03-04 12:24:31 model_checkpoint.ckpt.data-00001-of-00002 already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/model_checkpoint.ckpt.index size_local : 28001 size in s3 : 28001 create time local : 2026-03-04 13:32:02 create time in s3 : 2026-03-04 12:24:31 model_checkpoint.ckpt.index already exist and didn't need to update /data/models_weight/Rungis_amount_dechets_fall_2018_v2_tf/model_weights.h5 size_local : 94501976 size in s3 : 94501976 create time local : 2026-03-04 13:32:04 create time in s3 : 2026-03-04 12:24:36 model_weights.h5 already exist and didn't need to update desc size : 2048 Model: "sequential" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= module (KerasLayer) (None, 2048) 23561152 _________________________________________________________________ Rungis_amount_dechets_fall_2 (None, 5) 10245 ================================================================= Total params: 23,571,397 Trainable params: 10,245 Non-trainable params: 23,561,152 _________________________________________________________________ Loading Weights... time used to create the model : 7.7140398025512695 time used to load_weights : 0.22580957412719727 0it [00:00, ?it/s] 12it [00:00, 117.67it/s] 24it [00:00, 116.81it/s] 36it [00:00, 117.07it/s] 48it [00:00, 116.93it/s] 60it [00:00, 116.85it/s] 72it [00:00, 117.12it/s] 84it [00:00, 117.88it/s] 96it [00:00, 116.85it/s] 108it [00:00, 109.72it/s]temp/1776787228_3623643_1416193735_c7b1d58d18d3cbc232e2cfe45de7deb4.jpg temp/1776787228_3623643_1416193734_bbb2d81a8f7b51d43dce6b6456171a03.jpg temp/1776787228_3623643_1416193733_f4311d729398d8a3d05e8ce1d72151ae.jpg temp/1776787228_3623643_1416193712_22482f22ed916299d98fe702b2e2f867.jpg temp/1776787228_3623643_1416193711_82337171034537b5db054e30f0bc1a4c.jpg temp/1776787228_3623643_1416193710_842ce49a9f795db1b137fe872469fb79.jpg temp/1776787228_3623643_1416193709_7f3d1344f1b9b2d705c8b3802d51594d.jpg temp/1776787228_3623643_1416193708_4670f08d559b1c73594b13cb34df2f82.jpg temp/1776787228_3623643_1416193707_7fa6cd75997adcf804515f7fce03aa0b.jpg temp/1776787228_3623643_1416193694_7995adea397b885404778d5cb38e535b.jpg temp/1776787228_3623643_1416193693_67ba75529a3af32cf83ce40a64b33763.jpg temp/1776787228_3623643_1416193692_fac9d0b0a6f0d0441b94c9e2532fa48b.jpg temp/1776787228_3623643_1416193690_4a4f8a344289c09c512f27cf853cb20c.jpg temp/1776787228_3623643_1416193688_afc6b550722613e5558e5f739f3855b1.jpg temp/1776787228_3623643_1416193687_31294fa56fe4173eabb59d889825bb17.jpg temp/1776787228_3623643_1416193677_c35a0c744c00501660003260944ca8d7.jpg temp/1776787228_3623643_1416193675_4ca99cdcfb650631cbb49919aa4a1ff6.jpg temp/1776787228_3623643_1416193674_5cd5fe31ad5047188570ab146d9f5ab5.jpg temp/1776787228_3623643_1416193673_c7c043fe6fbba9010ca398afb2cd221b.jpg temp/1776787228_3623643_1416193672_39493cf005433b6072e4eb4109c19438.jpg temp/1776787228_3623643_1416193671_81a3f449c600041ba6fb96372e22352d.jpg temp/1776787228_3623643_1416193657_f368418a9a381b731a60a69d282885e7.jpg temp/1776787228_3623643_1416193656_3ded4ed856796f2db5f723ac70ca9cb3.jpg temp/1776787228_3623643_1416193655_33300da6ecc21b568672d52a25cd3c70.jpg temp/1776787228_3623643_1416193654_8b424e493f48fd9881377d33ec829854.jpg temp/1776787228_3623643_1416193653_3850c9ac66fa5293a612e41c28b4dc21.jpg temp/1776787228_3623643_1416193652_e0fb054c1eb339320fe2a05dbb6d8ca3.jpg temp/1776787228_3623643_1416193610_3998d0c33c9accecfa1031b557a2ed94.jpg temp/1776787228_3623643_1416193609_618630b9324c4e7a2d76363310c0bc6e.jpg temp/1776787228_3623643_1416193608_dadbb95d479ca97a51af9aa1b162bfb7.jpg temp/1776787228_3623643_1416193607_37d2f0cba35371fa77e5814ab3d2201c.jpg temp/1776787228_3623643_1416193605_71d34d65e34304ed4b655ef8af51856a.jpg temp/1776787228_3623643_1416193604_92d3568c0db865f4bbbd6f508768061e.jpg temp/1776787228_3623643_1416193587_783fa387b10f1b0e9cc3fdccdf1be319.jpg temp/1776787228_3623643_1416193586_33c5b43ced1f827c1a6b812bb7275717.jpg temp/1776787228_3623643_1416193585_2ba581f0910880c9344c116cb8245f5d.jpg temp/1776787228_3623643_1416193578_4870005806b3c807575a773c8f9b9a78.jpg temp/1776787228_3623643_1416193577_5672e74fef9dda05f493d33cc0d2109c.jpg temp/1776787228_3623643_1416193576_ff58ca7a4c1856893460f3b4cecdeb8a.jpg temp/1776787228_3623643_1416193575_6bef2e07c975f95176aa8b826f699842.jpg temp/1776787228_3623643_1416193574_23705d34dd71aed659fa3d59774fb70e.jpg temp/1776787228_3623643_1416193573_eaf723e7f308f990f564801be9cd0124.jpg temp/1776787228_3623643_1416193561_7c124f32b5d28c048c816df2ed63fed8.jpg temp/1776787228_3623643_1416193560_3d350b294b9aa2e96c343a9e9a77fb92.jpg temp/1776787228_3623643_1416193559_ea48babf1a69a6a864d29137dc869051.jpg temp/1776787228_3623643_1416193558_3a1adcb98546de5cb6e189626a587d78.jpg temp/1776787228_3623643_1416193556_ee57099c0238b614b62102d629bf7a04.jpg temp/1776787228_3623643_1416193555_c23326e9ea603f00d4b5a7fc54af7d84.jpg temp/1776787228_3623643_1416192789_cca15b94b45679d72fdd0aaea05bf15c.jpg temp/1776787228_3623643_1416192788_d2aab2621333409ab1741c421fed5918.jpg temp/1776787228_3623643_1416192787_597081f679e47592e4afe92ef10a98b3.jpg temp/1776787228_3623643_1416192786_d3865259e8d3083462b96f115b0d91c4.jpg temp/1776787228_3623643_1416192785_ca7fb59c970a8ebb1421a991be71b16f.jpg temp/1776787228_3623643_1416192784_9a285bc1e30268c95ccd6dd290d3f4d6.jpg temp/1776787228_3623643_1416192324_cc656ff2f88daab2b2f51a06daa6f77b.jpg temp/1776787228_3623643_1416192323_da1cbc30000c7d7fc7f260eeb08bba07.jpg temp/1776787228_3623643_1416192322_a51e333fe6cebb84a9abb0818280da6b.jpg temp/1776787228_3623643_1416192320_ea0a98e34b151e53ad3be29d9444d742.jpg temp/1776787228_3623643_1416192318_7862865c4e51866734997e0bd1e713c7.jpg temp/1776787228_3623643_1416192317_433ada540e2ae9a399c3e02e4e7a715c.jpg temp/1776787228_3623643_1416192287_859dfa4222c1ce7b611104a67e0c79e3.jpg temp/1776787228_3623643_1416192286_77bc2c321a4000808622cf482fbc80cc.jpg temp/1776787228_3623643_1416192283_205647b7696348c195b5bde08449a19d.jpg temp/1776787228_3623643_1416192282_dc272ba8447aa2616efc047a9d458a49.jpg temp/1776787228_3623643_1416192281_9b8d63c13d0c3047fa9e27921de36a00.jpg temp/1776787228_3623643_1416192280_354c37602e4efab7a63ed4cebde228a9.jpg temp/1776787228_3623643_1416192268_709d3e8893ef363470838903d71ea20e.jpg temp/1776787228_3623643_1416192267_0355da12214532f706ec464579fab872.jpg temp/1776787228_3623643_1416192266_c37d620e2db4b3d40b95e0813fd226ff.jpg temp/1776787228_3623643_1416192265_b04a60b8c31107dccf11d6cb493dc66f.jpg temp/1776787228_3623643_1416192264_9e6e539cd6f29bfb2fddae8b1d125071.jpg temp/1776787228_3623643_1416192263_668b80ec7fb5faffdaf908bd18299e80.jpg temp/1776787228_3623643_1416191791_88227c8b9b397998e68810be1b63df7d.jpg temp/1776787228_3623643_1416191790_b33fab3cfdc892bdea5213c34e1149b0.jpg temp/1776787228_3623643_1416191789_33a7d6a3ced9d11ebdd37290b53ac30d.jpg temp/1776787228_3623643_1416191788_71fef4243ebbe92a7d6ca266af54daa7.jpg temp/1776787228_3623643_1416191787_be3b4c286f452061f07400f192443545.jpg temp/1776787228_3623643_1416191786_75e15f78f810360c3925631d05167e16.jpg temp/1776787228_3623643_1416190987_f7f3764d579210a7929c6cb309f1da64.jpg temp/1776787228_3623643_1416190915_ca17ebc5ae7f669b6d5fae20c0d55cdc.jpg temp/1776787228_3623643_1416190914_1159a3206e43874fc11bf94478f93257.jpg temp/1776787228_3623643_1416190913_4e636373aef0f3b38fe170374fe8a967.jpg temp/1776787228_3623643_1416190912_b9c5b8d9f7604a709e7f83caa6d02d1c.jpg temp/1776787228_3623643_1416190911_89db131a08377ad22db6f0cb53b8cb7e.jpg temp/1776787228_3623643_1416189916_433c289c3b728fa19cdca2bf40fc18d0.jpg temp/1776787228_3623643_1416189915_c6da060c8ddc90a0218afd0fddac327d.jpg temp/1776787228_3623643_1416189914_0aa00bc259f76c8eb0c04568ff0afd4f.jpg temp/1776787228_3623643_1416189912_46e9fdfb37ad5be0aaf1fada2a795110.jpg temp/1776787228_3623643_1416189910_d36a3a2f204bfa919c6a93595f1f87d5.jpg temp/1776787228_3623643_1416189909_fc29397d3c8c706472cca8eeb2142aef.jpg temp/1776787228_3623643_1416188735_738eb04ef44549d386506acce7f3a478.jpg temp/1776787228_3623643_1416188734_44ace5a2233c3fabe33c8e92c76f2a27.jpg temp/1776787228_3623643_1416188733_c521d088b7462ea4ce44bbbb3f907252.jpg temp/1776787228_3623643_1416188732_434f0531831b01414bd3a59397cfb5eb.jpg temp/1776787228_3623643_1416188731_eac804dfe58323f899b6131449278a60.jpg temp/1776787228_3623643_1416188730_7d3c0e2e30f01c956af63bf14a47fa31.jpg temp/1776787228_3623643_1416187919_470484e2db00707d2f280a44c92f2ee5.jpg temp/1776787228_3623643_1416187918_5ce564cd6ec3ee7c592bb3e90037ad30.jpg temp/1776787228_3623643_1416187917_2a89901f2170810109cf093522130de3.jpg temp/1776787228_3623643_1416187916_9fa192c756ff96a521c82cd4985934d6.jpg temp/1776787228_3623643_1416187915_ece68648c6f45a77fbb2bcca1d8bd7ee.jpg temp/1776787228_3623643_1416187914_a66996a00f531a4a189c20a395143226.jpg temp/1776787228_3623643_1416187899_facc286b8403ffb73f06b752455cfec4.jpg temp/1776787228_3623643_1416187897_8750c3718aae1e807bc8a56373907ac5.jpg temp/1776787228_3623643_1416187896_850ad3b7102d3eb90e55ca3fea0a909e.jpg temp/1776787228_3623643_1416187895_4213a9c3587b9d3c49ecce4429d04354.jpg temp/1776787228_3623643_1416187894_1658bf08dfc40f4e490746454510e653.jpg temp/1776787228_3623643_1416187893_15e49a306a851ac5dce7c400a26b94ba.jpg temp/1776787228_3623643_1416187794_6c4acec5936cd8bb2cebc6d28b029903.jpg temp/1776787228_3623643_1416187760_23df7cf7b158bda7e3c4a1e60ff81c9b.jpg temp/1776787228_3623643_1416187744_fd873f30307f6e202a8f33aefeac313a.jpg temp/1776787228_3623643_1416187592_009bf18c7af1697818ec178698725521.jpg temp/1776787228_3623643_1416187430_60aee21d286e536ecfbe389b4340f8a1.jpg 120it [00:01, 107.63it/s] 132it [00:01, 110.49it/s] 144it [00:01, 67.89it/s] 148it [00:01, 88.71it/s]temp/1776787228_3623643_1416187394_b5d8c290c9354323ce23d2b4d5990618.jpg temp/1776787228_3623643_1416186943_bb61e60017a03d03997a9a1769fa2f25.jpg temp/1776787228_3623643_1416186942_b604812ee04e5114b77e61e6efe9953b.jpg temp/1776787228_3623643_1416186941_5d5fac07d0ed98263de71581bf75c822.jpg temp/1776787228_3623643_1416186940_72cd84d12cd2804e8c3a003453260007.jpg temp/1776787228_3623643_1416186938_a870a7fcbeaef86134cce302540668f8.jpg temp/1776787228_3623643_1416186936_b7293b4bb921a9241e6fdcfcba08d139.jpg temp/1776787228_3623643_1416186857_72c9fa59ca5e97e9e21f3fdab331dcad.jpg temp/1776787228_3623643_1416186856_a00e3f0a6991a40e9906edbbfae1f80a.jpg temp/1776787228_3623643_1416186855_571be6714dc27ae127435025dc2c3e15.jpg temp/1776787228_3623643_1416186854_04b21e5d11ade11e74e6e55bee9c686e.jpg temp/1776787228_3623643_1416186852_845ee828b2037e2cbf70da9f06f5c10a.jpg temp/1776787228_3623643_1416186851_ceff30b97a86d128dbbf7c1a7dce7945.jpg temp/1776787228_3623643_1416186759_3d3e087e39ea08bb10aa1eca37472ab4.jpg temp/1776787228_3623643_1416186758_05315d4260fca352d39c97c0a1015d84.jpg temp/1776787228_3623643_1416186757_51c4fed3e06b3d22a0ec9d1e8d423d29.jpg temp/1776787228_3623643_1416186756_a099aa2b371b3b7f9dca6dde1885c1d3.jpg temp/1776787228_3623643_1416186755_05e7220ae670279fb505bc876cf5be1e.jpg temp/1776787228_3623643_1416186754_21e5682b63633afcbff3adc5dc503a91.jpg temp/1776787228_3623643_1416185805_9403be8f81ad0f2fc9b2ce237db78612.jpg temp/1776787228_3623643_1416185804_e86372227f816e72fc5ecd39bb1dd96b.jpg temp/1776787228_3623643_1416185803_0c877031f030ac07a2cf3a3b741e4954.jpg temp/1776787228_3623643_1416185801_f7e79710129e478e11fd2e4c2912669b.jpg temp/1776787228_3623643_1416185799_a4f46bd8a017c763105c7f0bb8c62466.jpg temp/1776787228_3623643_1416185798_6e735ebc483806a310c19e0e5123e7f1.jpg temp/1776787228_3623643_1416185270_aa52b426b51188027cf3923fd62b3a88.jpg temp/1776787228_3623643_1416185268_d50687c48a0b59b1306c7bbe15668141.jpg temp/1776787228_3623643_1416185267_01dc60c354703fb3f84a107519f04d63.jpg temp/1776787228_3623643_1416185266_7280874704c5bc4cd9550bd1abde2331.jpg temp/1776787228_3623643_1416185265_33931db60039349a259743eca8aa0e23.jpg temp/1776787228_3623643_1416185264_b0d3ed202a2a776662883d30987e2848.jpg temp/1776787228_3623643_1416185251_4288db1661ffb2adf76877b7535015b6.jpg temp/1776787228_3623643_1416185250_b2c64824cb8ad6cb27697f2d6bf3be95.jpg temp/1776787228_3623643_1416185248_a8035402b27f681bffcc3deae655fe9c.jpg temp/1776787228_3623643_1416185247_b4635f3bb0c1bf5a5b1a43cbda0cd82c.jpg temp/1776787228_3623643_1416185246_c01a564ef0a53a847f66eb872a2b0724.jpg ERROR in datou_step_exec, will save and exit ! [Errno 28] No space left on device: 'temp/1776787228_3623643_1416185246_c01a564ef0a53a847f66eb872a2b0724.jpg' -> 'tempdir_3623643/temp/image000000148_1776787228_3623643_1416185246_c01a564ef0a53a847f66eb872a2b0724.jpg' File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2340, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2534, in datou_step_exec return lib_process.datou_step_tfhub2(param, json_param, args, cache, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_process.py", line 3171, in datou_step_tfhub2 classes, outputs, features = this_model.predict_image_paths(list_paths, keep_aspect_ratio=keep_aspect_ratio, File "/home/admin/workarea/git/Velours/python/mtr/tfhub2/evaluate.py", line 257, in predict_image_paths shutil.copyfile(this_path, os.path.join("tempdir_" + process_id, "temp", File "/usr/lib/python3.8/shutil.py", line 275, in copyfile _fastcopy_sendfile(fsrc, fdst) File "/usr/lib/python3.8/shutil.py", line 166, in _fastcopy_sendfile raise err from None File "/usr/lib/python3.8/shutil.py", line 152, in _fastcopy_sendfile sent = os.sendfile(outfd, infd, offset, blocksize) [1416193735, 1416193734, 1416193733, 1416193712, 1416193711, 1416193710, 1416193709, 1416193708, 1416193707, 1416193694, 1416193693, 1416193692, 1416193690, 1416193688, 1416193687, 1416193677, 1416193675, 1416193674, 1416193673, 1416193672, 1416193671, 1416193657, 1416193656, 1416193655, 1416193654, 1416193653, 1416193652, 1416193610, 1416193609, 1416193608, 1416193607, 1416193605, 1416193604, 1416193587, 1416193586, 1416193585, 1416193578, 1416193577, 1416193576, 1416193575, 1416193574, 1416193573, 1416193561, 1416193560, 1416193559, 1416193558, 1416193556, 1416193555, 1416192789, 1416192788, 1416192787, 1416192786, 1416192785, 1416192784, 1416192324, 1416192323, 1416192322, 1416192320, 1416192318, 1416192317, 1416192287, 1416192286, 1416192283, 1416192282, 1416192281, 1416192280, 1416192268, 1416192267, 1416192266, 1416192265, 1416192264, 1416192263, 1416191791, 1416191790, 1416191789, 1416191788, 1416191787, 1416191786, 1416190987, 1416190915, 1416190914, 1416190913, 1416190912, 1416190911, 1416189916, 1416189915, 1416189914, 1416189912, 1416189910, 1416189909, 1416188735, 1416188734, 1416188733, 1416188732, 1416188731, 1416188730, 1416187919, 1416187918, 1416187917, 1416187916, 1416187915, 1416187914, 1416187899, 1416187897, 1416187896, 1416187895, 1416187894, 1416187893, 1416187794, 1416187760, 1416187744, 1416187592, 1416187430, 1416187394, 1416186943, 1416186942, 1416186941, 1416186940, 1416186938, 1416186936, 1416186857, 1416186856, 1416186855, 1416186854, 1416186852, 1416186851, 1416186759, 1416186758, 1416186757, 1416186756, 1416186755, 1416186754, 1416185805, 1416185804, 1416185803, 1416185801, 1416185799, 1416185798, 1416185270, 1416185268, 1416185267, 1416185266, 1416185265, 1416185264, 1416185251, 1416185250, 1416185248, 1416185247, 1416185246, 1416185245] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 150 time used for this insertion : 0.06939220428466797 save_final ERROR in last step tfhub_classification2, [Errno 28] No space left on device: 'temp/1776787228_3623643_1416185246_c01a564ef0a53a847f66eb872a2b0724.jpg' -> 'tempdir_3623643/temp/image000000148_1776787228_3623643_1416185246_c01a564ef0a53a847f66eb872a2b0724.jpg' time spend for datou_step_exec : 13.890019178390503 time spend to save output : 0.07364940643310547 total time spend for step 0 : 13.963668584823608 need to delete datou_research and reload, so keep current state 1 caffe_path_current : About to save ! 2 After save, about to update current ! 12.72user 7.86system 0:53.67elapsed 38%CPU (0avgtext+0avgdata 1725452maxresident)k 385680inputs+4650176outputs (106major+652753minor)pagefaults 0swaps