python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 12 -a ' -a 533 -l 200 --rand=1 ' -s datou_current_533 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 15711 load datou : 533 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Date 2026-09-11 11:40:30.217316 Current got : datou_id : 533, datou_cur_ids : ['4388177'] with mtr_portfolio_ids : ['31154925'] and first list_photo_ids : [] new path : /proc/15711/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! List Step Type Loaded in datou : tfhub_classification2, argmax list_input_json : {} origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFB[Errno 28] No space left on device can't download the photo : 1417753036 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417753036_81d98fc25209a02ce2080d339b8329e2.jpg FB[Errno 28] No space left on device can't download the photo : 1417753035 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417753035_d50c7ebf606b9ff1eab2bc9da8aead10.jpg FB[Errno 28] No space left on device can't download the photo : 1417753034 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417753034_fe83bde1f414665685997b41ac6a322f.jpg FB[Errno 28] No space left on device can't download the photo : 1417753032 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417753032_8cca3e82586bdc26af5a738636496f2b.jpg FB[Errno 28] No space left on device can't download the photo : 1417753013 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417753013_9e10e99ccf78489881f1929590f28811.jpg FB[Errno 28] No space left on device can't download the photo : 1417753011 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417753011_455e71ece453aedf61aca7a901f465af.jpg FB[Errno 28] No space left on device can't download the photo : 1417753009 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417753009_94465d29afefa82d1f0da216986a46fc.jpg FB[Errno 28] No space left on device can't download the photo : 1417753007 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417753007_a15cc78f9fb8d6c1f6214f595f8824f7.jpg FB[Errno 28] No space left on device can't download the photo : 1417752883 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752883_09c0bcb9b5d1ac00de40ea4f24c2e16d.jpg FB[Errno 28] No space left on device can't download the photo : 1417752882 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752882_cdb7475614b0add1f485fd1a918666c8.jpg FB[Errno 28] No space left on device can't download the photo : 1417752881 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752881_b2c897e9cf444e79e74dcf593432d280.jpg FB[Errno 28] No space left on device can't download the photo : 1417752880 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752880_9cc3b0c57cb9239d9fbb7756b35be304.jpg FB[Errno 28] No space left on device can't download the photo : 1417752878 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752878_d726cfd3e7c5ec0e6b4a83cf424952a4.jpg FB[Errno 28] No space left on device can't download the photo : 1417752877 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752877_4e8202140ddb6691b6d792a112a58c8d.jpg FB[Errno 28] No space left on device can't download the photo : 1417752867 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752867_e0538b70d3c91d100fbc5fbebf9ebe29.jpg FB[Errno 28] No space left on device can't download the photo : 1417752865 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752865_82a77fe2a4970419fedf23f9187ba098.jpg FB[Errno 28] No space left on device can't download the photo : 1417752864 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752864_e486985738b51e352e54c334a897a349.jpg FB[Errno 28] No space left on device can't download the photo : 1417752863 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752863_9b4f04ee8eeabbb7e94ecd76294f9fef.jpg FB[Errno 28] No space left on device can't download the photo : 1417752861 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752861_d17f7cda98b781bced2b102ef7a4d0bf.jpg FB[Errno 28] No space left on device can't download the photo : 1417752859 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752859_8d1d4e4a2a7e0564e2d56e46afe56868.jpg FB[Errno 28] No space left on device can't download the photo : 1417752792 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752792_f17b0522ec1866e32f8f44d68b126019.jpg FB[Errno 28] No space left on device can't download the photo : 1417752790 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752790_d81ccbf87c5b280f37903561c1f2ad32.jpg FB[Errno 28] No space left on device can't download the photo : 1417752788 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752788_f2318ab8b6a43845dab6606babebea2c.jpg FB[Errno 28] No space left on device can't download the photo : 1417752786 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752786_aa24e71290aca5019247b2e92bf0cab5.jpg FB[Errno 28] No space left on device can't download the photo : 1417752782 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752782_fa2fce973c69d0471a30b0f2fb392d7e.jpg FB[Errno 28] No space left on device can't download the photo : 1417752779 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752779_55ecf65f496cb0c0f6c53ce2451d1579.jpg FB[Errno 28] No space left on device can't download the photo : 1417752723 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752723_b72e5fe320f09749397601b5ddc5b9ca.jpg FB[Errno 28] No space left on device can't download the photo : 1417752691 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752691_992809a00e9f868ab1a15e60238a62b6.jpg FB[Errno 28] No space left on device can't download the photo : 1417752688 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752688_dd9880125229a16abcdbccb73a72e5a8.jpg FB[Errno 28] No space left on device can't download the photo : 1417752686 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752686_a0b5de4002d804e17d7d8dd4015bcacb.jpg FB[Errno 28] No space left on device can't download the photo : 1417752685 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752685_870e5931ea1821ce7231ea332907e329.jpg FB[Errno 28] No space left on device can't download the photo : 1417752682 complete_path : /home/admin/workarea/git/Velours/python/temp/1789119630_15711_1417752682_71a52b280b8c0ac2ee166816cb51af41.jpg Fwe have missing 32 photos in the step downloads : photo missing : [1417753036, 1417753035, 1417753034, 1417753032, 1417753013, 1417753011, 1417753009, 1417753007, 1417752883, 1417752882, 1417752881, 1417752880, 1417752878, 1417752877, 1417752867, 1417752865, 1417752864, 1417752863, 1417752861, 1417752859, 1417752792, 1417752790, 1417752788, 1417752786, 1417752782, 1417752779, 1417752723, 1417752691, 1417752688, 1417752686, 1417752685, 1417752682] try to delete the photos missing in DB Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417753036 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417753035 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417753034 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417753032 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417753013 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417753011 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417753009 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417753007 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752883 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752882 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752881 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752880 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752878 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752877 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752867 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752865 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752864 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752863 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752861 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752859 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752792 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752790 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752788 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752786 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752782 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752779 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752723 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752691 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752688 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752686 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752685 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417752682 length of list_filenames : 26 ; length of list_pids : 26 ; length of list_args : 26 time to download the photos : 19.59565019607544 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 2 step1:tfhub_classification2 Fri Sep 11 11:40:49 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou_step TFHub with tf2 ! nombre de thcls : 3 we are using the classfication for multi_thcl [3513, 3379, 3847] begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10999 max_wait_temp : 1 max_wait : 5 ERROR in datou_step_exec, will save and exit ! [Errno 2] No usable temporary directory found in ['/tmp', '/var/tmp', '/usr/tmp', '/home/admin/workarea/git/Velours/python'] File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2340, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2534, in datou_step_exec return lib_process.datou_step_tfhub2(param, json_param, args, cache, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_process.py", line 3089, in datou_step_tfhub2 import tensorflow as tf File "/usr/local/lib/python3.8/dist-packages/tensorflow/__init__.py", line 41, in from tensorflow.python.tools import module_util as _module_util File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/__init__.py", line 132, in from tensorflow.python.platform import test File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/platform/test.py", line 24, in from tensorflow.python.framework import test_util as _test_util File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 36, in from absl.testing import parameterized File "/usr/local/lib/python3.8/dist-packages/absl/testing/parameterized.py", line 171, in from absl.testing import absltest File "/usr/local/lib/python3.8/dist-packages/absl/testing/absltest.py", line 236, in flags.DEFINE_string('test_tmpdir', get_default_test_tmpdir(), File "/usr/local/lib/python3.8/dist-packages/absl/testing/absltest.py", line 177, in get_default_test_tmpdir tmpdir = os.path.join(tempfile.gettempdir(), 'absl_testing') File "/usr/lib/python3.8/tempfile.py", line 441, in gettempdir tempdir = _get_default_tempdir() File "/usr/lib/python3.8/tempfile.py", line 357, in _get_default_tempdir raise FileNotFoundError(_errno.ENOENT, [1417753108, 1417753107, 1417753106, 1417753105, 1417753104, 1417753103, 1417753089, 1417753088, 1417753087, 1417753086, 1417753083, 1417753082, 1417753072, 1417753071, 1417753070, 1417753069, 1417753067, 1417753066, 1417753054, 1417753053, 1417753052, 1417753051, 1417753049, 1417753047, 1417753038, 1417753037] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 26 time used for this insertion : 0.05725812911987305 save_final ERROR in last step tfhub_classification2, [Errno 2] No usable temporary directory found in ['/tmp', '/var/tmp', '/usr/tmp', '/home/admin/workarea/git/Velours/python'] time spend for datou_step_exec : 2.4737963676452637 time spend to save output : 0.06051898002624512 total time spend for step 0 : 2.534315347671509 need to delete datou_research and reload, so keep current state 1 caffe_path_current : About to save ! 2 After save, about to update current ! 3.66user 3.49system 0:26.96elapsed 26%CPU (0avgtext+0avgdata 385560maxresident)k 2288inputs+402520outputs (16major+153806minor)pagefaults 0swaps