python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 12 -a ' -a 533 -l 200 --rand=1 ' -s datou_current_533 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 4023201 load datou : 533 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 375>200 please execute split_portfolio.py -i 31129927 -l 200 size over we load limit photo not treated list_input_json: {} Date 2026-10-01 08:20:29.474525 Current got : datou_id : 533, datou_cur_ids : ['4386398'] with mtr_portfolio_ids : ['31129927'] and first list_photo_ids : [] new path : /proc/4023201/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! List Step Type Loaded in datou : tfhub_classification2, argmax list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFB[Errno 28] No space left on device can't download the photo : 1419142008 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419142008_a13a822c79c79834eca234973690d79c.jpg FB[Errno 28] No space left on device can't download the photo : 1419142005 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419142005_a312d283c24dfdfae121e070b5a70cd4.jpg FB[Errno 28] No space left on device can't download the photo : 1419142002 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419142002_254e57bc16cbb4e6b8fc1679f173f5f0.jpg FB[Errno 28] No space left on device can't download the photo : 1419142000 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419142000_e9f1cd2896b7db0899aa3ec09ac53c27.jpg FB[Errno 28] No space left on device can't download the photo : 1419141942 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419141942_3eca91127b3f171ef23b43421dda6791.jpg FB[Errno 28] No space left on device can't download the photo : 1419141941 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419141941_f05f48b912a9690470307039677c0c5b.jpg FB[Errno 28] No space left on device can't download the photo : 1419141940 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419141940_2052921f83b1a5763e205ce2cd7a254a.jpg FB[Errno 28] No space left on device can't download the photo : 1419141939 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419141939_c15768d1180bd7cefc87fb4bf35b7a85.jpg FB[Errno 28] No space left on device can't download the photo : 1419141937 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419141937_d44a49898fedf728e169fb57f70a3324.jpg FB[Errno 28] No space left on device can't download the photo : 1419141913 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419141913_6e8492829800063a71e327dc0a3beb40.jpg FB[Errno 28] No space left on device can't download the photo : 1419141553 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419141553_0aab2bf1b12a802ba66dfe585190bb8f.jpg FB[Errno 28] No space left on device can't download the photo : 1419141440 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419141440_8067935d759e0e60aa5081b7f0894f33.jpg FB[Errno 28] No space left on device can't download the photo : 1419141436 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419141436_292d31148b72e92b214d2bddf4af1482.jpg FB[Errno 28] No space left on device can't download the photo : 1419141433 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419141433_40b6e8a2de6558022a2802b12515b72e.jpg FB[Errno 28] No space left on device can't download the photo : 1419141429 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419141429_d21cebed1c22db1715772034514c1439.jpg FB[Errno 28] No space left on device can't download the photo : 1419141426 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419141426_ca498b1646b81f1cc6938ba1ad8f1bac.jpg FB[Errno 28] No space left on device can't download the photo : 1419141422 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419141422_0d7d0268d55ee27281e1efe364fd2c3d.jpg FB[Errno 28] No space left on device can't download the photo : 1419141420 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419141420_1c7a8af710d2ba2553c4630bae6e5a33.jpg FB[Errno 28] No space left on device can't download the photo : 1419141419 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419141419_06e1d41911b257c81328306c477b6a50.jpg FB[Errno 28] No space left on device can't download the photo : 1419141418 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419141418_3f7fa147b912ba8470dab3bd8fbd6177.jpg FB[Errno 28] No space left on device can't download the photo : 1419141415 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419141415_8d12d94e5c58159b0d08e906e0170324.jpg FB[Errno 28] No space left on device can't download the photo : 1419141412 complete_path : /home/admin/workarea/git/Velours/python/temp/1790835629_4023201_1419141412_fd44422de22944c4bc1fc7114b9c5700.jpg Fwe have missing 22 photos in the step downloads : photo missing : [1419142008, 1419142005, 1419142002, 1419142000, 1419141942, 1419141941, 1419141940, 1419141939, 1419141937, 1419141913, 1419141553, 1419141440, 1419141436, 1419141433, 1419141429, 1419141426, 1419141422, 1419141420, 1419141419, 1419141418, 1419141415, 1419141412] try to delete the photos missing in DB Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419142008 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419142005 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419142002 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419142000 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419141942 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419141941 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419141940 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419141939 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419141937 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419141913 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419141553 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419141440 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419141436 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419141433 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419141429 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419141426 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419141422 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419141420 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419141419 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419141418 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419141415 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1419141412 length of list_filenames : 86 ; length of list_pids : 86 ; length of list_args : 86 time to download the photos : 35.00334906578064 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 2 step1:tfhub_classification2 Thu Oct 1 08:21:04 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou_step TFHub with tf2 ! nombre de thcls : 3 we are using the classfication for multi_thcl [3513, 3379, 3847] begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 5 ERROR in datou_step_exec, will save and exit ! [Errno 2] No usable temporary directory found in ['/tmp', '/var/tmp', '/usr/tmp', '/home/admin/workarea/git/Velours/python'] File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2340, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2534, in datou_step_exec return lib_process.datou_step_tfhub2(param, json_param, args, cache, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_process.py", line 3089, in datou_step_tfhub2 import tensorflow as tf File "/usr/local/lib/python3.8/dist-packages/tensorflow/__init__.py", line 41, in from tensorflow.python.tools import module_util as _module_util File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/__init__.py", line 132, in from tensorflow.python.platform import test File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/platform/test.py", line 24, in from tensorflow.python.framework import test_util as _test_util File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 36, in from absl.testing import parameterized File "/usr/local/lib/python3.8/dist-packages/absl/testing/parameterized.py", line 171, in from absl.testing import absltest File "/usr/local/lib/python3.8/dist-packages/absl/testing/absltest.py", line 236, in flags.DEFINE_string('test_tmpdir', get_default_test_tmpdir(), File "/usr/local/lib/python3.8/dist-packages/absl/testing/absltest.py", line 177, in get_default_test_tmpdir tmpdir = os.path.join(tempfile.gettempdir(), 'absl_testing') File "/usr/lib/python3.8/tempfile.py", line 441, in gettempdir tempdir = _get_default_tempdir() File "/usr/lib/python3.8/tempfile.py", line 357, in _get_default_tempdir raise FileNotFoundError(_errno.ENOENT, [1419146755, 1419146730, 1419146717, 1419146691, 1419146664, 1419146663, 1419146441, 1419146384, 1419146380, 1419146379, 1419146378, 1419146376, 1419146372, 1419146368, 1419146366, 1419146351, 1419146293, 1419146237, 1419145916, 1419145865, 1419145807, 1419145757, 1419145703, 1419145645, 1419145344, 1419145343, 1419145342, 1419145341, 1419145339, 1419145336, 1419145325, 1419145322, 1419145321, 1419145320, 1419145319, 1419145317, 1419145312, 1419145309, 1419145307, 1419145306, 1419145305, 1419145303, 1419145297, 1419145294, 1419145293, 1419145292, 1419145291, 1419145289, 1419145282, 1419145279, 1419145278, 1419145276, 1419145275, 1419145273, 1419143282, 1419143278, 1419143275, 1419143273, 1419143270, 1419143269, 1419143264, 1419143260, 1419143253, 1419143217, 1419143206, 1419143204, 1419142171, 1419142096, 1419142053, 1419142052, 1419142051, 1419142050, 1419142043, 1419142042, 1419142040, 1419142039, 1419142038, 1419142037, 1419142027, 1419142026, 1419142025, 1419142024, 1419142021, 1419142018, 1419142014, 1419142011] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 86 time used for this insertion : 0.07784485816955566 save_final ERROR in last step tfhub_classification2, [Errno 2] No usable temporary directory found in ['/tmp', '/var/tmp', '/usr/tmp', '/home/admin/workarea/git/Velours/python'] time spend for datou_step_exec : 2.809061288833618 time spend to save output : 0.08466458320617676 total time spend for step 0 : 2.893725872039795 need to delete datou_research and reload, so keep current state 1 caffe_path_current : About to save ! 2 After save, about to update current ! 4.39user 5.34system 0:41.77elapsed 23%CPU (0avgtext+0avgdata 392032maxresident)k 4336inputs+1336800outputs (48major+241444minor)pagefaults 0swaps