python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 12 -a ' -a 533 -l 200 --rand=1 ' -s datou_current_533 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1204689 load datou : 533 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Date 2026-09-12 11:20:30.741745 Current got : datou_id : 533, datou_cur_ids : ['4388558'] with mtr_portfolio_ids : ['31159634'] and first list_photo_ids : [] new path : /proc/1204689/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! List Step Type Loaded in datou : tfhub_classification2, argmax list_input_json : {} origin We have 1 , BFBFBFBFBFBFB[Errno 28] No space left on device can't download the photo : 1417815988 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417815988_328cfcd95ad0aca5ec4131b61af91e09.jpg FB[Errno 28] No space left on device can't download the photo : 1417815987 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417815987_b22da53f6e80b52ae44a14d9af5c8970.jpg FB[Errno 28] No space left on device can't download the photo : 1417815986 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417815986_ce97a0c68efbc588635b5420deb194f1.jpg FB[Errno 28] No space left on device can't download the photo : 1417815983 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417815983_792b8dd47b2eb4be7dd4c1992fe8ee3c.jpg FB[Errno 28] No space left on device can't download the photo : 1417815982 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417815982_275a92b81338aadb5ce87fdf47181689.jpg FB[Errno 28] No space left on device can't download the photo : 1417815981 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417815981_d0943d809f1416e7fa572a97b724aafd.jpg FB[Errno 28] No space left on device can't download the photo : 1417815980 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417815980_c4ac4fe1787fc84dcab0216c8604c6d6.jpg FB[Errno 28] No space left on device can't download the photo : 1417815979 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417815979_d06718f65dff5bf30545225387791253.jpg FB[Errno 28] No space left on device can't download the photo : 1417815978 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417815978_d5b280db0b5e1cd22c35b7445914d9bf.jpg FB[Errno 28] No space left on device can't download the photo : 1417815030 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417815030_e6ad32e2ddd9ac7d9283e2846c4fc7be.jpg FB[Errno 28] No space left on device can't download the photo : 1417815029 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417815029_c95c2052157e3bc73174a7f1a4b81963.jpg FB[Errno 28] No space left on device can't download the photo : 1417815028 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417815028_12ccda0459daf2dd0a28b1f5c5485508.jpg FB[Errno 28] No space left on device can't download the photo : 1417815027 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417815027_1ba751044736459fb763f940bc99bfd8.jpg FB[Errno 28] No space left on device can't download the photo : 1417815026 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417815026_f065daa2ba7a8796c56d2a3741aa73be.jpg FB[Errno 28] No space left on device can't download the photo : 1417815025 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417815025_534864c70954215aff5c34ec019de3ae.jpg FB[Errno 28] No space left on device can't download the photo : 1417814505 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417814505_8471fd0ef63d6ce1d869ec7cce047539.jpg FB[Errno 28] No space left on device can't download the photo : 1417814502 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417814502_885bc746d3bb79c2dce88e269ec9a8a2.jpg FB[Errno 28] No space left on device can't download the photo : 1417814501 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417814501_9626c95f111f9cb3f12adca00b814858.jpg FB[Errno 28] No space left on device can't download the photo : 1417814499 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417814499_d5168ebdbaabc4c8057a4ac256d52fa8.jpg FB[Errno 28] No space left on device can't download the photo : 1417814498 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417814498_b587af0f10c031724fc42edaf22a776e.jpg FB[Errno 28] No space left on device can't download the photo : 1417814497 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417814497_4fa23b0b3cf73da4abde2a854b033d2c.jpg FB[Errno 28] No space left on device can't download the photo : 1417813809 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417813809_ae2b1175fbe81fe2ac68b4b4aa1bf3b1.jpg FB[Errno 28] No space left on device can't download the photo : 1417813808 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417813808_17998858652251fd33ada61b3008a46a.jpg FB[Errno 28] No space left on device can't download the photo : 1417813807 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417813807_413a4bcd343d175838289e54ba1061d4.jpg FB[Errno 28] No space left on device can't download the photo : 1417813806 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417813806_5899127329a3c136f4492e24e4cf0f0b.jpg FB[Errno 28] No space left on device can't download the photo : 1417813805 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417813805_83a16941eb0d2f9c529ecbe1c5c4c07f.jpg FB[Errno 28] No space left on device can't download the photo : 1417813804 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417813804_7b5feab4bc93c75b255a1f5d0a39a57f.jpg FB[Errno 28] No space left on device can't download the photo : 1417813517 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417813517_d07779aa6a2fa9132999ce132a6408e9.jpg FB[Errno 28] No space left on device can't download the photo : 1417813516 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417813516_079aa681229b80aba9e74a18927b0e4d.jpg FB[Errno 28] No space left on device can't download the photo : 1417813515 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417813515_6f02e2ee4915b3db0d7bd64349ae8a97.jpg FB[Errno 28] No space left on device can't download the photo : 1417813514 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417813514_f1c158b275bc3c8e1b115b789843b189.jpg FB[Errno 28] No space left on device can't download the photo : 1417813513 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417813513_b50b32e173a1141ebf58cc84e34caa54.jpg FB[Errno 28] No space left on device can't download the photo : 1417813512 complete_path : /home/admin/workarea/git/Velours/python/temp/1789204830_1204689_1417813512_887cc418279efebb703ca74106e485b7.jpg Fwe have missing 33 photos in the step downloads : photo missing : [1417815988, 1417815987, 1417815986, 1417815983, 1417815982, 1417815981, 1417815980, 1417815979, 1417815978, 1417815030, 1417815029, 1417815028, 1417815027, 1417815026, 1417815025, 1417814505, 1417814502, 1417814501, 1417814499, 1417814498, 1417814497, 1417813809, 1417813808, 1417813807, 1417813806, 1417813805, 1417813804, 1417813517, 1417813516, 1417813515, 1417813514, 1417813513, 1417813512] try to delete the photos missing in DB Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417815988 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417815987 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417815986 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417815983 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417815982 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417815981 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417815980 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417815979 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417815978 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417815030 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417815029 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417815028 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417815027 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417815026 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417815025 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417814505 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417814502 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417814501 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417814499 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417814498 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417814497 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417813809 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417813808 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417813807 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417813806 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417813805 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417813804 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417813517 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417813516 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417813515 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417813514 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417813513 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417813512 length of list_filenames : 6 ; length of list_pids : 6 ; length of list_args : 6 time to download the photos : 104.03133082389832 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 2 step1:tfhub_classification2 Sat Sep 12 11:22:14 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou_step TFHub with tf2 ! nombre de thcls : 3 we are using the classfication for multi_thcl [3513, 3379, 3847] begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10999 max_wait_temp : 1 max_wait : 5 ERROR in datou_step_exec, will save and exit ! [Errno 2] No usable temporary directory found in ['/tmp', '/var/tmp', '/usr/tmp', '/home/admin/workarea/git/Velours/python'] File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2340, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2534, in datou_step_exec return lib_process.datou_step_tfhub2(param, json_param, args, cache, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_process.py", line 3089, in datou_step_tfhub2 import tensorflow as tf File "/usr/local/lib/python3.8/dist-packages/tensorflow/__init__.py", line 41, in from tensorflow.python.tools import module_util as _module_util File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/__init__.py", line 132, in from tensorflow.python.platform import test File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/platform/test.py", line 24, in from tensorflow.python.framework import test_util as _test_util File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 36, in from absl.testing import parameterized File "/usr/local/lib/python3.8/dist-packages/absl/testing/parameterized.py", line 171, in from absl.testing import absltest File "/usr/local/lib/python3.8/dist-packages/absl/testing/absltest.py", line 236, in flags.DEFINE_string('test_tmpdir', get_default_test_tmpdir(), File "/usr/local/lib/python3.8/dist-packages/absl/testing/absltest.py", line 177, in get_default_test_tmpdir tmpdir = os.path.join(tempfile.gettempdir(), 'absl_testing') File "/usr/lib/python3.8/tempfile.py", line 441, in gettempdir tempdir = _get_default_tempdir() File "/usr/lib/python3.8/tempfile.py", line 357, in _get_default_tempdir raise FileNotFoundError(_errno.ENOENT, [1417816005, 1417816003, 1417816002, 1417816001, 1417816000, 1417815998] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.07219552993774414 save_final ERROR in last step tfhub_classification2, [Errno 2] No usable temporary directory found in ['/tmp', '/var/tmp', '/usr/tmp', '/home/admin/workarea/git/Velours/python'] time spend for datou_step_exec : 3.2312026023864746 time spend to save output : 0.079437255859375 total time spend for step 0 : 3.3106398582458496 need to delete datou_research and reload, so keep current state 1 caffe_path_current : About to save ! 2 After save, about to update current ! 3.43user 3.45system 1:52.89elapsed 6%CPU (0avgtext+0avgdata 390228maxresident)k 471944inputs+95512outputs (2303major+135168minor)pagefaults 0swaps