python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 12 -a ' -a 533 -l 200 --rand=1 ' -s datou_current_533 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3166905 load datou : 533 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Date 2026-09-14 10:10:31.172880 Current got : datou_id : 533, datou_cur_ids : ['4380639'] with mtr_portfolio_ids : ['31049477'] and first list_photo_ids : [] new path : /proc/3166905/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! List Step Type Loaded in datou : tfhub_classification2, argmax list_input_json : {} origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFB[Errno 28] No space left on device can't download the photo : 1417906858 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906858_2569503fb99eed60acf8e688a4c4458b.jpg FB[Errno 28] No space left on device can't download the photo : 1417906857 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906857_02020af8858ebb4d6e51d98553838256.jpg FB[Errno 28] No space left on device can't download the photo : 1417906856 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906856_87c3fb2a5de41ae8447b4fe3631023c4.jpg FB[Errno 28] No space left on device can't download the photo : 1417906855 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906855_4300a9d2dd96bb9b3c8def0c9ed5882e.jpg FB[Errno 28] No space left on device can't download the photo : 1417906854 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906854_1c0a6ccc50cf0424c03c97e62e858a08.jpg FB[Errno 28] No space left on device can't download the photo : 1417906853 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906853_8561867421a1369c9757367f20bed21f.jpg FB[Errno 28] No space left on device can't download the photo : 1417906814 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906814_c367612a5665d3934c83e3c94d67cf30.jpg FB[Errno 28] No space left on device can't download the photo : 1417906813 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906813_7042668483534fddf037b28ee80f4730.jpg FB[Errno 28] No space left on device can't download the photo : 1417906812 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906812_899cd31afdaabf61297f213894ce8c66.jpg FB[Errno 28] No space left on device can't download the photo : 1417906811 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906811_ce8c822d5beb6f864c8a4b993bfb5d9f.jpg FB[Errno 28] No space left on device can't download the photo : 1417906810 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906810_1742778579a83917182f7058646edff6.jpg FB[Errno 28] No space left on device can't download the photo : 1417906809 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906809_24a3401230603540936adb617bf5b0a3.jpg FB[Errno 28] No space left on device can't download the photo : 1417906709 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906709_93ecf9a8cf6d401fab3230f95d0bee80.jpg FB[Errno 28] No space left on device can't download the photo : 1417906708 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906708_59fc42cf0d70da8739e496841e35121f.jpg FB[Errno 28] No space left on device can't download the photo : 1417906707 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906707_0a0509507afc18a17d7e1eec887903f1.jpg FB[Errno 28] No space left on device can't download the photo : 1417906706 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906706_1952b47f118891fad8f8428f438a6392.jpg FB[Errno 28] No space left on device can't download the photo : 1417906705 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906705_86c5075f1a193f3ff2238d25973d42ce.jpg FB[Errno 28] No space left on device can't download the photo : 1417906704 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906704_fa4cc61b90f108bf2c8753588b10d2c5.jpg FB[Errno 28] No space left on device can't download the photo : 1417906614 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906614_47ff714efd5bebcebe230d322f486059.jpg FB[Errno 28] No space left on device can't download the photo : 1417906611 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906611_85e5330c1f46856425eb58c3ff43427b.jpg FB[Errno 28] No space left on device can't download the photo : 1417906608 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906608_dc73be18f66839b9724399e5baa203d8.jpg FB[Errno 28] No space left on device can't download the photo : 1417906605 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906605_eb46bb4047504e7e46315d6471b14300.jpg FB[Errno 28] No space left on device can't download the photo : 1417906603 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906603_aa0fc41f35419b8e0a90e3c74068c880.jpg FB[Errno 28] No space left on device can't download the photo : 1417906602 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906602_5f09102e7676c76922c84535928dd2ea.jpg FB[Errno 28] No space left on device can't download the photo : 1417906439 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906439_84082ee8c49bf8f2cd7352effa61bdec.jpg FB[Errno 28] No space left on device can't download the photo : 1417906438 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906438_1f61ba462ea8e580b4d9404a38e5dc34.jpg FB[Errno 28] No space left on device can't download the photo : 1417906436 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906436_807b4aecf0da22ad07da4d6a3a5b383b.jpg FB[Errno 28] No space left on device can't download the photo : 1417906434 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906434_fa24ef83b728193b7ba81942208acf71.jpg FB[Errno 28] No space left on device can't download the photo : 1417906431 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906431_f13b93f9dfe8edb4644c47a2efede98a.jpg FB[Errno 28] No space left on device can't download the photo : 1417906428 complete_path : /home/admin/workarea/git/Velours/python/temp/1789373431_3166905_1417906428_870d221b140714922acc11069c5e02be.jpg Fwe have missing 30 photos in the step downloads : photo missing : [1417906858, 1417906857, 1417906856, 1417906855, 1417906854, 1417906853, 1417906814, 1417906813, 1417906812, 1417906811, 1417906810, 1417906809, 1417906709, 1417906708, 1417906707, 1417906706, 1417906705, 1417906704, 1417906614, 1417906611, 1417906608, 1417906605, 1417906603, 1417906602, 1417906439, 1417906438, 1417906436, 1417906434, 1417906431, 1417906428] try to delete the photos missing in DB Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906858 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906857 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906856 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906855 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906854 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906853 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906814 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906813 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906812 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906811 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906810 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906809 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906709 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906708 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906707 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906706 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906705 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906704 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906614 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906611 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906608 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906605 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906603 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906602 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906439 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906438 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906436 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906434 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906431 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1417906428 length of list_filenames : 12 ; length of list_pids : 12 ; length of list_args : 12 time to download the photos : 14.997342586517334 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 2 step1:tfhub_classification2 Mon Sep 14 10:10:46 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou_step TFHub with tf2 ! nombre de thcls : 3 we are using the classfication for multi_thcl [3513, 3379, 3847] begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10775 max_wait_temp : 1 max_wait : 5 ERROR in datou_step_exec, will save and exit ! [Errno 2] No usable temporary directory found in ['/tmp', '/var/tmp', '/usr/tmp', '/home/admin/workarea/git/Velours/python'] File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2340, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2534, in datou_step_exec return lib_process.datou_step_tfhub2(param, json_param, args, cache, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_process.py", line 3089, in datou_step_tfhub2 import tensorflow as tf File "/usr/local/lib/python3.8/dist-packages/tensorflow/__init__.py", line 41, in from tensorflow.python.tools import module_util as _module_util File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/__init__.py", line 132, in from tensorflow.python.platform import test File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/platform/test.py", line 24, in from tensorflow.python.framework import test_util as _test_util File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 36, in from absl.testing import parameterized File "/usr/local/lib/python3.8/dist-packages/absl/testing/parameterized.py", line 171, in from absl.testing import absltest File "/usr/local/lib/python3.8/dist-packages/absl/testing/absltest.py", line 236, in flags.DEFINE_string('test_tmpdir', get_default_test_tmpdir(), File "/usr/local/lib/python3.8/dist-packages/absl/testing/absltest.py", line 177, in get_default_test_tmpdir tmpdir = os.path.join(tempfile.gettempdir(), 'absl_testing') File "/usr/lib/python3.8/tempfile.py", line 441, in gettempdir tempdir = _get_default_tempdir() File "/usr/lib/python3.8/tempfile.py", line 357, in _get_default_tempdir raise FileNotFoundError(_errno.ENOENT, [1417907095, 1417907092, 1417907090, 1417907087, 1417907082, 1417907078, 1417906963, 1417906962, 1417906961, 1417906959, 1417906958, 1417906956] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.04102802276611328 save_final ERROR in last step tfhub_classification2, [Errno 2] No usable temporary directory found in ['/tmp', '/var/tmp', '/usr/tmp', '/home/admin/workarea/git/Velours/python'] time spend for datou_step_exec : 3.3745651245117188 time spend to save output : 0.04630780220031738 total time spend for step 0 : 3.420872926712036 need to delete datou_research and reload, so keep current state 1 caffe_path_current : About to save ! 2 After save, about to update current ! 3.71user 3.83system 0:23.73elapsed 31%CPU (0avgtext+0avgdata 404788maxresident)k 474760inputs+178024outputs (2328major+178793minor)pagefaults 0swaps