python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 12 -a ' -a 533 -l 200 --rand=1 ' -s datou_current_533 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2722499 load datou : 533 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 712>200 please execute split_portfolio.py -i 31042617 -l 200 size over we load limit photo not treated list_input_json: {} Date 2026-05-09 10:00:31.191143 Current got : datou_id : 533, datou_cur_ids : ['4378536'] with mtr_portfolio_ids : ['31042617'] and first list_photo_ids : [] new path : /proc/2722499/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! List Step Type Loaded in datou : tfhub_classification2, argmax list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFB[Errno 28] No space left on device can't download the photo : 1416699733 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699733_4b8a1e07282b0daa508e61c4edd588f3.jpg FB[Errno 28] No space left on device can't download the photo : 1416699675 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699675_53327596e428a1cd759a5a967391fdca.jpg FB[Errno 28] No space left on device can't download the photo : 1416699674 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699674_187a0ab66da6b610eb0f2e63a5711c34.jpg FB[Errno 28] No space left on device can't download the photo : 1416699673 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699673_c095dfec1313909fa70402d9b129a59b.jpg FB[Errno 28] No space left on device can't download the photo : 1416699672 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699672_85cabdbe172473a375528aebe583d649.jpg FB[Errno 28] No space left on device can't download the photo : 1416699671 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699671_9cfd3e3cf9dc706819d96afd3acdc266.jpg FB[Errno 28] No space left on device can't download the photo : 1416699670 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699670_3670cb164012627156d2a51161a2ca7d.jpg FB[Errno 28] No space left on device can't download the photo : 1416699625 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699625_94b61f05471ceece82883a384f34d0f5.jpg FB[Errno 28] No space left on device can't download the photo : 1416699624 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699624_4a7988d8018e7bedc8de640fc3cc9a9f.jpg FB[Errno 28] No space left on device can't download the photo : 1416699622 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699622_acacc9a0b7f2e64c8fe78a0f1a259f68.jpg FB[Errno 28] No space left on device can't download the photo : 1416699620 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699620_4222a5093bf5e9129f76d1e3406f7757.jpg FB[Errno 28] No space left on device can't download the photo : 1416699618 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699618_f10df348890399805543278e3ccb2258.jpg FB[Errno 28] No space left on device can't download the photo : 1416699616 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699616_74c1be65462f1ebbd05579faaf7d27e4.jpg FB[Errno 28] No space left on device can't download the photo : 1416699575 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699575_2a5f7a757db3b47ed3ea4db8c9ae236e.jpg FB[Errno 28] No space left on device can't download the photo : 1416699572 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699572_b758943c416d2476af6e5098f36311bb.jpg FB[Errno 28] No space left on device can't download the photo : 1416699570 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699570_e3bf69fff61d529d531928fdd3f75ccb.jpg FB[Errno 28] No space left on device can't download the photo : 1416699568 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699568_db958b4ef8420af9fc18f7a0e2a6b24f.jpg FB[Errno 28] No space left on device can't download the photo : 1416699567 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699567_48ffba22991feb2abced95a40daa0a9a.jpg FB[Errno 28] No space left on device can't download the photo : 1416699566 complete_path : /home/admin/workarea/git/Velours/python/temp/1778313631_2722499_1416699566_ac717ee694f626cebe85e2f064ccab90.jpg Fwe have missing 19 photos in the step downloads : photo missing : [1416699733, 1416699675, 1416699674, 1416699673, 1416699672, 1416699671, 1416699670, 1416699625, 1416699624, 1416699622, 1416699620, 1416699618, 1416699616, 1416699575, 1416699572, 1416699570, 1416699568, 1416699567, 1416699566] try to delete the photos missing in DB Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699733 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699675 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699674 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699673 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699672 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699671 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699670 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699625 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699624 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699622 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699620 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699618 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699616 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699575 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699572 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699570 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699568 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699567 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1416699566 length of list_filenames : 88 ; length of list_pids : 88 ; length of list_args : 88 time to download the photos : 33.36718273162842 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 2 step1:tfhub_classification2 Sat May 9 10:01:04 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou_step TFHub with tf2 ! nombre de thcls : 3 we are using the classfication for multi_thcl [3513, 3379, 3847] begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 5 ERROR in datou_step_exec, will save and exit ! [Errno 2] No usable temporary directory found in ['/tmp', '/var/tmp', '/usr/tmp', '/home/admin/workarea/git/Velours/python'] File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2340, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2534, in datou_step_exec return lib_process.datou_step_tfhub2(param, json_param, args, cache, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_process.py", line 3089, in datou_step_tfhub2 import tensorflow as tf File "/usr/local/lib/python3.8/dist-packages/tensorflow/__init__.py", line 41, in from tensorflow.python.tools import module_util as _module_util File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/__init__.py", line 132, in from tensorflow.python.platform import test File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/platform/test.py", line 24, in from tensorflow.python.framework import test_util as _test_util File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 36, in from absl.testing import parameterized File "/usr/local/lib/python3.8/dist-packages/absl/testing/parameterized.py", line 171, in from absl.testing import absltest File "/usr/local/lib/python3.8/dist-packages/absl/testing/absltest.py", line 236, in flags.DEFINE_string('test_tmpdir', get_default_test_tmpdir(), File "/usr/local/lib/python3.8/dist-packages/absl/testing/absltest.py", line 177, in get_default_test_tmpdir tmpdir = os.path.join(tempfile.gettempdir(), 'absl_testing') File "/usr/lib/python3.8/tempfile.py", line 441, in gettempdir tempdir = _get_default_tempdir() File "/usr/lib/python3.8/tempfile.py", line 357, in _get_default_tempdir raise FileNotFoundError(_errno.ENOENT, [1416700921, 1416700920, 1416700919, 1416700918, 1416700917, 1416700916, 1416700915, 1416700914, 1416700913, 1416700912, 1416700911, 1416700910, 1416700909, 1416700908, 1416700894, 1416700893, 1416700892, 1416700891, 1416700890, 1416700889, 1416700863, 1416700862, 1416700861, 1416700860, 1416700859, 1416700858, 1416700850, 1416700849, 1416700848, 1416700847, 1416700846, 1416700845, 1416700793, 1416700792, 1416700727, 1416700724, 1416700721, 1416700717, 1416700713, 1416700711, 1416700627, 1416700590, 1416700524, 1416700522, 1416700489, 1416700255, 1416700178, 1416700177, 1416700174, 1416700172, 1416700169, 1416700166, 1416700104, 1416700102, 1416700099, 1416700094, 1416700091, 1416700089, 1416699974, 1416699973, 1416699971, 1416699969, 1416699964, 1416699961, 1416699915, 1416699913, 1416699911, 1416699908, 1416699906, 1416699905, 1416699860, 1416699847, 1416699846, 1416699845, 1416699844, 1416699843, 1416699842, 1416699799, 1416699798, 1416699797, 1416699795, 1416699792, 1416699790, 1416699742, 1416699740, 1416699738, 1416699736, 1416699734] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 88 time used for this insertion : 0.029515981674194336 save_final ERROR in last step tfhub_classification2, [Errno 2] No usable temporary directory found in ['/tmp', '/var/tmp', '/usr/tmp', '/home/admin/workarea/git/Velours/python'] time spend for datou_step_exec : 2.391176223754883 time spend to save output : 0.0369114875793457 total time spend for step 0 : 2.4280877113342285 need to delete datou_research and reload, so keep current state 1 caffe_path_current : About to save ! 2 After save, about to update current ! 3.99user 4.13system 0:40.90elapsed 19%CPU (0avgtext+0avgdata 371680maxresident)k 15832inputs+1370144outputs (227major+153336minor)pagefaults 0swaps