python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' --fifo -a 533 -l 100 ' -s datou_current_533 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 131053 load datou : 533 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 781>100 please execute split_portfolio.py -i 23321573 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 533, datou_cur_ids : ['2949141'] with mtr_portfolio_ids : ['23321573'] and first list_photo_ids : [] new path : /proc/131053/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! List Step Type Loaded in datou : tfhub_classification2, argmax list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! B[Errno 28] No space left on device can't download the photo : 1361097231 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361097231_7580835d2444204455a9ff4370590ba4.jpg FB[Errno 28] No space left on device can't download the photo : 1361097208 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361097208_3d24f4767539e5173936901ece1c7d41.jpg FB[Errno 28] No space left on device can't download the photo : 1361096708 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361096708_1fe5fb25574edd4aaa6b6533d2c3c8f4.jpg FB[Errno 28] No space left on device can't download the photo : 1361096676 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361096676_db7916bf614ceb2c54339bb046cf71d5.jpg FB[Errno 28] No space left on device can't download the photo : 1361096073 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361096073_584deec04bac2ad5e56e991cd831e477.jpg FB[Errno 28] No space left on device can't download the photo : 1361095721 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361095721_21aa86215ffc4ed9f27ecaede5a83a14.jpg FB[Errno 28] No space left on device can't download the photo : 1361095718 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361095718_6d3a87a92b693c803f3480b539584052.jpg FB[Errno 28] No space left on device can't download the photo : 1361095646 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361095646_9c9b6c71f6cdee169608692d3f278d6b.jpg FB[Errno 28] No space left on device can't download the photo : 1361095637 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361095637_19aa4fa71d5d14ce84f21ba287252546.jpg FB[Errno 28] No space left on device can't download the photo : 1361095591 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361095591_aff8e351459d28e0928858fc74c401e9.jpg FB[Errno 28] No space left on device can't download the photo : 1361095587 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361095587_72956dba8d2efd1ba3a10d99255d25e2.jpg FB[Errno 28] No space left on device can't download the photo : 1361095539 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361095539_7ba7d5f7bd5c90610dc718c7bf6c60bd.jpg FB[Errno 28] No space left on device can't download the photo : 1361095532 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361095532_c9be05640fbb4a02ca7222dfce593b0b.jpg FB[Errno 28] No space left on device can't download the photo : 1361095488 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361095488_a24145822e26c98173dc76acec15051e.jpg FB[Errno 28] No space left on device can't download the photo : 1361095485 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361095485_8837f02ba204337dd85790c3b1310802.jpg FB[Errno 28] No space left on device can't download the photo : 1361095414 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361095414_c76a2ac3ee6a5321e8030251c7906927.jpg FB[Errno 28] No space left on device can't download the photo : 1361095306 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361095306_ba2c3532ec771cced78f9792e7c197fc.jpg FB[Errno 28] No space left on device can't download the photo : 1361095119 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361095119_0de32c76242e9826dbf29bce1906cff0.jpg FB[Errno 28] No space left on device can't download the photo : 1361095113 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361095113_ba124b03773f3b54b5f5b8c5f594161b.jpg FB[Errno 28] No space left on device can't download the photo : 1361095038 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361095038_7f5814a5c72e3b76487421cbb3ba202d.jpg FB[Errno 28] No space left on device can't download the photo : 1361095022 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361095022_553a175145d806f92d1f9157711f05d1.jpg FB[Errno 28] No space left on device can't download the photo : 1361094805 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361094805_a4f7813758b4b3a1ec4930a32997413f.jpg FB[Errno 28] No space left on device can't download the photo : 1361094776 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361094776_85ce0761eeb0e677852ced4417edda4f.jpg FB[Errno 28] No space left on device can't download the photo : 1361094637 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361094637_3c7c2cf60ac85aff04d7ca55a05e1461.jpg FB[Errno 28] No space left on device can't download the photo : 1361094632 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361094632_15c8be909f41c6318264c143f5db6046.jpg FB[Errno 28] No space left on device can't download the photo : 1361094591 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361094591_e6180eff5a0068c2c90f0cff62d7cff3.jpg FB[Errno 28] No space left on device can't download the photo : 1361094587 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361094587_674a6d324c19c7491c38a4f901497bda.jpg FB[Errno 28] No space left on device can't download the photo : 1361094452 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361094452_df332ab26b15e5c5b32efbda64accd0f.jpg FB[Errno 28] No space left on device can't download the photo : 1361094434 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361094434_8ddee99fa1e2b9c01c0f45e65f952b60.jpg FB[Errno 28] No space left on device can't download the photo : 1361094173 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361094173_c8399b30350425f1408c7289200f2424.jpg FB[Errno 28] No space left on device can't download the photo : 1361094120 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361094120_3030a960ade7d4c40bad66695013e61d.jpg FB[Errno 28] No space left on device can't download the photo : 1361093827 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361093827_cf68c31e051529a60ea28add89c8512d.jpg FB[Errno 28] No space left on device can't download the photo : 1361093817 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361093817_527c23780ce45b17be6b7648d93b51a4.jpg FB[Errno 28] No space left on device can't download the photo : 1361093289 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361093289_e6ea7d82b4a155d9d9706c2afc85ce2a.jpg FB[Errno 28] No space left on device can't download the photo : 1361093285 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361093285_d482d3e1f7d123fb0d517e123846d665.jpg FB[Errno 28] No space left on device can't download the photo : 1361093026 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361093026_a48409b176c95fc25ede266003416dd7.jpg FB[Errno 28] No space left on device can't download the photo : 1361092961 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361092961_52b1fddc25fe52769ea5725cf0debefb.jpg FB[Errno 28] No space left on device can't download the photo : 1361092354 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361092354_0d2966adc269cbc74c4cae7921cbb620.jpg FB[Errno 28] No space left on device can't download the photo : 1361092282 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361092282_0c11fa62e97b94a3eb9bebbc964b4739.jpg FB[Errno 28] No space left on device can't download the photo : 1361091851 complete_path : /home/admin/workarea/git/Velours/python/temp/1748267188_131053_1361091851_7f4d2ce6700f2f706cc374e2d7448b6e.jpg FB[Errno 2we have missing 51 photos in the step downloads : photo missing : [1361097231, 1361097208, 1361096708, 1361096676, 1361096073, 1361095721, 1361095718, 1361095646, 1361095637, 1361095591, 1361095587, 1361095539, 1361095532, 1361095488, 1361095485, 1361095414, 1361095306, 1361095119, 1361095113, 1361095038, 1361095022, 1361094805, 1361094776, 1361094637, 1361094632, 1361094591, 1361094587, 1361094452, 1361094434, 1361094173, 1361094120, 1361093827, 1361093817, 1361093289, 1361093285, 1361093026, 1361092961, 1361092354, 1361092282, 1361091851, 1361091848, 1361091713, 1361091683, 1361091572, 1361091565, 1361091370, 1361091366, 1361091301, 1361091297, 1361091187, 1361091182] try to delete the photos missing in DB HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable HTTP Error 503: Service Unavailable length of list_filenames : 0 ; length of list_pids : 0 ; length of list_args : 0 time to download the photos : 8.829965353012085 About to test input to load empty input or other problem ret : 2 len(total_photo_id_missing) : 51 1.29user 0.69system 0:11.62elapsed 17%CPU (0avgtext+0avgdata 99836maxresident)k 288inputs+56outputs (11major+48850minor)pagefaults 0swaps