python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3125049 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 3435>100 please execute split_portfolio.py -i 26769748 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3700792'] with mtr_portfolio_ids : ['26769748'] and first list_photo_ids : [] new path : /proc/3125049/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BHTTP Error 402: Payment Required can't download the photo : 1383487347 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487347_761a6eb949ea374190443c82301771e6.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487345 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487345_06d876f3908402e33147919812853b20.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487343 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487343_eb8e199a80153c2e6911ae652f353af9.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487302 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487302_6f15c691c910d0cb6c85873c25c1a29e.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487299 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487299_abb92a509665296a7ca5b7593b2cf80b.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487296 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487296_2238866eaed68bdae2e6a25b3e4185b0.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487272 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487272_323e2bef7949cd53d7f4e8444bf1eb8b.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487271 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487271_aae067ff0a9fe1bbc6a444e593712462.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487269 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487269_26975b1717e840ba74b4025f2982cd77.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487234 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487234_f27bc8b83ac55950ee1f5f80f373f3b2.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487216 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487216_5fad15b465c065311d66f8641b72fa7b.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487214 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487214_657b2dc90c7822e3d95e7813013263fe.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487213 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487213_efbf840ef6036719b509a6aaa5e34edd.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487212 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487212_5eaa5b5b2312e9ddde830666e3474569.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487211 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487211_aad8ee94ab434f99d47489c94198f33a.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487210 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487210_8cb83134df8705c07fa858bbc12d6d53.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487113 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487113_6f69ec5a14eb4a511a0d728c56a7f1fe.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487072 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487072_d40f4ec02777b1903d4d460e39326168.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487047 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487047_102ad4bcb3dad31a0cc7cbc328539503.jpg FBHTTP Error 402: Payment Required can't download the photo : 1383487016 complete_path : /home/admin/workarea/git/Velours/python/temp/1757686047_3125049_1383487016_66a8bb3e6c700240fb7ed52bb42bf869.jpg Fwe have missing 20 photos in the step downloads : photo missing : [1383487347, 1383487345, 1383487343, 1383487302, 1383487299, 1383487296, 1383487272, 1383487271, 1383487269, 1383487234, 1383487216, 1383487214, 1383487213, 1383487212, 1383487211, 1383487210, 1383487113, 1383487072, 1383487047, 1383487016] try to delete the photos missing in DB Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487347 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487345 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487343 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487302 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487299 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487296 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487272 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487271 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487269 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487234 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487216 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487214 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487213 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487212 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487211 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487210 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487113 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487072 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487047 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1383487016 length of list_filenames : 0 ; length of list_pids : 0 ; length of list_args : 0 time to download the photos : 7.12190580368042 About to test input to load empty input or other problem ret : 2 all the photo in this batch is missing ! 1.06user 0.71system 0:09.18elapsed 19%CPU (0avgtext+0avgdata 100336maxresident)k 0inputs+32outputs (7major+48549minor)pagefaults 0swaps