python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1584086 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 3876>100 please execute split_portfolio.py -i 24493811 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3224247'] with mtr_portfolio_ids : ['24493811'] and first list_photo_ids : [] new path : /proc/1584086/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 2 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.3227920532226562 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Wed Jul 2 18:32:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1751473950_1584086_1369999426_7792427355e1678adad04e4fe1d90d70.jpg resize: (1080, 1632) 1369999426 -5.660410105930025 treat image : temp/1751473950_1584086_1369999382_6011f6f79c0f341fee603daf20eda76f.jpg resize: (1080, 1632) 1369999382 -1.230229022519118 treat image : temp/1751473950_1584086_1369999343_d641edaa6d17eac91e1ccce9a6bebfae.jpg resize: (1080, 1632) 1369999343 -2.2915331150510867 treat image : temp/1751473950_1584086_1369999303_ff959fa1cdb3e572ab8e496aa693040e.jpg resize: (1080, 1632) 1369999303 -2.308298090893985 treat image : temp/1751473950_1584086_1369999264_c849024c404791bd8fae48d1e62fa52b.jpg resize: (1080, 1632) 1369999264 -2.346718092784931 treat image : temp/1751473950_1584086_1369999222_00e2dc94eb9631100da41d0f40a99f04.jpg resize: (1080, 1632) 1369999222 -1.8402878164295795 treat image : temp/1751473950_1584086_1369999035_f1782386ba9fb8d247b2b8007a6ac068.jpg resize: (1080, 1632) 1369999035 -5.52990684059625 treat image : temp/1751473950_1584086_1369998994_608a759fba87c9d98f7c8d5f16f903d3.jpg resize: (1080, 1632) 1369998994 -5.473338743173402 treat image : temp/1751473950_1584086_1369998934_49efaf9f1c03d0062d7e1753b427af44.jpg resize: (1080, 1632) 1369998934 -5.50535089079654 treat image : temp/1751473950_1584086_1369998848_e98278dcff9aaa07980f72e36da0ffa3.jpg resize: (1080, 1632) 1369998848 -5.648332359948896 treat image : temp/1751473950_1584086_1369998810_fa8f1d03aaaba6d3d82fafe3f115e913.jpg resize: (1080, 1632) 1369998810 -5.710659821257567 treat image : temp/1751473950_1584086_1369998759_8b3b24069dc4db2031de676ff89ea067.jpg resize: (1080, 1632) 1369998759 -5.705837896491102 treat image : temp/1751473950_1584086_1369998577_b98a8ff52ee5b1c11ad0eaf07662fb2a.jpg resize: (1080, 1632) 1369998577 -5.162733015045474 treat image : temp/1751473950_1584086_1369998528_79cd27c233d6f19a4cda33cf2b84bffb.jpg resize: (1080, 1632) 1369998528 -5.2007537546250715 treat image : temp/1751473950_1584086_1369998464_9b60f0df48e5be09e61c27951b52cd5e.jpg resize: (1080, 1632) 1369998464 -5.176894423678491 treat image : temp/1751473950_1584086_1369998425_45b571accdfb4ff666c5d13e9b510a3b.jpg resize: (1080, 1632) 1369998425 -5.163809221327309 treat image : temp/1751473950_1584086_1369998374_9c6fe32e710d67e70a116b69f1bac721.jpg resize: (1080, 1632) 1369998374 -5.4470040949510246 treat image : temp/1751473950_1584086_1369998304_5a448b87298382ca3fb222833d94db26.jpg resize: (1080, 1632) 1369998304 -5.427868806878819 treat image : temp/1751473950_1584086_1369896252_25bbd384c9bc1f5a0a5d8f08261cba34.jpg resize: (1080, 1632) 1369896252 -5.197408623492919 treat image : temp/1751473950_1584086_1369896192_e075e05549979d8a5a26f340ac626ab1.jpg resize: (1080, 1632) 1369896192 -5.207004157414905 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.02979755401611328 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.01609516143798828 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.0878148078918457 save missing photos in datou_result : time spend for datou_step_exec : 15.380433320999146 time spend to save output : 0.13809633255004883 total time spend for step 1 : 15.518529653549194 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.67user 3.20system 0:21.88elapsed 81%CPU (0avgtext+0avgdata 138028maxresident)k 152inputs+9456outputs (3major+217432minor)pagefaults 0swaps