python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 820047 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 136>100 please execute split_portfolio.py -i 22870033 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2818969'] with mtr_portfolio_ids : ['22870033'] and first list_photo_ids : [] new path : /proc/820047/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.720083713531494 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Mon May 12 05:42:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1747021346_820047_1357597894_a3eae5c6d52a9e313c4874648563c07d.jpg resize: (1080, 1632) 1357597894 -5.5762580499198355 treat image : temp/1747021346_820047_1357597893_d8f834f5b791e06937305f755e5d1c8a.jpg resize: (1080, 1632) 1357597893 -5.517544693364626 treat image : temp/1747021346_820047_1357597892_554da74b6bb0093c54b3e001740938a7.jpg resize: (1080, 1632) 1357597892 -5.405776390827972 treat image : temp/1747021346_820047_1357597890_9f24ff108e73f3ff20d25de01f74fb5e.jpg resize: (1080, 1632) 1357597890 -0.2982331328219186 treat image : temp/1747021346_820047_1357597849_38b0a56c58a0d35c0151feb9d9a5d173.jpg resize: (1080, 1632) 1357597849 -5.447941157519808 treat image : temp/1747021346_820047_1357597848_1b7a686a4b8923b439a99fde5fb70b54.jpg resize: (1080, 1632) 1357597848 -3.252400478168147 treat image : temp/1747021346_820047_1357597847_6b1ab70b884847f62fc2015a365467f4.jpg resize: (1080, 1632) 1357597847 -3.2362427929459225 treat image : temp/1747021346_820047_1357597846_6775bc3d08d808d01439e8256a0a5a9d.jpg resize: (1080, 1632) 1357597846 -5.20364045367317 treat image : temp/1747021346_820047_1357597845_722852acb243bc224f027831de2842b9.jpg resize: (1080, 1632) 1357597845 -5.7433898775594106 treat image : temp/1747021346_820047_1357597818_27a5efdbfa0a1b7900fe5b98f528c66d.jpg resize: (1080, 1632) 1357597818 -5.792391960234177 treat image : temp/1747021346_820047_1357597815_176375a558fb16f617c8bc282d8fe717.jpg resize: (1080, 1632) 1357597815 -5.944530334159415 treat image : temp/1747021346_820047_1357597801_6cc8b097b3f137f496bcbc09aac1bff7.jpg resize: (1080, 1632) 1357597801 -1.9516055953241314 treat image : temp/1747021346_820047_1357597799_8e8725054890764c2b548f1d25f437ff.jpg resize: (1080, 1632) 1357597799 -2.258740431879005 treat image : temp/1747021346_820047_1357597797_2fbee41ec0d59f7a755fdc2ce4809f67.jpg resize: (1080, 1632) 1357597797 -5.205674672531234 treat image : temp/1747021346_820047_1357597795_a6e7fec6ec1f523571deba269ccb7b7d.jpg resize: (1080, 1632) 1357597795 -6.1600374784914615 treat image : temp/1747021346_820047_1357597792_24f0260a39809b4404639ad244bb7d9a.jpg resize: (1080, 1632) 1357597792 -4.83523561665631 treat image : temp/1747021346_820047_1357597659_487c8e8799402c5a9a5eabf425c3f7d9.jpg resize: (1080, 1632) 1357597659 -5.673905489259892 treat image : temp/1747021346_820047_1357597656_9b497e323e6852a05ad516670e25489d.jpg resize: (1080, 1632) 1357597656 -0.7900343868397675 treat image : temp/1747021346_820047_1357597488_bed898ee9e5259a608385237e1a61b53.jpg resize: (1080, 1632) 1357597488 -6.057835022532507 treat image : temp/1747021346_820047_1357597483_2c563bbec2a0172e0b3ad30540234634.jpg resize: (1080, 1632) 1357597483 -4.9728418350971655 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.01294398307800293 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.012752056121826172 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.015839815139770508 save missing photos in datou_result : time spend for datou_step_exec : 15.286834001541138 time spend to save output : 0.12331843376159668 total time spend for step 1 : 15.410152435302734 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.01user 3.68system 0:20.28elapsed 87%CPU (0avgtext+0avgdata 142608maxresident)k 136inputs+9784outputs (0major+258848minor)pagefaults 0swaps