TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 1189>100 please execute split_portfolio.py -i 23183727 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2914480'] with mtr_portfolio_ids : ['23183727'] and first list_photo_ids : [] new path : /proc/2111416/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.202152967453003 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Wed May 21 10:17:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1747815446_2111416_1359988784_3457f192f93959f61f6a21515f77ea2a.jpg resize: (1080, 1632) 1359988784 -3.622342836652591 treat image : temp/1747815446_2111416_1359988780_301292dcec176d7fb283e4eddd48ad37.jpg resize: (1080, 1632) 1359988780 -4.24744985031002 treat image : temp/1747815446_2111416_1359988776_5b9971e024d057aeadda751f5798f4ab.jpg resize: (1080, 1632) 1359988776 -1.7045466063497892 treat image : temp/1747815446_2111416_1359988750_4e2bc7c162da9ec544b189d49bd240df.jpg resize: (1080, 1632) 1359988750 -5.242859029265341 treat image : temp/1747815446_2111416_1359988745_cad45787464a566ed6dab99deebe6840.jpg resize: (1080, 1632) 1359988745 -5.220961139349174 treat image : temp/1747815446_2111416_1359988740_ae51cc2a608add31847d5dddc768408d.jpg resize: (1080, 1632) 1359988740 -4.496161058598901 treat image : temp/1747815446_2111416_1359988642_5caffb0a712bfb42a0377096d7a92d54.jpg resize: (1080, 1632) 1359988642 -3.253175667334795 treat image : temp/1747815446_2111416_1359988618_5b4103a39b5b88ba0a05d2a2c3fab93d.jpg resize: (1080, 1632) 1359988618 -5.976082153137903 treat image : temp/1747815446_2111416_1359988612_904679c143af7f44641b8e4ecc73c4ce.jpg resize: (1080, 1632) 1359988612 -4.632782133317196 treat image : temp/1747815446_2111416_1359988607_9b64f0c6182ed62ae9f772f228797089.jpg resize: (1080, 1632) 1359988607 -4.8328713529237595 treat image : temp/1747815446_2111416_1359988596_e9f34eb792819022ac742b3963fa3363.jpg resize: (1080, 1632) 1359988596 -4.994975297289077 treat image : temp/1747815446_2111416_1359988481_677a7ea1a430a2cf625ac434712dac14.jpg resize: (1080, 1632) 1359988481 -1.5367121646579944 treat image : temp/1747815446_2111416_1359988477_ac9f6d3b3c51639a35070713cdb5babc.jpg resize: (1080, 1632) 1359988477 -3.7444086704435002 treat image : temp/1747815446_2111416_1359988472_da14aef7ce65de30c7fead06e96d0b46.jpg resize: (1080, 1632) 1359988472 -4.118322401661142 treat image : temp/1747815446_2111416_1359988459_0361b314c8444f03d0ee2baf028fccf7.jpg resize: (1080, 1632) 1359988459 -4.409708701288817 treat image : temp/1747815446_2111416_1359988444_1cac77d8943a57213c6ecfb8f9c5b137.jpg resize: (1080, 1632) 1359988444 -5.414538245277474 treat image : temp/1747815446_2111416_1359988242_76b60ccc7171036831a904e065810aec.jpg resize: (1080, 1632) 1359988242 -4.669952240492146 treat image : temp/1747815446_2111416_1359988214_6d99bd31df2ccbe89088f1cdedfa9ca4.jpg resize: (1080, 1632) 1359988214 -4.899303708460501 treat image : temp/1747815446_2111416_1359988187_d50aeb4c425487aed5df3ab97583d5c2.jpg resize: (1080, 1632) 1359988187 -3.3992107912564906 treat image : temp/1747815446_2111416_1359987979_1dfbc34edf9ca2bbcd99893903ecef36.jpg resize: (1080, 1632) 1359987979 -3.047291774506687 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.015694856643676758 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.08792924880981445 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.12607097625732422 save missing photos in datou_result : time spend for datou_step_exec : 16.81571364402771 time spend to save output : 0.23482871055603027 total time spend for step 1 : 17.05054235458374 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.50user 5.40system 0:20.83elapsed 95%CPU (0avgtext+0avgdata 138912maxresident)k 152inputs+8584outputs (18major+256436minor)pagefaults 0swaps