TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 1673>100 please execute split_portfolio.py -i 22525102 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2771543'] with mtr_portfolio_ids : ['22525102'] and first list_photo_ids : [] new path : /proc/2445257/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 13 ; length of list_pids : 13 ; length of list_args : 13 time to download the photos : 1.4148187637329102 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Wed Apr 30 14:32:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1746016348_2445257_1354699705_3555e1b014aca94597ee7ea213642a29.jpg resize: (1080, 1632) 1354699705 -5.926544751984401 treat image : temp/1746016348_2445257_1354699701_5f52afe82962583c8237b3a80c41274a.jpg resize: (1080, 1632) 1354699701 -3.408918043996688 treat image : temp/1746016348_2445257_1354699655_3a7b7316efb626cc6cbb49b3d94af1ae.jpg resize: (1080, 1632) 1354699655 -5.198765346031774 treat image : temp/1746016348_2445257_1354699077_5d31794905d20debc2956cabce9e19fc.jpg resize: (1080, 1632) 1354699077 -4.949275503458654 treat image : temp/1746016348_2445257_1354699026_04f2cad2ea67e9d6df4f1970dc85297d.jpg resize: (1080, 1632) 1354699026 -3.6692343249479435 treat image : temp/1746016348_2445257_1354698954_2fd9f18ed4dd6c3858dc056e2b96060d.jpg resize: (1080, 1632) 1354698954 -5.225588226858925 treat image : temp/1746016348_2445257_1354698924_6d1a946f594785d7b3bf8d0201ca9b74.jpg resize: (1080, 1632) 1354698924 -5.298788994351438 treat image : temp/1746016348_2445257_1354698892_9f24dbd37f84594bc78a4c6c0f51f505.jpg resize: (1080, 1632) 1354698892 -5.805257052729309 treat image : temp/1746016348_2445257_1354697959_78393b00cd55b44405abdc5f992c0bb6.jpg resize: (1080, 1632) 1354697959 -5.511326690253552 treat image : temp/1746016348_2445257_1354697890_c7a996f18e119ddecec4a048cc5fe08f.jpg resize: (1080, 1632) 1354697890 -4.593728494334997 treat image : temp/1746016348_2445257_1354697865_8dc7f976910681c0f801753267106c0b.jpg resize: (1080, 1632) 1354697865 -5.082657871142021 treat image : temp/1746016348_2445257_1354697839_a7e540d68ab8c69f5e6cdceb8f60feb9.jpg resize: (1080, 1632) 1354697839 -4.1215855687155685 treat image : temp/1746016348_2445257_1354697809_52b80590fa1cce89cc24f309e83be024.jpg resize: (1080, 1632) 1354697809 -5.253201486207259 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 13 time used for this insertion : 0.012122154235839844 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 13 time used for this insertion : 0.013568639755249023 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.013983964920043945 save missing photos in datou_result : time spend for datou_step_exec : 9.53162932395935 time spend to save output : 0.04446005821228027 total time spend for step 1 : 9.57608938217163 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 13 set_done_treatment 9.66user 2.27system 0:14.20elapsed 83%CPU (0avgtext+0avgdata 140032maxresident)k 40inputs+6432outputs (9major+187324minor)pagefaults 0swaps