TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 1893>100 please execute split_portfolio.py -i 22700488 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2795252'] with mtr_portfolio_ids : ['22700488'] and first list_photo_ids : [] new path : /proc/1424022/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.244539976119995 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Tue May 6 18:22:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1746548549_1424022_1356379177_eef155ee0035cfc271027fb21ce6eab6.jpg resize: (1080, 1632) 1356379177 -5.115334510947934 treat image : temp/1746548549_1424022_1356379174_eea310ea0581b21e13821a82d934976e.jpg resize: (1080, 1632) 1356379174 -1.5244195095949127 treat image : temp/1746548549_1424022_1356379166_f9cf237daaaa551be9719921e373a72e.jpg resize: (1080, 1632) 1356379166 -4.569477505266142 treat image : temp/1746548549_1424022_1356379159_0714f8a6a64914d1e4bcd329ccb652d9.jpg resize: (1080, 1632) 1356379159 -4.70878350296892 treat image : temp/1746548549_1424022_1356379155_f4538cabcef184eeaa0e3ebab33bfd1a.jpg resize: (1080, 1632) 1356379155 -4.473094807732466 treat image : temp/1746548549_1424022_1356379149_ad41459c60316b309423ee561f9f78ac.jpg resize: (1080, 1632) 1356379149 -3.206860524043888 treat image : temp/1746548549_1424022_1356379133_38e908a6fc4647d2c0da620fcc3d9f1c.jpg resize: (1080, 1632) 1356379133 -5.939504878761917 treat image : temp/1746548549_1424022_1356379130_959aec19c8b35f6830e8ebc800c5ffa4.jpg resize: (1080, 1632) 1356379130 -5.621819243459576 treat image : temp/1746548549_1424022_1356379126_623648f689ae4f3b31c6b8acf6ee8af8.jpg resize: (1080, 1632) 1356379126 -6.326640082530913 treat image : temp/1746548549_1424022_1356379121_c8d5cca61454ed712aa022f4d244261b.jpg resize: (1080, 1632) 1356379121 -3.3895555032259743 treat image : temp/1746548549_1424022_1356379116_12d9a9f2e0edd7daf7d222f1e115b2dc.jpg resize: (1080, 1632) 1356379116 -1.8914864988187907 treat image : temp/1746548549_1424022_1356379109_5f25ac27f3d28596d9e4947abe4205d7.jpg resize: (1080, 1632) 1356379109 -2.6630613528283678 treat image : temp/1746548549_1424022_1356378952_e369aeabbcc174c54b037f632ca7ff38.jpg resize: (1080, 1632) 1356378952 -6.161946080888665 treat image : temp/1746548549_1424022_1356378947_e1b6f77e47f30e603aac7bf82ff4168b.jpg resize: (1080, 1632) 1356378947 -5.636596625515996 treat image : temp/1746548549_1424022_1356378931_f1203c3ab4277e784ee04a08bc855391.jpg resize: (1080, 1632) 1356378931 -5.8308730245932265 treat image : temp/1746548549_1424022_1356378922_f0f28229af5ef63105eabca2fca9c895.jpg resize: (1080, 1632) 1356378922 -1.35873162870197 treat image : temp/1746548549_1424022_1356378807_11eb203aa10164f746af5c7773aa2654.jpg resize: (1080, 1632) 1356378807 -4.031779061898867 treat image : temp/1746548549_1424022_1356378800_fcf7637688d6bf8fb28bdac862dd4286.jpg resize: (1080, 1632) 1356378800 -6.186518446125254 treat image : temp/1746548549_1424022_1356378797_a4cad8efda8a045f6a1d95caf6901d0d.jpg resize: (1080, 1632) 1356378797 -6.321009022631765 treat image : temp/1746548549_1424022_1356378792_6bffc27121061447ab4fbc7c772449f2.jpg resize: (1080, 1632) 1356378792 -6.193202159726194 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.014196395874023438 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.013707876205444336 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.014700889587402344 save missing photos in datou_result : time spend for datou_step_exec : 18.143859148025513 time spend to save output : 0.047502756118774414 total time spend for step 1 : 18.191361904144287 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 15.26user 5.36system 0:24.16elapsed 85%CPU (0avgtext+0avgdata 142144maxresident)k 384inputs+10352outputs (7major+259887minor)pagefaults 0swaps