TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 4791>100 please execute split_portfolio.py -i 19382293 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2460022'] with mtr_portfolio_ids : ['19382293'] and first list_photo_ids : [] new path : /proc/3249205/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 3.1622941493988037 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Tue Mar 25 19:57:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1742929050_3249205_1333524011_21d71fbe897029a491f6d54d0c45c917.jpg resize: (1080, 1632) 1333524011 1.9041485907300442 treat image : temp/1742929050_3249205_1333523940_db39630d882a173381a92620ecc8f696.jpg resize: (1080, 1632) 1333523940 2.6429638908565503 treat image : temp/1742929050_3249205_1333523870_339612d0fbd4ba0691275a412f9afc15.jpg resize: (1080, 1632) 1333523870 2.5834951619261917 treat image : temp/1742929050_3249205_1333523768_b8dd6b9c5fbbac5cf3f4bd91a5d70f7e.jpg resize: (1080, 1632) 1333523768 1.9796214685690134 treat image : temp/1742929050_3249205_1333523656_2940651ab128a5461b9abef0fc1f0923.jpg resize: (1080, 1632) 1333523656 0.5651388337125622 treat image : temp/1742929050_3249205_1333523501_5c7e5f9a4e87f163d87746419d1b4e58.jpg resize: (1080, 1632) 1333523501 0.36415676147784687 treat image : temp/1742929050_3249205_1333523439_048267f2101f02232e69987e483cfd7b.jpg resize: (1080, 1632) 1333523439 1.3935072587719504 treat image : temp/1742929050_3249205_1333523364_a2e1a2790042e4f5db5be59299011879.jpg resize: (1080, 1632) 1333523364 2.150282147915925 treat image : temp/1742929050_3249205_1333523295_2ecefdf93740d10f55757dd1a0e98129.jpg resize: (1080, 1632) 1333523295 0.657062790027855 treat image : temp/1742929050_3249205_1333522778_dc98bdc3c78edf217410691dd119b75d.jpg resize: (1080, 1632) 1333522778 2.644924922647465 treat image : temp/1742929050_3249205_1333522739_207e6c83d04ba1ef35f1eab54ea81afb.jpg resize: (1080, 1632) 1333522739 3.1208959122766458 treat image : temp/1742929050_3249205_1333522654_c7d054611fe474910f768e59b6bdd497.jpg resize: (1080, 1632) 1333522654 5.020137014586876 treat image : temp/1742929050_3249205_1333522535_0c87f8323ffe3b9616256ef2a22ff340.jpg resize: (1080, 1632) 1333522535 3.349097701593911 treat image : temp/1742929050_3249205_1333522398_99f13d7422b49a7b1a46061800328d57.jpg resize: (1080, 1632) 1333522398 2.977294181655529 treat image : temp/1742929050_3249205_1333522304_d3599bad452fee9597b9945be06844ff.jpg resize: (1080, 1632) 1333522304 0.6950978004809134 treat image : temp/1742929050_3249205_1333520858_00486adbc6dc1d6abae3ce8f2dbabc71.jpg resize: (1080, 1632) 1333520858 3.3445546487258606 treat image : temp/1742929050_3249205_1333520857_c1d102aabb88b8b7cb6a7c98857e418a.jpg resize: (1080, 1632) 1333520857 2.7514033457128173 treat image : temp/1742929050_3249205_1333520856_47b1bf0561d0a7384709fc3e53486b72.jpg resize: (1080, 1632) 1333520856 2.2246975394960984 treat image : temp/1742929050_3249205_1333520855_9ff1e459522abdf72906bca86a14366e.jpg resize: (1080, 1632) 1333520855 0.08757303167666607 treat image : temp/1742929050_3249205_1333520853_cf0ce6c41aeea4f2654b07267ea8520e.jpg resize: (1080, 1632) 1333520853 1.3257337690041968 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.012758493423461914 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.2520589828491211 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.015932083129882812 save missing photos in datou_result : time spend for datou_step_exec : 14.97817873954773 time spend to save output : 0.2859506607055664 total time spend for step 1 : 15.264129400253296 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 13.64user 3.73system 0:22.43elapsed 77%CPU (0avgtext+0avgdata 138992maxresident)k 136inputs+3544outputs (0major+234443minor)pagefaults 0swaps