TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 3335>100 please execute split_portfolio.py -i 21605229 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2681618'] with mtr_portfolio_ids : ['21605229'] and first list_photo_ids : [] new path : /proc/765852/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.1331381797790527 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Sat Mar 22 11:42:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1742640148_765852_1346395783_35e5a55b9e674d57c948a270c310e43d.jpg resize: (1080, 1632) 1346395783 -4.160646239546563 treat image : temp/1742640148_765852_1346395752_2884c18e55bb6ec926671f32112b93e6.jpg resize: (1080, 1632) 1346395752 -2.2255383356893943 treat image : temp/1742640148_765852_1346395744_c8df40968475682fed42f731688c4ae3.jpg resize: (1080, 1632) 1346395744 -3.4998798329095293 treat image : temp/1742640148_765852_1346395742_a75f074674c1c9f0bd335438a9fdf2a5.jpg resize: (1080, 1632) 1346395742 -3.346067550071997 treat image : temp/1742640148_765852_1346395740_6c6cd5734b5c2a4f0e3b4a657b7d386b.jpg resize: (1080, 1632) 1346395740 -3.7587275450091795 treat image : temp/1742640148_765852_1346395730_1ff32019655673b53e3092d4291ce1bd.jpg resize: (1080, 1632) 1346395730 -4.182200255171801 treat image : temp/1742640148_765852_1346395727_d7b55d6135fed9d59f07195129813735.jpg resize: (1080, 1632) 1346395727 -5.934346202329167 treat image : temp/1742640148_765852_1346395684_3345ffb07f47be087b0e8be1251c453d.jpg resize: (1080, 1632) 1346395684 -6.08782293279905 treat image : temp/1742640148_765852_1346395663_a8687d629b2b369f6fe0720c908508e4.jpg resize: (1080, 1632) 1346395663 -6.208160141605337 treat image : temp/1742640148_765852_1346395652_672e5e8f5a0d26221754933812ab3b53.jpg resize: (1080, 1632) 1346395652 -6.178437866432327 treat image : temp/1742640148_765852_1346395623_39dcd7b5edbb72f2e9a05887d360ff99.jpg resize: (1080, 1632) 1346395623 -6.460985801365708 treat image : temp/1742640148_765852_1346395569_113a4c9624b76dcbf7d30c93f2f91c23.jpg resize: (1080, 1632) 1346395569 -6.4942734065080066 treat image : temp/1742640148_765852_1346395567_e63b78e5536352a5881932155c31c870.jpg resize: (1080, 1632) 1346395567 -3.2890432881929206 treat image : temp/1742640148_765852_1346395563_3f451290dd30282c4d250782ae2708e6.jpg resize: (1080, 1632) 1346395563 -6.195417809105704 treat image : temp/1742640148_765852_1346395561_7a971ee2ef7f5592be931b1b4bcc7ad3.jpg resize: (1080, 1632) 1346395561 -6.137045970877004 treat image : temp/1742640148_765852_1346395559_d849f094c1ae806598d3178ec960ced4.jpg resize: (1080, 1632) 1346395559 -6.174005002763677 treat image : temp/1742640148_765852_1346395557_9c75ff98c60f2de9159f6b93ce0f8d8c.jpg resize: (1080, 1632) 1346395557 -6.198271325771727 treat image : temp/1742640148_765852_1346395552_168811ad3c3c0717c165f69b9985f8cc.jpg resize: (1080, 1632) 1346395552 -6.156779075280713 treat image : temp/1742640148_765852_1346395548_472c429a062e8123fdb09acd04c3c7d6.jpg resize: (1080, 1632) 1346395548 -5.525765397223482 treat image : temp/1742640148_765852_1346395541_cfb61e01c85919aed3d11c970d3719d1.jpg resize: (1080, 1632) 1346395541 -5.534275090944638 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.014009952545166016 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.012776374816894531 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.015027284622192383 save missing photos in datou_result : time spend for datou_step_exec : 14.348688125610352 time spend to save output : 0.04636812210083008 total time spend for step 1 : 14.395056247711182 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.11user 2.98system 0:19.78elapsed 86%CPU (0avgtext+0avgdata 138760maxresident)k 72inputs+10784outputs (13major+256832minor)pagefaults 0swaps