TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 2067>100 please execute split_portfolio.py -i 22151579 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2733389'] with mtr_portfolio_ids : ['22151579'] and first list_photo_ids : [] new path : /proc/854378/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 3.0485928058624268 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Wed Apr 9 11:57:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1744192649_854378_1350676604_6169e7a924bbe8cdee53131206f7a931.jpg resize: (1080, 1632) 1350676604 -4.79093246082711 treat image : temp/1744192649_854378_1350676586_0aab50c9c57f5924ee2e7f24a0f05027.jpg resize: (1080, 1632) 1350676586 -5.112991392292412 treat image : temp/1744192649_854378_1350676584_6f8c5c09abc112390245549a8f9532c3.jpg resize: (1080, 1632) 1350676584 -4.142819665984606 treat image : temp/1744192649_854378_1350676580_bdc0b59e5fd919db338f8016d943a1e3.jpg resize: (1080, 1632) 1350676580 -5.361958400168434 treat image : temp/1744192649_854378_1350676576_059d971b5638b691f24071b9e73e5cff.jpg resize: (1080, 1632) 1350676576 -6.036666928615857 treat image : temp/1744192649_854378_1350676567_06f7c462ae471c90f83fd67c05fc346e.jpg resize: (1080, 1632) 1350676567 -4.297983004401328 treat image : temp/1744192649_854378_1350676562_b5bc81b2297a278009ea1337e598f9dc.jpg resize: (1080, 1632) 1350676562 -5.589743474255875 treat image : temp/1744192649_854378_1350676558_4eed30303cbf9e395f82896755f2a30e.jpg resize: (1080, 1632) 1350676558 -4.4604360489032615 treat image : temp/1744192649_854378_1350676553_5c4b5f47e84a8c5384eec098344434e7.jpg resize: (1080, 1632) 1350676553 -5.606233558586044 treat image : temp/1744192649_854378_1350676548_f7d54ab7f5a723e529d7ca3659ddfec3.jpg resize: (1080, 1632) 1350676548 -5.747402580500724 treat image : temp/1744192649_854378_1350676546_5b600733f4af8ba069d387278e578786.jpg resize: (1080, 1632) 1350676546 -5.634054246245229 treat image : temp/1744192649_854378_1350676518_15882862c76004440871bc87a3be0011.jpg resize: (1080, 1632) 1350676518 -5.27531552083116 treat image : temp/1744192649_854378_1350676465_aeaa580e01b7f796f5b5b65772ca45d1.jpg resize: (1080, 1632) 1350676465 -5.282275729969659 treat image : temp/1744192649_854378_1350676443_93615c9917fc4833f79276632cd18895.jpg resize: (1080, 1632) 1350676443 -1.9448604706811423 treat image : temp/1744192649_854378_1350676438_736599598db0fed2c4788eb3f26bfe0e.jpg resize: (1080, 1632) 1350676438 -4.078644604286325 treat image : temp/1744192649_854378_1350676436_b46da9345655972ac4cff413d6e33eeb.jpg resize: (1080, 1632) 1350676436 -5.055917329564744 treat image : temp/1744192649_854378_1350676432_5c0e1a51e9be965cbe91a1ccc37a90bd.jpg resize: (1080, 1632) 1350676432 -5.550917608545245 treat image : temp/1744192649_854378_1350676418_47e1df337dfbee73698148ebc15f8bcb.jpg resize: (1080, 1632) 1350676418 -6.359393186836943 treat image : temp/1744192649_854378_1350676416_59667aac33ef52beaa7e0f2ba25c7328.jpg resize: (1080, 1632) 1350676416 -5.462540831115787 treat image : temp/1744192649_854378_1350676413_fb5ee17fdc531b9f04cfe13c704b2e30.jpg resize: (1080, 1632) 1350676413 -5.186164637361371 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.013012886047363281 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.014590978622436523 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.015066146850585938 save missing photos in datou_result : time spend for datou_step_exec : 15.34607458114624 time spend to save output : 0.04788923263549805 total time spend for step 1 : 15.393963813781738 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.82user 3.62system 0:22.87elapsed 80%CPU (0avgtext+0avgdata 137092maxresident)k 32inputs+10112outputs (0major+259500minor)pagefaults 0swaps