TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 1721>100 please execute split_portfolio.py -i 22870033 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2818969'] with mtr_portfolio_ids : ['22870033'] and first list_photo_ids : [] new path : /proc/2485425/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.287928581237793 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Mon May 12 14:27:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1747052849_2485425_1357642058_03bcc1d6dff574c4537bd18ebf3de031.jpg resize: (1080, 1632) 1357642058 -3.4659240865926866 treat image : temp/1747052849_2485425_1357641962_f0dec2d1fbe9eac9813ed739ea8c967a.jpg resize: (1080, 1632) 1357641962 -3.6693664887193096 treat image : temp/1747052849_2485425_1357641959_67342fea1f38e28789347f2c92901026.jpg resize: (1080, 1632) 1357641959 -1.1120030497959756 treat image : temp/1747052849_2485425_1357641957_14923e5af9153a9ef74c6c01f04e86cb.jpg resize: (1080, 1632) 1357641957 -3.0196253289272463 treat image : temp/1747052849_2485425_1357641954_5aad5e0d8b6383c68fc8d63889e8328e.jpg resize: (1080, 1632) 1357641954 -6.0771882135603965 treat image : temp/1747052849_2485425_1357641887_ce24999298936909187cc5ae25c311e3.jpg resize: (1080, 1632) 1357641887 -5.877277537598039 treat image : temp/1747052849_2485425_1357641883_b17f6a24a910e68709e5d2c0a0a617ce.jpg resize: (1080, 1632) 1357641883 -5.813248864415669 treat image : temp/1747052849_2485425_1357641865_25cb68504b1397c040a88d8cda7aad71.jpg resize: (1080, 1632) 1357641865 -5.986518020343963 treat image : temp/1747052849_2485425_1357641860_542a9ee550ed52e3f3e954f38b1f94f7.jpg resize: (1080, 1632) 1357641860 -5.964198433231684 treat image : temp/1747052849_2485425_1357641827_45759f7e0aa48f2d826cc075e6cdf5d3.jpg resize: (1080, 1632) 1357641827 -1.6995476231284694 treat image : temp/1747052849_2485425_1357641824_888b672e39d06f5791a74dac09421237.jpg resize: (1080, 1632) 1357641824 -4.628343891838583 treat image : temp/1747052849_2485425_1357641821_1c1ad7db0ae01c5b2d66acadd769b9ea.jpg resize: (1080, 1632) 1357641821 -6.32880662877201 treat image : temp/1747052849_2485425_1357641819_07caeb940b88e17e3b3f8c4a9939d47d.jpg resize: (1080, 1632) 1357641819 -6.338502977653747 treat image : temp/1747052849_2485425_1357641817_9ce8a48b83eb9db60ccdc1f8907e70aa.jpg resize: (1080, 1632) 1357641817 -6.045085324512556 treat image : temp/1747052849_2485425_1357641813_934493ce5f12c946e6bc5628b9cf0e9c.jpg resize: (1080, 1632) 1357641813 -5.9898583190017085 treat image : temp/1747052849_2485425_1357641767_eea15b11f89a5a244abffa0385bcab3b.jpg resize: (1080, 1632) 1357641767 -5.931940256647912 treat image : temp/1747052849_2485425_1357641763_fc75f72db9a50a03a168a6ace0c2a7ad.jpg resize: (1080, 1632) 1357641763 -5.955415522730338 treat image : temp/1747052849_2485425_1357641759_6a3304ce970a0601a3ddaa61be64fcb4.jpg resize: (1080, 1632) 1357641759 -2.0405498618970066 treat image : temp/1747052849_2485425_1357641666_b84e7f685ff7b0a8ed2ce9d124793dc2.jpg resize: (1080, 1632) 1357641666 -6.519967917403976 treat image : temp/1747052849_2485425_1357641640_877fd47e83e02919729e2f77147eefa0.jpg resize: (1080, 1632) 1357641640 -2.9753319751463168 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.01780867576599121 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.017919063568115234 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.01784372329711914 save missing photos in datou_result : time spend for datou_step_exec : 17.749603271484375 time spend to save output : 0.05800271034240723 total time spend for step 1 : 17.807605981826782 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 15.07user 5.06system 0:24.25elapsed 83%CPU (0avgtext+0avgdata 140072maxresident)k 128inputs+10576outputs (19major+251004minor)pagefaults 0swaps