TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 479>100 please execute split_portfolio.py -i 22055303 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2723927'] with mtr_portfolio_ids : ['22055303'] and first list_photo_ids : [] new path : /proc/3389270/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 16 ; length of list_pids : 16 ; length of list_args : 16 time to download the photos : 1.8274145126342773 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Wed Apr 16 07:02:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1744779746_3389270_1350171897_c0e8a377a7fef1755e8ed6f982b81b99.jpg resize: (1080, 1632) 1350171897 -4.591898263331128 treat image : temp/1744779746_3389270_1350171854_7d06c7e9b9722c986564ee5e60ea3f7f.jpg resize: (1080, 1632) 1350171854 -5.465766211343221 treat image : temp/1744779746_3389270_1350171809_8002d81d05f8ba772c4b3372ec7d4383.jpg resize: (1080, 1632) 1350171809 -3.5328271018562662 treat image : temp/1744779746_3389270_1350171764_e5b0b44b87df23f3e75bc2c2459752e9.jpg resize: (1080, 1632) 1350171764 -3.5173129348518652 treat image : temp/1744779746_3389270_1350171707_fbdeff2eb74cc96c1fd7250173a26f06.jpg resize: (1080, 1632) 1350171707 -1.6913249182195527 treat image : temp/1744779746_3389270_1350171610_3d648cba35f0ec166d892b0bbf0f1b45.jpg resize: (1080, 1632) 1350171610 -2.8191736808026455 treat image : temp/1744779746_3389270_1350171577_66b90d932f29b4a89d089a0adb019dfb.jpg resize: (1080, 1632) 1350171577 -3.1197826120635663 treat image : temp/1744779746_3389270_1350171547_0959dcaa3ca62bd608d6c8ac7b6ad995.jpg resize: (1080, 1632) 1350171547 -3.368885681254086 treat image : temp/1744779746_3389270_1350171518_ef040c2a4295b0e342dfc6a149db73f2.jpg resize: (1080, 1632) 1350171518 -5.255938147013434 treat image : temp/1744779746_3389270_1350171496_62e2fbc4b0f0165018ba38b9abcafb30.jpg resize: (1080, 1632) 1350171496 -3.619452936482345 treat image : temp/1744779746_3389270_1350171417_657b0bf81639f9028d1a9422dfc7b9a2.jpg resize: (1080, 1632) 1350171417 -4.684238204633153 treat image : temp/1744779746_3389270_1350171381_9bb7997a6c94831cc932c2f65713dfab.jpg resize: (1080, 1632) 1350171381 -4.702979820076452 treat image : temp/1744779746_3389270_1350171346_33b7eb5effc4918a61cbb6e6f0bdda33.jpg resize: (1080, 1632) 1350171346 -6.020955603592979 treat image : temp/1744779746_3389270_1350171320_1d9aa729c5c547e3539abfb3eeb86fae.jpg resize: (1080, 1632) 1350171320 -5.798889457474734 treat image : temp/1744779746_3389270_1350171291_be2f8ccd031ebda5408ab0ef93421193.jpg resize: (1080, 1632) 1350171291 -4.892963782174087 treat image : temp/1744779746_3389270_1350171264_20eafec21927216e01a8fea6d98720bc.jpg resize: (1080, 1632) 1350171264 -5.743906226761173 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 16 time used for this insertion : 0.011709213256835938 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 16 time used for this insertion : 0.011983871459960938 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.19597291946411133 save missing photos in datou_result : time spend for datou_step_exec : 16.226896286010742 time spend to save output : 0.22459697723388672 total time spend for step 1 : 16.45149326324463 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 16 set_done_treatment 12.32user 6.21system 0:19.96elapsed 92%CPU (0avgtext+0avgdata 139604maxresident)k 3864inputs+7584outputs (24major+229960minor)pagefaults 0swaps