TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 3329>100 please execute split_portfolio.py -i 21995993 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2718254'] with mtr_portfolio_ids : ['21995993'] and first list_photo_ids : [] new path : /proc/4163631/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.4149258136749268 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Thu Apr 3 18:02:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1743696150_4163631_1349831997_b451d88ba911a0b152416d48161c83fc.jpg resize: (1080, 1632) 1349831997 -4.758729721873399 treat image : temp/1743696150_4163631_1349831992_3461bf54060cdd3c62957eb3d07f1948.jpg resize: (1080, 1632) 1349831992 -5.723861277196282 treat image : temp/1743696150_4163631_1349831987_a35a80949415bbcbcf58e7763cc79c1b.jpg resize: (1080, 1632) 1349831987 -5.401164891225628 treat image : temp/1743696150_4163631_1349831980_3731d0340a49b79e08ed38b35f05a6b4.jpg resize: (1080, 1632) 1349831980 -5.855533235055916 treat image : temp/1743696150_4163631_1349831974_f270b19d4040ac5d93fc51ddfab80237.jpg resize: (1080, 1632) 1349831974 -4.027545794837851 treat image : temp/1743696150_4163631_1349831967_ebf433f72acd5195d1a843494e10faed.jpg resize: (1080, 1632) 1349831967 -1.3258681606901097 treat image : temp/1743696150_4163631_1349831902_e6725966f8ef4e6effd080bf29bf5b9d.jpg resize: (1080, 1632) 1349831902 -2.7369364128373053 treat image : temp/1743696150_4163631_1349831880_f7d3bcefc1e636c3e8dc1c35f99c5c6a.jpg resize: (1080, 1632) 1349831880 -3.707199893207432 treat image : temp/1743696150_4163631_1349831854_b0fc1f0bca3d8e1d51bdf82f4832b037.jpg resize: (1080, 1632) 1349831854 -4.548699366240907 treat image : temp/1743696150_4163631_1349831838_1ba3093657d9bb82eb434a652a32704e.jpg resize: (1080, 1632) 1349831838 -5.50238719616904 treat image : temp/1743696150_4163631_1349831832_dbde9fcca44c635dcb6858463322cb4b.jpg resize: (1080, 1632) 1349831832 -5.745938309642565 treat image : temp/1743696150_4163631_1349831814_bb4a2ff616dc4eb570168c9e53bfba5c.jpg resize: (1080, 1632) 1349831814 -5.244274451119871 treat image : temp/1743696150_4163631_1349831756_f89724bb566072d25ca9651778dedc70.jpg resize: (1080, 1632) 1349831756 -4.912383064079999 treat image : temp/1743696150_4163631_1349831746_578e194da17ab4a8888ae0e2433027ca.jpg resize: (1080, 1632) 1349831746 -4.958367529239483 treat image : temp/1743696150_4163631_1349831736_cebfe60830c047990e17f19a28a6db58.jpg resize: (1080, 1632) 1349831736 -3.916888350234019 treat image : temp/1743696150_4163631_1349831713_bea456d2ba8f149d242e8eb2a1bf84bd.jpg resize: (1080, 1632) 1349831713 -5.7963999979864385 treat image : temp/1743696150_4163631_1349831699_b965202c40dc1ea794dbae495d63850f.jpg resize: (1080, 1632) 1349831699 -4.213398485125717 treat image : temp/1743696150_4163631_1349831676_77f4f9df2bca924724ae5a0d27f26653.jpg resize: (1080, 1632) 1349831676 -5.761152011913091 treat image : temp/1743696150_4163631_1349827838_2b352f0e959d4c665aafb28266db13ed.jpg resize: (1080, 1632) 1349827838 -4.789719533491459 treat image : temp/1743696150_4163631_1349827801_41fc2dec6568630d7b49fcb102612875.jpg resize: (1080, 1632) 1349827801 -6.080850637410507 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.04161190986633301 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.04216194152832031 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.1322789192199707 save missing photos in datou_result : time spend for datou_step_exec : 17.347184419631958 time spend to save output : 0.33281707763671875 total time spend for step 1 : 17.680001497268677 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 15.43user 4.27system 0:24.17elapsed 81%CPU (0avgtext+0avgdata 141972maxresident)k 6272inputs+9976outputs (53major+257504minor)pagefaults 0swaps