TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 2868>100 please execute split_portfolio.py -i 21608215 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2682218'] with mtr_portfolio_ids : ['21608215'] and first list_photo_ids : [] new path : /proc/1537128/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 1.999917984008789 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Sat Mar 22 16:07:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1742656048_1537128_1346447937_501209874a3e0342615bde1fb00e4f17.jpg resize: (1080, 1632) 1346447937 -6.2825754579848665 treat image : temp/1742656048_1537128_1346447924_637b1f19977f46ab402b265ca3d1539f.jpg resize: (1080, 1632) 1346447924 -5.888198618436437 treat image : temp/1742656048_1537128_1346447918_784a102a4acd968fdfcc1097c83561d1.jpg resize: (1080, 1632) 1346447918 -5.496483847085273 treat image : temp/1742656048_1537128_1346447913_4b64d96da90ad9245721c34923f4a8ed.jpg resize: (1080, 1632) 1346447913 -4.301882069898631 treat image : temp/1742656048_1537128_1346447911_cd0aeb4b7b1370681716454ff37cf34e.jpg resize: (1080, 1632) 1346447911 -2.5177504691089188 treat image : temp/1742656048_1537128_1346447908_11fd9300b7ca9dfed232eeea85f85235.jpg resize: (1080, 1632) 1346447908 -2.99595140226002 treat image : temp/1742656048_1537128_1346447896_da38082b9e8331a306a9eb8e4b612a33.jpg resize: (1080, 1632) 1346447896 -5.105107546467682 treat image : temp/1742656048_1537128_1346447868_f2babde55469e3c61ccbf4b1bef1523d.jpg resize: (1080, 1632) 1346447868 -5.951078883702413 treat image : temp/1742656048_1537128_1346447853_7d34506aaedfc95d8297d5270f65cd58.jpg resize: (1080, 1632) 1346447853 -6.281432851815901 treat image : temp/1742656048_1537128_1346447849_f37e49ca719b6585afdf255a924f5fc1.jpg resize: (1080, 1632) 1346447849 -6.05750961943944 treat image : temp/1742656048_1537128_1346447845_7e27ac7578fea187c0be7f4994b29f5a.jpg resize: (1080, 1632) 1346447845 -5.443506212583687 treat image : temp/1742656048_1537128_1346447818_3d12be3186bdbc86e92f8a7a7dc1e757.jpg resize: (1080, 1632) 1346447818 -4.489412598567046 treat image : temp/1742656048_1537128_1346447317_6cfd2a9ef6183ddec721a6e33b8f04fb.jpg resize: (1080, 1632) 1346447317 -3.258548812236698 treat image : temp/1742656048_1537128_1346447305_bacd55a55c5757eb2bd49bb0b764b355.jpg resize: (1080, 1632) 1346447305 -3.258548812236698 treat image : temp/1742656048_1537128_1346447285_833ff733482d09227d0c9beb0539710f.jpg resize: (1080, 1632) 1346447285 -6.122291804761002 treat image : temp/1742656048_1537128_1346447266_9a4e10881e41acfe82a8d513788266fc.jpg resize: (1080, 1632) 1346447266 -6.122291804761002 treat image : temp/1742656048_1537128_1346447095_9ecf766a6caf2861560a974b1514b166.jpg resize: (1080, 1632) 1346447095 -6.1766506050778425 treat image : temp/1742656048_1537128_1346447066_ae6a3b9eb6a4f7abd9c9127897fb1826.jpg resize: (1080, 1632) 1346447066 -5.3016648359217635 treat image : temp/1742656048_1537128_1346447038_f3be087a06be8a0f93fbe9c26e4585b3.jpg resize: (1080, 1632) 1346447038 -5.019357530311668 treat image : temp/1742656048_1537128_1346447011_babe254d0832dc3074186eeb8d9b4f1a.jpg resize: (1080, 1632) 1346447011 -6.245704681711326 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.01380300521850586 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.011857748031616211 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.015035629272460938 save missing photos in datou_result : time spend for datou_step_exec : 16.92376470565796 time spend to save output : 0.0455324649810791 total time spend for step 1 : 16.969297170639038 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.11user 5.35system 0:22.75elapsed 85%CPU (0avgtext+0avgdata 141804maxresident)k 0inputs+11008outputs (2major+195756minor)pagefaults 0swaps