TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 2556>100 please execute split_portfolio.py -i 21602882 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2681004'] with mtr_portfolio_ids : ['21602882'] and first list_photo_ids : [] new path : /proc/3631442/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.14308762550354 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Sat Mar 22 04:47:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1742615247_3631442_1346334851_d9f1ddafa80aeb705e9fc3c6b96a0c9f.jpg resize: (1080, 1632) 1346334851 -6.45535001323797 treat image : temp/1742615247_3631442_1346334848_851a1eac048e8da39d603e47cea4e5df.jpg resize: (1080, 1632) 1346334848 -6.370056552878842 treat image : temp/1742615247_3631442_1346334845_814155bad6d1c66f507e40c77bac757d.jpg resize: (1080, 1632) 1346334845 -5.945146042102944 treat image : temp/1742615247_3631442_1346334841_48bfd1182fc0aec2a34d5e978919bbe6.jpg resize: (1080, 1632) 1346334841 -6.247284569676024 treat image : temp/1742615247_3631442_1346334838_ef5c67299af3301529027d1e639cf44a.jpg resize: (1080, 1632) 1346334838 -6.696330370072515 treat image : temp/1742615247_3631442_1346334835_f7c3602db1b69d87dff492585cb8505f.jpg resize: (1080, 1632) 1346334835 -6.3040047136405635 treat image : temp/1742615247_3631442_1346334825_0b68b2ef4d1ec18bc35adb022c0d2643.jpg resize: (1080, 1632) 1346334825 -6.899568940162308 treat image : temp/1742615247_3631442_1346334822_7cd4f1acaa0da1aaff05c9e07b5d19f4.jpg resize: (1080, 1632) 1346334822 -6.64612012459531 treat image : temp/1742615247_3631442_1346334819_e7b37548b79ed231fb7cbd8a08cd22dd.jpg resize: (1080, 1632) 1346334819 -6.57469784531946 treat image : temp/1742615247_3631442_1346334816_9dfab4a67a574db027787d939b4b0e35.jpg resize: (1080, 1632) 1346334816 -5.957104381450066 treat image : temp/1742615247_3631442_1346334813_9d018d3d2ed020c28b6d82343b59bd14.jpg resize: (1080, 1632) 1346334813 -6.191577239625072 treat image : temp/1742615247_3631442_1346334811_0d43f9330073a0bc840c928dc0249128.jpg resize: (1080, 1632) 1346334811 -3.6442751536719618 treat image : temp/1742615247_3631442_1346334803_f2517579c0bef130ae4a676148b94133.jpg resize: (1080, 1632) 1346334803 -2.7038904541218276 treat image : temp/1742615247_3631442_1346334799_fc7a994832360c6c2c7b9e5ebed6e233.jpg resize: (1080, 1632) 1346334799 -0.1539097091189242 treat image : temp/1742615247_3631442_1346334794_7413408a2c1d08058203438f61c8e1b5.jpg resize: (1080, 1632) 1346334794 -5.660176245411569 treat image : temp/1742615247_3631442_1346334789_c30558d98385265147fac38b35f5ea47.jpg resize: (1080, 1632) 1346334789 -5.750671758755656 treat image : temp/1742615247_3631442_1346334787_76602fa9e810aaed730a2a53d56a8924.jpg resize: (1080, 1632) 1346334787 -5.289790421654027 treat image : temp/1742615247_3631442_1346334782_2c8c7b94ee5e75117efc778ed3810ad5.jpg resize: (1080, 1632) 1346334782 -4.852038744958182 treat image : temp/1742615247_3631442_1346334229_95152bbd4c9faaf8a6aeab88f7a57ff0.jpg resize: (1080, 1632) 1346334229 -6.1487261714572545 treat image : temp/1742615247_3631442_1346334160_bdafb6b4f066fa890722f10e9783d9b3.jpg resize: (1080, 1632) 1346334160 -2.3813106461243065 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.015738964080810547 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.4240107536315918 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.046000003814697266 save missing photos in datou_result : time spend for datou_step_exec : 15.051146030426025 time spend to save output : 0.4908559322357178 total time spend for step 1 : 15.542001962661743 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.17user 3.72system 0:20.20elapsed 88%CPU (0avgtext+0avgdata 137688maxresident)k 88inputs+11416outputs (5major+256263minor)pagefaults 0swaps