TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 1206>100 please execute split_portfolio.py -i 21602882 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2681004'] with mtr_portfolio_ids : ['21602882'] and first list_photo_ids : [] new path : /proc/3009066/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.1497507095336914 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Sat Mar 22 02:37:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1742607449_3009066_1346318476_05e8209ddc7eb4c7a3630eb713680d48.jpg resize: (1080, 1632) 1346318476 -6.410472794432143 treat image : temp/1742607449_3009066_1346318472_aa8e3ba330e8daca0b6f9c8e952284dd.jpg resize: (1080, 1632) 1346318472 -5.915375887593592 treat image : temp/1742607449_3009066_1346318469_7a003876c0b230a75d6fa126ac253f6e.jpg resize: (1080, 1632) 1346318469 -5.21447378908168 treat image : temp/1742607449_3009066_1346318465_7210677b0135b062abcdd17714718509.jpg resize: (1080, 1632) 1346318465 -2.1507254994289258 treat image : temp/1742607449_3009066_1346318461_42914abe063433900975ee25d94da183.jpg resize: (1080, 1632) 1346318461 -5.404314744656303 treat image : temp/1742607449_3009066_1346318456_d5c3d51457b47dd684aa01114c389891.jpg resize: (1080, 1632) 1346318456 -6.178915897288987 treat image : temp/1742607449_3009066_1346318448_6a92640eca98bdb442079ad888662ad2.jpg resize: (1080, 1632) 1346318448 -6.402581003656131 treat image : temp/1742607449_3009066_1346318446_828c108f0a4a2efeb3b418f3e90426a6.jpg resize: (1080, 1632) 1346318446 -4.899775277774227 treat image : temp/1742607449_3009066_1346318443_e49b611fb6df18560f0b108ef0c26817.jpg resize: (1080, 1632) 1346318443 -6.064340519137106 treat image : temp/1742607449_3009066_1346318440_9aa319865bf4fab7d396e13e538793df.jpg resize: (1080, 1632) 1346318440 -4.835273066113788 treat image : temp/1742607449_3009066_1346318437_da1d9968b09d71e23b3309f7f274f2e3.jpg resize: (1080, 1632) 1346318437 -4.4900306935279115 treat image : temp/1742607449_3009066_1346318434_97438dff586de941221fcbf14bb705fd.jpg resize: (1080, 1632) 1346318434 -5.4046167768326905 treat image : temp/1742607449_3009066_1346318410_5e397b331b2f8e5f146b5c2710b77e67.jpg resize: (1080, 1632) 1346318410 -6.592339021866731 treat image : temp/1742607449_3009066_1346318405_41e37bf8b47e6db15ddba372433556a5.jpg resize: (1080, 1632) 1346318405 -6.212525006599806 treat image : temp/1742607449_3009066_1346318399_8354cc4e49d813e45d5c48c98936ab94.jpg resize: (1080, 1632) 1346318399 -2.272610977674122 treat image : temp/1742607449_3009066_1346318396_fe72ecdb34838c4907863b7eb7f53b1f.jpg resize: (1080, 1632) 1346318396 -2.676271387148591 treat image : temp/1742607449_3009066_1346318394_a27e490dd3f9f365e8cb459ab309258b.jpg resize: (1080, 1632) 1346318394 -3.1823244407738174 treat image : temp/1742607449_3009066_1346318391_16ceb6d5bd439023ac03b91e0b3e550d.jpg resize: (1080, 1632) 1346318391 -2.303285014739965 treat image : temp/1742607449_3009066_1346318259_5b6d50d63134dc2765c464e47e4add92.jpg resize: (1080, 1632) 1346318259 -5.549398597946679 treat image : temp/1742607449_3009066_1346318254_b2b267ca263a4f115d8e5f62af629d39.jpg resize: (1080, 1632) 1346318254 -3.767902766191428 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.013334512710571289 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.01385951042175293 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.01872873306274414 save missing photos in datou_result : time spend for datou_step_exec : 15.400270223617554 time spend to save output : 0.2851736545562744 total time spend for step 1 : 15.685443878173828 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.56user 3.75system 0:21.63elapsed 84%CPU (0avgtext+0avgdata 140644maxresident)k 8560inputs+10824outputs (35major+260529minor)pagefaults 0swaps