python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3096114 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 2003>100 please execute split_portfolio.py -i 23183727 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2914480'] with mtr_portfolio_ids : ['23183727'] and first list_photo_ids : [] new path : /proc/3096114/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.428039312362671 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Wed May 21 15:07:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1747832848_3096114_1360043751_2b82ef65ab76cd9fff09ef901e9ebea6.jpg resize: (1080, 1632) 1360043751 -5.394197484592029 treat image : temp/1747832848_3096114_1360043747_f8ef03d2564177bbbb4f3710d2c4bbaa.jpg resize: (1080, 1632) 1360043747 -4.154267353625499 treat image : temp/1747832848_3096114_1360043741_75b56964ce65261356a811a6432b99fb.jpg resize: (1080, 1632) 1360043741 -5.761434469713214 treat image : temp/1747832848_3096114_1360043736_23710ec4272dfdba37aad2a94d1385d5.jpg resize: (1080, 1632) 1360043736 -3.3871977805481603 treat image : temp/1747832848_3096114_1360043712_b6ed6096ef5c77fe13c564c2d4606a8e.jpg resize: (1080, 1632) 1360043712 -6.744348324061429 treat image : temp/1747832848_3096114_1360043709_3ce94f68c5da951c6e1462308e7c5cef.jpg resize: (1080, 1632) 1360043709 -5.984069980969833 treat image : temp/1747832848_3096114_1360043706_b190d866537cba92d314eb33a8c29f93.jpg resize: (1080, 1632) 1360043706 -6.143253600482676 treat image : temp/1747832848_3096114_1360043701_03ec13410e7429408196ceefb27152b4.jpg resize: (1080, 1632) 1360043701 -6.2870065805439665 treat image : temp/1747832848_3096114_1360043694_680cc8cad160e16927dbd394a8407ed1.jpg resize: (1080, 1632) 1360043694 -2.972939363944811 treat image : temp/1747832848_3096114_1360043690_01e0a665848f20bbac5e1710209af4e1.jpg resize: (1080, 1632) 1360043690 -5.288715842936709 treat image : temp/1747832848_3096114_1360043660_e7abf967f33b180422a277d0e11d2a12.jpg resize: (1080, 1632) 1360043660 -5.279628018303463 treat image : temp/1747832848_3096114_1360043656_b0a5150979e57b763e3aa17e8e866b74.jpg resize: (1080, 1632) 1360043656 -1.3352515597317278 treat image : temp/1747832848_3096114_1360043653_1ce3637c37263a142c805b503769dc91.jpg resize: (1080, 1632) 1360043653 -4.714551246508807 treat image : temp/1747832848_3096114_1360043640_969843a337498946543eaf86aa79bdb4.jpg resize: (1080, 1632) 1360043640 -6.021292732030405 treat image : temp/1747832848_3096114_1360043636_085f89d653236aff7d53eb664378faa4.jpg resize: (1080, 1632) 1360043636 -5.752634826624564 treat image : temp/1747832848_3096114_1360043632_dba7c1174278e26827be8b8805a12aa2.jpg resize: (1080, 1632) 1360043632 -5.738149789895121 treat image : temp/1747832848_3096114_1360043626_4340b200030ac3298b9743fb42d31197.jpg resize: (1080, 1632) 1360043626 -5.314233998474948 treat image : temp/1747832848_3096114_1360043611_f27f326ddedb8458e77e1b2add0f59f5.jpg resize: (1080, 1632) 1360043611 -6.146658712089686 treat image : temp/1747832848_3096114_1360043608_c4c9207caf05850588d59c2c80d03da1.jpg resize: (1080, 1632) 1360043608 -5.627444507820211 treat image : temp/1747832848_3096114_1360043484_4635a62a02cd3457173e1f252f957a52.jpg resize: (1080, 1632) 1360043484 -5.412168007497502 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.014110565185546875 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.0136566162109375 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.015877246856689453 save missing photos in datou_result : time spend for datou_step_exec : 19.07983946800232 time spend to save output : 0.04887580871582031 total time spend for step 1 : 19.12871527671814 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 15.30user 7.04system 0:25.26elapsed 88%CPU (0avgtext+0avgdata 138664maxresident)k 2672inputs+10784outputs (21major+260289minor)pagefaults 0swaps