python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1321023 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 1016>100 please execute split_portfolio.py -i 23145313 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2900260'] with mtr_portfolio_ids : ['23145313'] and first list_photo_ids : [] new path : /proc/1321023/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.19506573677063 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Tue May 20 08:37:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1747723048_1321023_1359777370_d7826274bfa91da79509e88139d4a5aa.jpg resize: (1080, 1632) 1359777370 -2.9560162358895483 treat image : temp/1747723048_1321023_1359777367_14db3f95b6acbf1f7454d39d769a6952.jpg resize: (1080, 1632) 1359777367 -3.4817253107802366 treat image : temp/1747723048_1321023_1359777363_4d65b18c544a6b6c26ebcaf879b7eec1.jpg resize: (1080, 1632) 1359777363 -1.937484656653071 treat image : temp/1747723048_1321023_1359777358_816bbae6af43a9b663a1ed5de5ba6101.jpg resize: (1080, 1632) 1359777358 -0.9060385587164124 treat image : temp/1747723048_1321023_1359777355_60b354f5d34294aad241d3bcc724a528.jpg resize: (1080, 1632) 1359777355 -2.0706224670490996 treat image : temp/1747723048_1321023_1359777269_212a7df17e8473ddb1d3f960e01dc5e7.jpg resize: (1080, 1632) 1359777269 -2.264690093228371 treat image : temp/1747723048_1321023_1359777267_659cbb207c7beecf32f87085d0998d51.jpg resize: (1080, 1632) 1359777267 -3.376527514966308 treat image : temp/1747723048_1321023_1359777264_5c0f5f6cb08090ba49cdfaf7e1ca3ff4.jpg resize: (1080, 1632) 1359777264 -5.533979468117848 treat image : temp/1747723048_1321023_1359777261_45f3913c0a9f270045d61bba1bb463d3.jpg resize: (1080, 1632) 1359777261 -4.832163123870337 treat image : temp/1747723048_1321023_1359777258_12d364ff8adc19edb68fc51bc5a5bc4e.jpg resize: (1080, 1632) 1359777258 -2.5578231386830645 treat image : temp/1747723048_1321023_1359777255_401a6b5ba450cd46aac5a745e5d72b5c.jpg resize: (1080, 1632) 1359777255 -5.797927912125808 treat image : temp/1747723048_1321023_1359777139_5052db6da983f319fa05e5ef55fb4a99.jpg resize: (1080, 1632) 1359777139 -5.877114086346119 treat image : temp/1747723048_1321023_1359777136_d6cd26789a3fa385a83e2602e08db6cc.jpg resize: (1080, 1632) 1359777136 -2.735720952644272 treat image : temp/1747723048_1321023_1359777133_90bb8efe72c0303959c328bf3f40dd45.jpg resize: (1080, 1632) 1359777133 -1.6289704402540663 treat image : temp/1747723048_1321023_1359777131_48329a273f12e334527db6cf01e08cd7.jpg resize: (1080, 1632) 1359777131 -2.873509532588868 treat image : temp/1747723048_1321023_1359777110_f93416afdd9f0b953d6a344113634424.jpg resize: (1080, 1632) 1359777110 -5.922037557023628 treat image : temp/1747723048_1321023_1359777108_70754ee55ecb1f90f1e5ef481b2f1df0.jpg resize: (1080, 1632) 1359777108 -6.058383558644425 treat image : temp/1747723048_1321023_1359777107_90823fad5886f63a703cc47bfe85dc53.jpg resize: (1080, 1632) 1359777107 -5.7371246158078 treat image : temp/1747723048_1321023_1359777104_8231e9349495c382e01f75831f22bd49.jpg resize: (1080, 1632) 1359777104 -6.189699720022653 treat image : temp/1747723048_1321023_1359777101_20ec4f0ffe68f4283ffbe57559735224.jpg resize: (1080, 1632) 1359777101 -5.723956792803545 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.013777494430541992 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.37400197982788086 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.09596633911132812 save missing photos in datou_result : time spend for datou_step_exec : 16.92737102508545 time spend to save output : 0.4885847568511963 total time spend for step 1 : 17.415955781936646 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 15.07user 4.39system 0:21.62elapsed 90%CPU (0avgtext+0avgdata 140068maxresident)k 3280inputs+9224outputs (14major+260535minor)pagefaults 0swaps