python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3229607 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 2944>100 please execute split_portfolio.py -i 24536011 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3231073'] with mtr_portfolio_ids : ['24536011'] and first list_photo_ids : [] new path : /proc/3229607/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 18 ; length of list_pids : 18 ; length of list_args : 18 time to download the photos : 2.025141477584839 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Thu Jul 3 11:12:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1751533948_3229607_1370394273_2b5cbdf8e11528000506871605a95c95.jpg resize: (1080, 1632) 1370394273 -4.17243288391312 treat image : temp/1751533948_3229607_1370394203_d9aa75d6ca91290bdc0d00582531abff.jpg resize: (1080, 1632) 1370394203 -4.798444565188539 treat image : temp/1751533948_3229607_1370394136_1359cac3f2a412b6a476ac397497d454.jpg resize: (1080, 1632) 1370394136 -4.1897127325783 treat image : temp/1751533948_3229607_1370394060_b1674f649836a37abb34447bee6e1e58.jpg resize: (1080, 1632) 1370394060 -1.9861730491788328 treat image : temp/1751533948_3229607_1370394037_000b900643fe4c441ae14c74cb276e3f.jpg resize: (1080, 1632) 1370394037 -2.5038246756580405 treat image : temp/1751533948_3229607_1370393967_f6887fd9cf8f44beb7f4558476c276f7.jpg resize: (1080, 1632) 1370393967 -2.482618872964213 treat image : temp/1751533948_3229607_1370392443_9c27fffcde3b7eea5fd51447ea8c2587.jpg resize: (1080, 1632) 1370392443 -3.7591687040162856 treat image : temp/1751533948_3229607_1370392442_c45fc9dc0a13d31229310a02b5337fcc.jpg resize: (1080, 1632) 1370392442 -4.996106345929126 treat image : temp/1751533948_3229607_1370391627_b54a6630cdf40b1d1f37f598757b6faf.jpg resize: (1080, 1632) 1370391627 -4.187808892329615 treat image : temp/1751533948_3229607_1370391570_f0ea57f3edea1f456d8c9dbce42fd7b4.jpg resize: (1080, 1632) 1370391570 -5.553828068404865 treat image : temp/1751533948_3229607_1370391545_8fa4101775ba759fb4b4f23c7c518b1a.jpg resize: (1080, 1632) 1370391545 -2.7725354761275742 treat image : temp/1751533948_3229607_1370391502_d6fcc3dad8149b3003b6276eebfd26fe.jpg resize: (1080, 1632) 1370391502 -4.671471044794789 treat image : temp/1751533948_3229607_1370391483_c2a233fa1a47de5851c5b58d47f699a1.jpg resize: (1080, 1632) 1370391483 -2.794450229931396 treat image : temp/1751533948_3229607_1370391438_5bbc6fd9fb6a9a24f6b4ac51084cf4fb.jpg resize: (1080, 1632) 1370391438 -3.1838832912558916 treat image : temp/1751533948_3229607_1370391420_e2f551571febc17240a5922268ff5525.jpg resize: (1080, 1632) 1370391420 -4.475316608668383 treat image : temp/1751533948_3229607_1370391346_c8d2406534c2ae8b96b03182bb2db169.jpg resize: (1080, 1632) 1370391346 -5.132690371289642 treat image : temp/1751533948_3229607_1370391312_5321125913cf996b3cdedad9c18e0137.jpg resize: (1080, 1632) 1370391312 -4.210808490870191 treat image : temp/1751533948_3229607_1370391196_b06c3203d75a462900cba28769c1af7c.jpg resize: (1080, 1632) 1370391196 -5.650567338252833 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 18 time used for this insertion : 0.01519918441772461 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 18 time used for this insertion : 0.05193161964416504 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.04031658172607422 save missing photos in datou_result : time spend for datou_step_exec : 15.66127872467041 time spend to save output : 0.11188650131225586 total time spend for step 1 : 15.773165225982666 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 18 set_done_treatment 13.16user 4.88system 0:19.97elapsed 90%CPU (0avgtext+0avgdata 137844maxresident)k 360inputs+7616outputs (8major+239220minor)pagefaults 0swaps