python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2314979 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 956>100 please execute split_portfolio.py -i 24536011 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3231073'] with mtr_portfolio_ids : ['24536011'] and first list_photo_ids : [] new path : /proc/2314979/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 18 ; length of list_pids : 18 ; length of list_args : 18 time to download the photos : 1.9070892333984375 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Thu Jul 3 02:32:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1751502746_2314979_1370234139_5a584b710820bf95b28524b6854bd99f.jpg resize: (1080, 1632) 1370234139 -2.688904985215102 treat image : temp/1751502746_2314979_1370234103_1837c5766b8cf916b82d8f351bb88ce0.jpg resize: (1080, 1632) 1370234103 -2.690763280550613 treat image : temp/1751502746_2314979_1370234048_e99aa9ef35f2cb7b7d8e3a6fa42b5f8f.jpg resize: (1080, 1632) 1370234048 -2.6487509698323537 treat image : temp/1751502746_2314979_1370234018_2c96f55e0746fb300e389090521ae4c5.jpg resize: (1080, 1632) 1370234018 -2.6361423176283227 treat image : temp/1751502746_2314979_1370233984_9e7f8e4918f4131347b6cc682439d116.jpg resize: (1080, 1632) 1370233984 -2.7181329990735255 treat image : temp/1751502746_2314979_1370233926_baf3340ff16d3f1dcbe413b503b383e1.jpg resize: (1080, 1632) 1370233926 -2.7124415540683304 treat image : temp/1751502746_2314979_1370233915_89463004fcfb9e60e985946e543b343b.jpg resize: (1080, 1632) 1370233915 -2.6745658802726044 treat image : temp/1751502746_2314979_1370233912_43a08e107f0394d7f0011f9bcb884643.jpg resize: (1080, 1632) 1370233912 -2.6810476980201603 treat image : temp/1751502746_2314979_1370233909_4396116c4cbdfb8dd7200c1447ad1c73.jpg resize: (1080, 1632) 1370233909 -2.6978927968918147 treat image : temp/1751502746_2314979_1370233903_836204835c6f05b3211dfd6bf7d28798.jpg resize: (1080, 1632) 1370233903 -2.7043130496104113 treat image : temp/1751502746_2314979_1370233891_a278e48c6a2085b40a585f1369559fd8.jpg resize: (1080, 1632) 1370233891 -2.68563473959764 treat image : temp/1751502746_2314979_1370233889_71f8bffcee7b5e063185a95697a5baef.jpg resize: (1080, 1632) 1370233889 -2.713796024973512 treat image : temp/1751502746_2314979_1370233824_c69f8cd29e8b27514cc4235962fd40cd.jpg resize: (1080, 1632) 1370233824 -2.698334141632847 treat image : temp/1751502746_2314979_1370233807_3785f1bba4a4c6af21abe47ec7151083.jpg resize: (1080, 1632) 1370233807 -2.7089762064496257 treat image : temp/1751502746_2314979_1370233804_619d364df786333ef9b37d6504cc3817.jpg resize: (1080, 1632) 1370233804 -2.643279421754508 treat image : temp/1751502746_2314979_1370233781_661185c136267c9c4668e67d60faed73.jpg resize: (1080, 1632) 1370233781 -2.679293374939298 treat image : temp/1751502746_2314979_1370233750_c2734cd0ccc3ca6fdb337894ea52b11b.jpg resize: (1080, 1632) 1370233750 -2.6702656047008455 treat image : temp/1751502746_2314979_1370233732_7b53bcb5a29ac61ca6effacd17564d9e.jpg resize: (1080, 1632) 1370233732 -2.702666504965615 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 18 time used for this insertion : 0.021916627883911133 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 18 time used for this insertion : 0.02071523666381836 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.025031089782714844 save missing photos in datou_result : time spend for datou_step_exec : 17.187807083129883 time spend to save output : 0.11675190925598145 total time spend for step 1 : 17.304558992385864 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 18 set_done_treatment 13.93user 5.78system 0:20.97elapsed 94%CPU (0avgtext+0avgdata 137156maxresident)k 1552inputs+6360outputs (44major+221984minor)pagefaults 0swaps