python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 137771 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 4350>100 please execute split_portfolio.py -i 25001616 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3300033'] with mtr_portfolio_ids : ['25001616'] and first list_photo_ids : [] new path : /proc/137771/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 3.0504515171051025 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Thu Jul 17 13:02:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1752750148_137771_1372401552_3dcaadd4ad2b4b71ce9d1fe32b1df2f6.jpg resize: (1080, 1632) 1372401552 -5.583425757299173 treat image : temp/1752750148_137771_1372344311_075ae9f702d33ffe9a8e3302afed78d2.jpg resize: (1080, 1632) 1372344311 -3.1013014451063214 treat image : temp/1752750148_137771_1372344308_53c4a5751756f194e001277c199c3fb7.jpg resize: (1080, 1632) 1372344308 -3.0936062064462293 treat image : temp/1752750148_137771_1372344307_ea4a0e97b384f7739d02da38959f4b89.jpg resize: (1080, 1632) 1372344307 -3.0530474182628287 treat image : temp/1752750148_137771_1372344304_fbaa14406b9933a1ae10afb0bede7f42.jpg resize: (1080, 1632) 1372344304 -3.054651050216349 treat image : temp/1752750148_137771_1372344301_8df71c9ad49c663bf6754f536342bdb0.jpg resize: (1080, 1632) 1372344301 -2.7887878502008885 treat image : temp/1752750148_137771_1372344299_e7c1f65c7ed554f2c5c5bd30f7405ced.jpg resize: (1080, 1632) 1372344299 -3.642263329951819 treat image : temp/1752750148_137771_1372344277_fe594451097393983a942745119a4af4.jpg resize: (1080, 1632) 1372344277 -2.7709851744214804 treat image : temp/1752750148_137771_1372344275_b60a4e8d236312df13b9dacd6335df50.jpg resize: (1080, 1632) 1372344275 -2.7817630456809486 treat image : temp/1752750148_137771_1372344273_711befb6c2df607bd7bbaa2742da3d76.jpg resize: (1080, 1632) 1372344273 -2.774158178325017 treat image : temp/1752750148_137771_1372344272_6641313ae584f34639a694b14a7aefd2.jpg resize: (1080, 1632) 1372344272 -3.099350719942788 treat image : temp/1752750148_137771_1372344270_621bc77130241aaa410c60ab5f014af0.jpg resize: (1080, 1632) 1372344270 -3.1144682587096106 treat image : temp/1752750148_137771_1372344268_dc9b75d27ee472c39f7fc270b9a064e3.jpg resize: (1080, 1632) 1372344268 -3.0940556025868258 treat image : temp/1752750148_137771_1372344255_61ca3c8a85ec0c7e80fa72f5fbf2853e.jpg resize: (1080, 1632) 1372344255 -2.682321364198504 treat image : temp/1752750148_137771_1372344253_bff83c4a4e81e858a80f9fd8b0a5a9b4.jpg resize: (1080, 1632) 1372344253 -2.6992888272905624 treat image : temp/1752750148_137771_1372344251_1604bb2e529dc375f71deaff22d9c20e.jpg resize: (1080, 1632) 1372344251 -2.802197180464408 treat image : temp/1752750148_137771_1372344250_5bcee85e857cbdee196ba76912363667.jpg resize: (1080, 1632) 1372344250 -2.7281059201307927 treat image : temp/1752750148_137771_1372344247_625c09d833441c3a40466e11d0e63eaa.jpg resize: (1080, 1632) 1372344247 -2.7623159131747683 treat image : temp/1752750148_137771_1372344245_53978052cc167374c3ce31985fea59b5.jpg resize: (1080, 1632) 1372344245 -2.7382639697619 treat image : temp/1752750148_137771_1372344221_173a34cf6bcf2aa68434303f89a1a686.jpg resize: (1080, 1632) 1372344221 -3.6598275870628076 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.035811662673950195 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.03471803665161133 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.03914642333984375 save missing photos in datou_result : time spend for datou_step_exec : 15.156190633773804 time spend to save output : 0.1257624626159668 total time spend for step 1 : 15.28195309638977 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.22user 3.39system 0:20.70elapsed 85%CPU (0avgtext+0avgdata 138928maxresident)k 2768inputs+7176outputs (29major+269550minor)pagefaults 0swaps