python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2310594 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 1333>100 please execute split_portfolio.py -i 26625914 -l 100 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4871, datou_cur_ids : ['3676285'] with mtr_portfolio_ids : ['26625914'] and first list_photo_ids : [] new path : /proc/2310594/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.644827127456665 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Mon Sep 8 14:47:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1757335647_2310594_1382546040_38102ae4b12793946337dc8b75262458.jpg resize: (1080, 1632) 1382546040 -3.6445320728380985 treat image : temp/1757335647_2310594_1382546037_9e499f5c4739dec4fee43ca21962f7b1.jpg resize: (1080, 1632) 1382546037 -0.6202698584700028 treat image : temp/1757335647_2310594_1382546036_17c6cf111edada35621cc98fda9f249f.jpg resize: (1080, 1632) 1382546036 -3.3339149191295374 treat image : temp/1757335647_2310594_1382546027_e3da5eb03fa5e1b29399aeb4bc231659.jpg resize: (1080, 1632) 1382546027 -5.685105510802253 treat image : temp/1757335647_2310594_1382546005_925957d9f44149249dcf55800c7123d4.jpg resize: (1080, 1632) 1382546005 -2.6324707550171604 treat image : temp/1757335647_2310594_1382546003_edb243ba9f6de3a04467588421ad0f15.jpg resize: (1080, 1632) 1382546003 -4.292979772605699 treat image : temp/1757335647_2310594_1382545999_0acaa6514e5444384f4f559c9f9e7107.jpg resize: (1080, 1632) 1382545999 -5.371406008652669 treat image : temp/1757335647_2310594_1382545996_cb054f49a0450b7af97da67fc7627e04.jpg resize: (1080, 1632) 1382545996 -3.370430862295635 treat image : temp/1757335647_2310594_1382545992_cb7fd5f1c506a70ab14c0d4aa8167ed8.jpg resize: (1080, 1632) 1382545992 -4.84382531731365 treat image : temp/1757335647_2310594_1382545989_8690d889ce6acd8e9a6dd1e670eaa748.jpg resize: (1080, 1632) 1382545989 -5.211094493951304 treat image : temp/1757335647_2310594_1382545976_a6595bd64821bd2d474fd099bd463a2d.jpg resize: (1080, 1632) 1382545976 -1.2248666185468053 treat image : temp/1757335647_2310594_1382545973_3a24d16e78b78f67295e4c087c8beb7b.jpg resize: (1080, 1632) 1382545973 -1.8729069729867085 treat image : temp/1757335647_2310594_1382545967_14395dccb1a5a7e8cc01d0321cd41663.jpg resize: (1080, 1632) 1382545967 -1.8538487896807359 treat image : temp/1757335647_2310594_1382545961_b6c219573706b4cf86d477ff55f6a167.jpg resize: (1080, 1632) 1382545961 -2.5880842584943182 treat image : temp/1757335647_2310594_1382545940_ab5b940d3c84457ea1fb46d84f794edb.jpg resize: (1080, 1632) 1382545940 -6.07735705601462 treat image : temp/1757335647_2310594_1382545932_22786dbaaa6930c885d5f45d3353d420.jpg resize: (1080, 1632) 1382545932 -3.845177379130668 treat image : temp/1757335647_2310594_1382545928_bb91c28892193852b9b811a543c0a4a7.jpg resize: (1080, 1632) 1382545928 -3.9860644550624733 treat image : temp/1757335647_2310594_1382545922_bfad667870e94022b07524add2c7ed5c.jpg resize: (1080, 1632) 1382545922 -5.585413596071806 treat image : temp/1757335647_2310594_1382545920_0b0e0f9b59e08aee6c478830bb80aa0e.jpg resize: (1080, 1632) 1382545920 -3.399879360620571 treat image : temp/1757335647_2310594_1382545918_acad0c439ac8aa1a75c77c07995bbbdf.jpg resize: (1080, 1632) 1382545918 -0.7556232511624407 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.012886524200439453 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.011711597442626953 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.015032768249511719 save missing photos in datou_result : time spend for datou_step_exec : 15.866616249084473 time spend to save output : 0.044189453125 total time spend for step 1 : 15.910805702209473 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.92user 3.79system 0:20.67elapsed 90%CPU (0avgtext+0avgdata 137096maxresident)k 184inputs+9040outputs (5major+260045minor)pagefaults 0swaps