python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3358114 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 1443>100 please execute split_portfolio.py -i 25799757 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3480382'] with mtr_portfolio_ids : ['25799757'] and first list_photo_ids : [] new path : /proc/3358114/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.321706533432007 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Fri Aug 8 19:17:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1754673446_3358114_1375925498_34cdf6d23468262c417a6c12f43e21eb.jpg resize: (1080, 1632) 1375925498 -4.539972813991899 treat image : temp/1754673446_3358114_1375925479_e08c227d44e06ca6416c15ca1a0dc603.jpg resize: (1080, 1632) 1375925479 -5.96772556270745 treat image : temp/1754673446_3358114_1375925459_ca964806941a2e39abd3c034c8f8c350.jpg resize: (1080, 1632) 1375925459 -5.635446809796341 treat image : temp/1754673446_3358114_1375925438_b1235ece8c42d76b5f8a67af4fb4cd9c.jpg resize: (1080, 1632) 1375925438 -5.616461704508812 treat image : temp/1754673446_3358114_1375925418_25720bdc5062d35a4043dea178af5839.jpg resize: (1080, 1632) 1375925418 -4.867356282128003 treat image : temp/1754673446_3358114_1375925412_1049dceaaaea5f0998b70baadd72354b.jpg resize: (1080, 1632) 1375925412 -1.3661807331322762 treat image : temp/1754673446_3358114_1375925341_771adc5a45313876aef0d7a43670eb35.jpg resize: (1080, 1632) 1375925341 -5.583818607460754 treat image : temp/1754673446_3358114_1375925321_46188a8fbe19c5232deaf0d085ddb9e2.jpg resize: (1080, 1632) 1375925321 -4.907830930902723 treat image : temp/1754673446_3358114_1375925298_80bfec84f534ab25c71838403bc0fdf2.jpg resize: (1080, 1632) 1375925298 -4.802342599858659 treat image : temp/1754673446_3358114_1375925277_6b2bf546723c83c31b93281900be5d54.jpg resize: (1080, 1632) 1375925277 -4.981868664519863 treat image : temp/1754673446_3358114_1375925258_5434def49e7a91c74896d8fa8fc47056.jpg resize: (1080, 1632) 1375925258 -5.349829433038619 treat image : temp/1754673446_3358114_1375925240_cc9dae8e713de5f4a63bca3316312f77.jpg resize: (1080, 1632) 1375925240 -4.281663176390697 treat image : temp/1754673446_3358114_1375925182_752c418da638ed355d2e308debaf9f5b.jpg resize: (1080, 1632) 1375925182 -1.965271906047057 treat image : temp/1754673446_3358114_1375925179_b116969c3f69803691ad4a19814aedd3.jpg resize: (1080, 1632) 1375925179 -1.965271906047057 treat image : temp/1754673446_3358114_1375925166_85111e11fbfd86c5914f7707f7ce7691.jpg resize: (1080, 1632) 1375925166 -3.492691116815062 treat image : temp/1754673446_3358114_1375925165_afa8db0f58b619f608c58563c28d5249.jpg resize: (1080, 1632) 1375925165 -3.492691116815062 treat image : temp/1754673446_3358114_1375925163_ed90162c7e6cd4b98f4fcda096eb4459.jpg resize: (1080, 1632) 1375925163 -5.352592398505651 treat image : temp/1754673446_3358114_1375925162_db20fea03e013c720038cd18d3c7be88.jpg resize: (1080, 1632) 1375925162 -5.352592398505651 treat image : temp/1754673446_3358114_1375925159_4b99130547a61e93443c676ac2862f9b.jpg resize: (1080, 1632) 1375925159 -3.0209687372879896 treat image : temp/1754673446_3358114_1375925158_9a7b8155a22631640a5ca8189e351f7b.jpg resize: (1080, 1632) 1375925158 -3.0209687372879896 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.04351472854614258 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.04426074028015137 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.044527530670166016 save missing photos in datou_result : time spend for datou_step_exec : 15.581546068191528 time spend to save output : 0.1504220962524414 total time spend for step 1 : 15.73196816444397 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 13.83user 4.39system 0:19.90elapsed 91%CPU (0avgtext+0avgdata 139240maxresident)k 24inputs+9208outputs (10major+259988minor)pagefaults 0swaps