python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 573839 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 9359>100 please execute split_portfolio.py -i 24815507 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3267785'] with mtr_portfolio_ids : ['24815507'] and first list_photo_ids : [] new path : /proc/573839/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.311955213546753 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Fri Jul 11 22:47:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1752266849_573839_1371706528_fa1700e6849382fdf010db2c0f373b13.jpg resize: (1080, 1632) 1371706528 -5.355796301352418 treat image : temp/1752266849_573839_1371706481_9879b338e2de00445af2bbb207a373e6.jpg resize: (1080, 1632) 1371706481 -5.352851124229496 treat image : temp/1752266849_573839_1371706426_3593314a6a67f79c07a40c0add1f2ec8.jpg resize: (1080, 1632) 1371706426 -5.355040569756891 treat image : temp/1752266849_573839_1371706368_f9caa69743054b0612d36dcba6bf4870.jpg resize: (1080, 1632) 1371706368 -5.374380807439404 treat image : temp/1752266849_573839_1371706301_11039a8a87ffcac88d7fecc3527f30fa.jpg resize: (1080, 1632) 1371706301 -5.376252064391126 treat image : temp/1752266849_573839_1371706248_b4668bd2136fbbd828018bb4a411d7ba.jpg resize: (1080, 1632) 1371706248 -5.390111228531468 treat image : temp/1752266849_573839_1371706036_372046d562b577ff7592d816c53e6ba5.jpg resize: (1080, 1632) 1371706036 -1.9731044058702032 treat image : temp/1752266849_573839_1371705988_6be1af9303d8f8a0a24c9db229e59bda.jpg resize: (1080, 1632) 1371705988 -3.0775806946433653 treat image : temp/1752266849_573839_1371705941_2ac1b2587604c2fc88ee9a8c6fec1bb9.jpg resize: (1080, 1632) 1371705941 -3.0331024979718806 treat image : temp/1752266849_573839_1371705900_d1f69f7bdad758a2b63dd37e389a643b.jpg resize: (1080, 1632) 1371705900 -2.9115378685696043 treat image : temp/1752266849_573839_1371705874_ca65d5cda6ff9f8ebc66f830202326b0.jpg resize: (1080, 1632) 1371705874 -2.116479472967524 treat image : temp/1752266849_573839_1371705844_ffcc5a5f08a88a68fb814b4e4986eb2b.jpg resize: (1080, 1632) 1371705844 -0.9251417358388166 treat image : temp/1752266849_573839_1371705744_d5cbd9309cada966824a69ef525f93e9.jpg resize: (1080, 1632) 1371705744 -5.399280360809957 treat image : temp/1752266849_573839_1371705716_29e27147874ad3411312317673af056c.jpg resize: (1080, 1632) 1371705716 -5.409409219485088 treat image : temp/1752266849_573839_1371705684_11aca1b6608706e7e0441960b0bc6e01.jpg resize: (1080, 1632) 1371705684 -5.4063247812387525 treat image : temp/1752266849_573839_1371705655_75baf21552cbf017670900c89ed2b75a.jpg resize: (1080, 1632) 1371705655 -5.4092058426030745 treat image : temp/1752266849_573839_1371705596_7d0a12124e7b288fc7db7c5998270ad8.jpg resize: (1080, 1632) 1371705596 -5.414524325851825 treat image : temp/1752266849_573839_1371705547_3b338845e3ed81b2e07513f80c73e067.jpg resize: (1080, 1632) 1371705547 -5.426239512236113 treat image : temp/1752266849_573839_1371705436_eccf1eaf209aea4a877bf408e38d4e3a.jpg resize: (1080, 1632) 1371705436 -4.907272149263739 treat image : temp/1752266849_573839_1371705384_5af10c9446a248485a09b3bbbeb45712.jpg resize: (1080, 1632) 1371705384 -4.955572250679965 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.012482166290283203 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.01287531852722168 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.013869285583496094 save missing photos in datou_result : time spend for datou_step_exec : 15.609590768814087 time spend to save output : 0.04406929016113281 total time spend for step 1 : 15.65366005897522 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.75user 3.19system 0:21.81elapsed 82%CPU (0avgtext+0avgdata 138108maxresident)k 96inputs+9320outputs (3major+239381minor)pagefaults 0swaps