python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3933793 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 6281>100 please execute split_portfolio.py -i 24815507 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3267785'] with mtr_portfolio_ids : ['24815507'] and first list_photo_ids : [] new path : /proc/3933793/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.2877402305603027 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Fri Jul 11 17:47:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1752248848_3933793_1371625114_f9cd12e61613f8e484a9336f81a55e3c.jpg resize: (1080, 1632) 1371625114 -4.465734407245929 treat image : temp/1752248848_3933793_1371625106_52a2f510812e50213c30ea5f417d6fc5.jpg resize: (1080, 1632) 1371625106 -4.443192954282723 treat image : temp/1752248848_3933793_1371625097_39e94888c1739ace2c0cd4b36e47db2e.jpg resize: (1080, 1632) 1371625097 -4.443717493438648 treat image : temp/1752248848_3933793_1371625065_0b6234ab8afd3ccb25d9b13af5492029.jpg resize: (1080, 1632) 1371625065 -4.458549119787397 treat image : temp/1752248848_3933793_1371625032_e4f09c1148226f0e55101d8b51f85d5d.jpg resize: (1080, 1632) 1371625032 -4.422822874361015 treat image : temp/1752248848_3933793_1371625004_62bcb5a87e71228d0e0050b1eaba0409.jpg resize: (1080, 1632) 1371625004 -4.419195788087556 treat image : temp/1752248848_3933793_1371624974_16e3c9296968273e4ed65d9768ae33b7.jpg resize: (1080, 1632) 1371624974 -4.430456619034538 treat image : temp/1752248848_3933793_1371624967_be63fca75192a09661bc5a643557e275.jpg resize: (1080, 1632) 1371624967 -4.469186047896466 treat image : temp/1752248848_3933793_1371624964_a958131d83a04ca4e156de27125399cb.jpg resize: (1080, 1632) 1371624964 -4.444174088832129 treat image : temp/1752248848_3933793_1371624959_884b76d626567af1f48c1da2bdcd4820.jpg resize: (1080, 1632) 1371624959 -4.484421532714157 treat image : temp/1752248848_3933793_1371624956_12616cfc7193ac5d1b8c9f51d02728c9.jpg resize: (1080, 1632) 1371624956 -4.437477491453381 treat image : temp/1752248848_3933793_1371624953_3561771ba7dfcf4b061b45cee92ac9bf.jpg resize: (1080, 1632) 1371624953 -4.46547191375289 treat image : temp/1752248848_3933793_1371624937_34264fd4d66bd0790e6b41373c099ea2.jpg resize: (1080, 1632) 1371624937 -5.049256509590066 treat image : temp/1752248848_3933793_1371624933_0d9d9d4663143dce689c23977c2de3d6.jpg resize: (1080, 1632) 1371624933 -5.043003573961457 treat image : temp/1752248848_3933793_1371624928_6edce31d8b8f8421aa5560f2d730b0c0.jpg resize: (1080, 1632) 1371624928 -5.00324501654452 treat image : temp/1752248848_3933793_1371624923_e9dd7fa044da37fa70258e6e17057618.jpg resize: (1080, 1632) 1371624923 -5.023712635642483 treat image : temp/1752248848_3933793_1371624920_0a90662e7554d66aaaca35752b77dbbf.jpg resize: (1080, 1632) 1371624920 -5.05518153131144 treat image : temp/1752248848_3933793_1371624918_856e5bc233c98b77d3422a5773c912c7.jpg resize: (1080, 1632) 1371624918 -5.0549329487815475 treat image : temp/1752248848_3933793_1371624386_eed83253ab2e94246be4454e8b5a6db3.jpg resize: (1080, 1632) 1371624386 -4.555862880425973 treat image : temp/1752248848_3933793_1371624375_3fc4c21c6245d24d4ab7429fb6b1ca5c.jpg resize: (1080, 1632) 1371624375 -4.525363159013276 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.012642383575439453 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.011736631393432617 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.014333009719848633 save missing photos in datou_result : time spend for datou_step_exec : 16.275848627090454 time spend to save output : 0.04352211952209473 total time spend for step 1 : 16.31937074661255 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.81user 4.27system 0:22.45elapsed 84%CPU (0avgtext+0avgdata 139444maxresident)k 56inputs+9400outputs (2major+258381minor)pagefaults 0swaps