python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1480927 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 217>100 please execute split_portfolio.py -i 22940775 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2844070'] with mtr_portfolio_ids : ['22940775'] and first list_photo_ids : [] new path : /proc/1480927/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.1073050498962402 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Wed May 14 05:57:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1747195047_1480927_1358094099_fecd170b43c895736a5982f2be783d2a.jpg resize: (1080, 1632) 1358094099 -5.1107851005705225 treat image : temp/1747195047_1480927_1358094098_305e6367830854ab6d075b350afd5b21.jpg resize: (1080, 1632) 1358094098 -5.344630710186513 treat image : temp/1747195047_1480927_1358094097_694f924c3b8a6efae73beda55306b540.jpg resize: (1080, 1632) 1358094097 -6.3914682936754055 treat image : temp/1747195047_1480927_1358094095_6ad0b59f987e7be9d880c8d6a1251ac5.jpg resize: (1080, 1632) 1358094095 -1.6550599720434824 treat image : temp/1747195047_1480927_1358094076_01b8426398d38cf73f4126a15aacb541.jpg resize: (1080, 1632) 1358094076 -5.578768537921533 treat image : temp/1747195047_1480927_1358094074_8ae8820bb8005cf31c470a3c5145582d.jpg resize: (1080, 1632) 1358094074 -5.646050317066227 treat image : temp/1747195047_1480927_1358094072_a62c3e069810ccb3136e3e979ecb90bc.jpg resize: (1080, 1632) 1358094072 -6.339473901971048 treat image : temp/1747195047_1480927_1358094070_eb738e62831f3127feb1a0491555b042.jpg resize: (1080, 1632) 1358094070 -6.360089521092661 treat image : temp/1747195047_1480927_1358094067_380923bda4db95776da4f177fc909aa5.jpg resize: (1080, 1632) 1358094067 -5.36088865448177 treat image : temp/1747195047_1480927_1358094054_f5548f68415168d03ccca9bb18a0356f.jpg resize: (1080, 1632) 1358094054 -4.7403388499783485 treat image : temp/1747195047_1480927_1358094023_83dda1ea0fa2419297f9198753517637.jpg resize: (1080, 1632) 1358094023 -1.4955742371750855 treat image : temp/1747195047_1480927_1358094022_ae3177c29aa7f60d8f4cfa4f92665c69.jpg resize: (1080, 1632) 1358094022 -1.0545225377235334 treat image : temp/1747195047_1480927_1358094020_16262c30ef7b28d8dc489be5188ef3d1.jpg resize: (1080, 1632) 1358094020 -4.744135502608569 treat image : temp/1747195047_1480927_1358094017_a9f0edb271a4ab0d66a4733ef39e878c.jpg resize: (1080, 1632) 1358094017 -5.260682515191325 treat image : temp/1747195047_1480927_1358093992_b4e79c7f5507294fefcdad9561a1b630.jpg resize: (1080, 1632) 1358093992 -5.7911287377623415 treat image : temp/1747195047_1480927_1358093991_c3dd6bc4cd77ea5c0a1653ae680fa630.jpg resize: (1080, 1632) 1358093991 -6.437484390291815 treat image : temp/1747195047_1480927_1358093989_c1ef50b3d7f6980544954f6f4f34994d.jpg resize: (1080, 1632) 1358093989 -5.912863927609519 treat image : temp/1747195047_1480927_1358093987_d29afe459ce24daac82876a74b302de1.jpg resize: (1080, 1632) 1358093987 -5.862337503850943 treat image : temp/1747195047_1480927_1358093964_5bcead92db20b29e48da52321280f250.jpg resize: (1080, 1632) 1358093964 -5.399680336224267 treat image : temp/1747195047_1480927_1358093962_be6a093b096b4b28eac94d9c749dd1fb.jpg resize: (1080, 1632) 1358093962 -5.906603975333563 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.012557506561279297 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.045014142990112305 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.018910884857177734 save missing photos in datou_result : time spend for datou_step_exec : 16.20750069618225 time spend to save output : 0.08140230178833008 total time spend for step 1 : 16.28890299797058 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.28user 4.71system 0:19.72elapsed 96%CPU (0avgtext+0avgdata 140272maxresident)k 64inputs+10504outputs (8major+253687minor)pagefaults 0swaps