python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1026253 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 8305>100 please execute split_portfolio.py -i 24774035 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3262193'] with mtr_portfolio_ids : ['24774035'] and first list_photo_ids : [] new path : /proc/1026253/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.396686553955078 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Sat Jul 12 01:42:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1752277346_1026253_1371773639_510760e5d22a6b8835607047921b010c.jpg resize: (1080, 1632) 1371773639 -5.2641932819742685 treat image : temp/1752277346_1026253_1371773589_0863cdc7c2915d0e7105054a0bc207aa.jpg resize: (1080, 1632) 1371773589 -5.122319667220523 treat image : temp/1752277346_1026253_1371773535_0041e3519fda7f0e63d31e319ba9f6b5.jpg resize: (1080, 1632) 1371773535 -4.1522866724123535 treat image : temp/1752277346_1026253_1371773486_c2c5b73bbc527755b29d208cda2b1f70.jpg resize: (1080, 1632) 1371773486 -3.972200237047926 treat image : temp/1752277346_1026253_1371773442_1fffdde24d679ec5be68c556a5fe23f3.jpg resize: (1080, 1632) 1371773442 -5.082472609852474 treat image : temp/1752277346_1026253_1371773397_5b5cea035fdca93559114250d90e1e68.jpg resize: (1080, 1632) 1371773397 -5.694876151882931 treat image : temp/1752277346_1026253_1371773027_7565cdd98b8e68d5ee785d06a111a51c.jpg resize: (1080, 1632) 1371773027 -4.387595546722127 treat image : temp/1752277346_1026253_1371772978_d2d9569c175ca07195fa3707992eb9c7.jpg resize: (1080, 1632) 1371772978 -2.8813485430453323 treat image : temp/1752277346_1026253_1371772942_d7449824b3fb6e1976b6783892ef59af.jpg resize: (1080, 1632) 1371772942 -0.9750777979670201 treat image : temp/1752277346_1026253_1371772930_5b4e3bea08d8ea58c4d45f866b495891.jpg resize: (1080, 1632) 1371772930 -2.9646267936308344 treat image : temp/1752277346_1026253_1371772924_184b1c2c3544973f13285eadd0ff54d3.jpg resize: (1080, 1632) 1371772924 -2.960678148016689 treat image : temp/1752277346_1026253_1371772922_d34c5ac95d50074c2b753a21d1ca29d8.jpg resize: (1080, 1632) 1371772922 -1.8826435445657688 treat image : temp/1752277346_1026253_1371770378_8713b9720243c95d71f582bba303e28f.jpg resize: (1080, 1632) 1371770378 -3.5769520643656723 treat image : temp/1752277346_1026253_1371770353_cda92162d9a40639c26593cbcade1209.jpg resize: (1080, 1632) 1371770353 -5.0758185104292215 treat image : temp/1752277346_1026253_1371770327_ceeb09f438e25b86b72fd1c1f87aeef2.jpg resize: (1080, 1632) 1371770327 -2.1299604336607696 treat image : temp/1752277346_1026253_1371770297_978619e669d7bd7578bb6a95dcce0c19.jpg resize: (1080, 1632) 1371770297 -4.129948948243537 treat image : temp/1752277346_1026253_1371769789_7a9ecb1e8764c010deea31aef45ece20.jpg resize: (1080, 1632) 1371769789 -4.0759274507879155 treat image : temp/1752277346_1026253_1371769775_74e80c8762c362192fcb70b422cfee50.jpg resize: (1080, 1632) 1371769775 -5.10272994002624 treat image : temp/1752277346_1026253_1371769773_f606a500acbc3cd8abf15519ff9f2c4f.jpg resize: (1080, 1632) 1371769773 -4.62598148508535 treat image : temp/1752277346_1026253_1371769771_3fdfd700f5bd1b6fb31700601ecb7d07.jpg resize: (1080, 1632) 1371769771 -4.253667710207122 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.016701221466064453 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.018024444580078125 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.02296280860900879 save missing photos in datou_result : time spend for datou_step_exec : 14.735666513442993 time spend to save output : 0.06211447715759277 total time spend for step 1 : 14.797780990600586 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 13.96user 3.18system 0:19.43elapsed 88%CPU (0avgtext+0avgdata 138492maxresident)k 104inputs+8520outputs (2major+237910minor)pagefaults 0swaps