python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1533303 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 2879>100 please execute split_portfolio.py -i 26511073 -l 100 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4871, datou_cur_ids : ['3661506'] with mtr_portfolio_ids : ['26511073'] and first list_photo_ids : [] new path : /proc/1533303/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.6073756217956543 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Thu Sep 4 18:52:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1757004747_1533303_1381471126_70758711520fbf3f920591126c8203cc_72785237.jpg resize: (1080, 1632) 1381471126 -4.897474509416588 treat image : temp/1757004747_1533303_1381471125_3a8b099a873f8127f9d50313b77a5003_53109731.jpg resize: (1080, 1632) 1381471125 -4.851307357181917 treat image : temp/1757004747_1533303_1381471123_0f356a1cb0d197ffe2b19d5d21f2d683_54073904.jpg resize: (1080, 1632) 1381471123 -5.109318932997693 treat image : temp/1757004747_1533303_1381471121_5006a5a1972ac9dda87079645d37b664_13723878.jpg resize: (1080, 1632) 1381471121 -4.749237059479383 treat image : temp/1757004747_1533303_1381471064_d945e96cc9cfc09bdb8cb6d7ea040eea_82423078.jpg resize: (1080, 1632) 1381471064 -4.936424835415149 treat image : temp/1757004747_1533303_1381471063_166708db8db173fb57a241cd549c21b3_3143049.jpg resize: (1080, 1632) 1381471063 -5.343490772484661 treat image : temp/1757004747_1533303_1381471062_6774659f9547ad8e09a170fa0bd89cfb_63242340.jpg resize: (1080, 1632) 1381471062 -5.759690329227928 treat image : temp/1757004747_1533303_1381471061_792e5bfe5b54ba29ee103923f898d231_51005272.jpg resize: (1080, 1632) 1381471061 -5.0347386947158475 treat image : temp/1757004747_1533303_1381446394_9f5868185f40896460b2b9f3e382834e_26087553.jpg resize: (1080, 1632) 1381446394 -0.6062969886079983 treat image : temp/1757004747_1533303_1381446393_dc2dd790cbcfc54d410d06d20a41d4c5_26065646.jpg resize: (1080, 1632) 1381446393 -0.7566125024912996 treat image : temp/1757004747_1533303_1381446392_3f3cc975cd7a487eb7f5a082864ce010_35615822.jpg resize: (1080, 1632) 1381446392 -4.848226776993465 treat image : temp/1757004747_1533303_1381446387_99cbedaaab1baead5cf9f88b07b6be46_39331652.jpg resize: (1080, 1632) 1381446387 -5.275650008513345 treat image : temp/1757004747_1533303_1381446386_c792c446feff4ebd96d4f1830774a784_91181329.jpg resize: (1080, 1632) 1381446386 -5.036958109602129 treat image : temp/1757004747_1533303_1381446385_9d1fc64ca1f61717d6f5a18dc7b7426c_91057959.jpg resize: (1080, 1632) 1381446385 -5.231574461264802 treat image : temp/1757004747_1533303_1381446384_25e2820ada8504ebeb7721d5b7126a29_5735354.jpg resize: (1080, 1632) 1381446384 -5.835157511026609 treat image : temp/1757004747_1533303_1381446383_37b0a407abf8a7fefea14392f93dbb33_69206835.jpg resize: (1080, 1632) 1381446383 -5.04276591820755 treat image : temp/1757004747_1533303_1381446382_3ac0d323f6513ff60f3f9c470dd3fc0b_28420304.jpg resize: (1080, 1632) 1381446382 -5.661924208902538 treat image : temp/1757004747_1533303_1381446362_671d9c9c88bf58fc003b20b01793da3e_32592088.jpg resize: (1080, 1632) 1381446362 -4.777435807104519 treat image : temp/1757004747_1533303_1381446361_f0aaf289f11103805698bca44ad137c7_43715731.jpg resize: (1080, 1632) 1381446361 -4.879928319666069 treat image : temp/1757004747_1533303_1381446360_adade844330620961fb0b06e7562054d_67486609.jpg resize: (1080, 1632) 1381446360 -5.376577666871237 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.028367042541503906 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.0273590087890625 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.02836132049560547 save missing photos in datou_result : time spend for datou_step_exec : 15.500279426574707 time spend to save output : 0.09708976745605469 total time spend for step 1 : 15.597369194030762 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.20user 3.95system 0:20.66elapsed 87%CPU (0avgtext+0avgdata 140252maxresident)k 352inputs+9760outputs (14major+209107minor)pagefaults 0swaps