python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3511467 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 5760>100 please execute split_portfolio.py -i 25197410 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3322248'] with mtr_portfolio_ids : ['25197410'] and first list_photo_ids : [] new path : /proc/3511467/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 18 ; length of list_pids : 18 ; length of list_args : 18 time to download the photos : 2.1317949295043945 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Wed Jul 23 19:17:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1753291047_3511467_1373379778_45b52a09de9e07d6a807d1a474f457f1.jpg resize: (1080, 1632) 1373379778 -3.3628881904173618 treat image : temp/1753291047_3511467_1373379774_26d9c9f0d2b472d77f0168de0f9e2e16.jpg resize: (1080, 1632) 1373379774 -3.3466167173471084 treat image : temp/1753291047_3511467_1373379771_17f134e84d8dd3e813428caec817a3a8.jpg resize: (1080, 1632) 1373379771 -2.1423636274232902 treat image : temp/1753291047_3511467_1373379770_3e8c5184463bff9810de0112dfa33728.jpg resize: (1080, 1632) 1373379770 -4.2548457691005375 treat image : temp/1753291047_3511467_1373379766_189e714e4f0aa7876a142cea0ac0352d.jpg resize: (1080, 1632) 1373379766 -4.925393620600255 treat image : temp/1753291047_3511467_1373379762_2462f12645015bf736ec07351c0cde0b.jpg resize: (1080, 1632) 1373379762 -5.363920456445601 treat image : temp/1753291047_3511467_1373379678_45ea943a297a8a3bbf3124115b7f40da.jpg resize: (1080, 1632) 1373379678 -5.431255610359456 treat image : temp/1753291047_3511467_1373379675_5dde75f90fbe138c2e495527a845a3c6.jpg resize: (1080, 1632) 1373379675 -4.637560615222871 treat image : temp/1753291047_3511467_1373379673_4696ccd8536c43c2a17083d22296d99d.jpg resize: (1080, 1632) 1373379673 -5.519006909163612 treat image : temp/1753291047_3511467_1373379671_f168b337daea74687f5c883b6afa6fa7.jpg resize: (1080, 1632) 1373379671 -4.709953706741421 treat image : temp/1753291047_3511467_1373379669_f11292c537664b106a3fa1a475bd4417.jpg resize: (1080, 1632) 1373379669 -4.424996919563738 treat image : temp/1753291047_3511467_1373379664_d2e17608c8ff0131127fee3098ff2f12.jpg resize: (1080, 1632) 1373379664 -1.8196892018693842 treat image : temp/1753291047_3511467_1373379640_3c82830bb297dc891e056b171b988616.jpg resize: (1080, 1632) 1373379640 -3.103859665448855 treat image : temp/1753291047_3511467_1373379637_20e839db8ae6f02fc34f6681e367ca80.jpg resize: (1080, 1632) 1373379637 -1.964057214060199 treat image : temp/1753291047_3511467_1373379634_1a08d6b29ca965e80e4d293e3c53aea4.jpg resize: (1080, 1632) 1373379634 -2.6550291465398645 treat image : temp/1753291047_3511467_1373379632_36aea40bb80666fc20c8fa1c2a2605df.jpg resize: (1080, 1632) 1373379632 -5.052839360010438 treat image : temp/1753291047_3511467_1373379628_6f634ab882e518d71a03ad770c8f8aff.jpg resize: (1080, 1632) 1373379628 -5.081294708828453 treat image : temp/1753291047_3511467_1373379622_cd4bcd023258d6718084b68bdc7b5c5f.jpg resize: (1080, 1632) 1373379622 -5.630869990444734 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 18 time used for this insertion : 0.013496160507202148 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 18 time used for this insertion : 0.012172937393188477 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.014863252639770508 save missing photos in datou_result : time spend for datou_step_exec : 15.440135717391968 time spend to save output : 0.04553103446960449 total time spend for step 1 : 15.485666751861572 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 18 set_done_treatment 13.14user 4.81system 0:20.55elapsed 87%CPU (0avgtext+0avgdata 138968maxresident)k 928inputs+7816outputs (23major+224538minor)pagefaults 0swaps