python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 691128 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 2239>100 please execute split_portfolio.py -i 22246422 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2741568'] with mtr_portfolio_ids : ['22246422'] and first list_photo_ids : [] new path : /proc/691128/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 14 ; length of list_pids : 14 ; length of list_args : 14 time to download the photos : 1.6284513473510742 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Fri Apr 11 16:17:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1744381047_691128_1351741492_fdf993c95dacf5510c16a58e83ca119d.jpg resize: (1080, 1632) 1351741492 -0.8084359563670005 treat image : temp/1744381047_691128_1351741482_fdf8f2cf45e06e00564e5094c7c6cc92.jpg resize: (1080, 1632) 1351741482 -4.913526453435662 treat image : temp/1744381047_691128_1351741475_7fd4a5e495db708911ad9045ac23a8d9.jpg resize: (1080, 1632) 1351741475 -6.3489403996104405 treat image : temp/1744381047_691128_1351741410_3dd2de627c5c5d23850c68095d0f391b.jpg resize: (1080, 1632) 1351741410 -5.338894263481715 treat image : temp/1744381047_691128_1351741403_dc6afbf2c61f8ebf10299276feede4c2.jpg resize: (1080, 1632) 1351741403 -5.851785945532618 treat image : temp/1744381047_691128_1351741381_7326188f279077edb23d66545f9cdb62.jpg resize: (1080, 1632) 1351741381 -5.588176704589037 treat image : temp/1744381047_691128_1351741367_96eff9833261c18d6746bf53da3291ca.jpg resize: (1080, 1632) 1351741367 -5.792106464041331 treat image : temp/1744381047_691128_1351741331_e461af30a0f9be60f45d7e1cfe048e2d.jpg resize: (1080, 1632) 1351741331 -5.394019829771616 treat image : temp/1744381047_691128_1351741318_a2c74f073fabb63ab0f8114a66ddc67f.jpg resize: (1080, 1632) 1351741318 -4.1888699092614985 treat image : temp/1744381047_691128_1351741005_f886f0a1049cd52b23233b821bcba06c.jpg resize: (1080, 1632) 1351741005 -0.8702899409602004 treat image : temp/1744381047_691128_1351740963_ecba94b56ae24434bb57856ea43e92f6.jpg resize: (1080, 1632) 1351740963 -1.1248775386051828 treat image : temp/1744381047_691128_1351740934_01a102d704490004f895c6f38824b553.jpg resize: (1080, 1632) 1351740934 -3.81230979674838 treat image : temp/1744381047_691128_1351740890_a08efb3d827cf2798103b85211cec15f.jpg resize: (1080, 1632) 1351740890 -5.708425357731833 treat image : temp/1744381047_691128_1351740860_7477079ea11a96c8fbfd032d45066fa4.jpg resize: (1080, 1632) 1351740860 -5.739039492206075 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 14 time used for this insertion : 0.013945341110229492 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 14 time used for this insertion : 0.012731790542602539 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.015190839767456055 save missing photos in datou_result : time spend for datou_step_exec : 11.911301374435425 time spend to save output : 0.05130124092102051 total time spend for step 1 : 11.962602615356445 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 14 set_done_treatment 10.95user 3.49system 0:21.12elapsed 68%CPU (0avgtext+0avgdata 138180maxresident)k 2664inputs+6832outputs (15major+203037minor)pagefaults 0swaps