python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2196216 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 3290>100 please execute split_portfolio.py -i 25430353 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3381100'] with mtr_portfolio_ids : ['25430353'] and first list_photo_ids : [] new path : /proc/2196216/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 18 ; length of list_pids : 18 ; length of list_args : 18 time to download the photos : 1.8388276100158691 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Tue Jul 29 10:47:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1753778847_2196216_1374289781_8666fc99701a358b5ad3a8316fad58a6.jpg resize: (1080, 1632) 1374289781 -3.101410590049671 treat image : temp/1753778847_2196216_1374289754_3078bef62942cd6fbc05aee96df97a65.jpg resize: (1080, 1632) 1374289754 -3.922239531995251 treat image : temp/1753778847_2196216_1374289701_f6ff0bcfd507ebdfc62a65d9e71ec72b.jpg resize: (1080, 1632) 1374289701 -2.629614169811385 treat image : temp/1753778847_2196216_1374289640_8b112bcafc65ee9cdad9005925d099da.jpg resize: (1080, 1632) 1374289640 -4.358864640680132 treat image : temp/1753778847_2196216_1374289608_95aae587f388001cae32a0af3c2f57a1.jpg resize: (1080, 1632) 1374289608 -4.323554765519185 treat image : temp/1753778847_2196216_1374289586_f0f273c3473e10d4bcea5e01f50afb32.jpg resize: (1080, 1632) 1374289586 -4.590561420901332 treat image : temp/1753778847_2196216_1374289554_b770361d8bc0819b5aee2590015d729c.jpg resize: (1080, 1632) 1374289554 -0.6444044960158886 treat image : temp/1753778847_2196216_1374289553_cf82dbf0c600d62db8ac19bd3cb94feb.jpg resize: (1080, 1632) 1374289553 -1.1774309823655786 treat image : temp/1753778847_2196216_1374289552_ca81909347ab9b5f4fb20c9ed14145be.jpg resize: (1080, 1632) 1374289552 -1.9900077494375887 treat image : temp/1753778847_2196216_1374289551_39623f8cfe8bcc66bac6e04a63ad3788.jpg resize: (1080, 1632) 1374289551 -2.011071109869183 treat image : temp/1753778847_2196216_1374289550_f2a024ba9a95afe4b9cf1181e6efb929.jpg resize: (1080, 1632) 1374289550 -1.9712601022870044 treat image : temp/1753778847_2196216_1374289549_37f26842f179a1e8515a32f28a8bf0a5.jpg resize: (1080, 1632) 1374289549 -3.057026475890666 treat image : temp/1753778847_2196216_1374289541_eaccccdcd9456e3092509d2cbaf9f3d7.jpg resize: (1080, 1632) 1374289541 -5.179462783788274 treat image : temp/1753778847_2196216_1374289540_f466f73520fae2745750af038071ab9f.jpg resize: (1080, 1632) 1374289540 -5.172010056815355 treat image : temp/1753778847_2196216_1374289539_d5f2d01cbfde8ac922600b58722df689.jpg resize: (1080, 1632) 1374289539 -5.151770067759742 treat image : temp/1753778847_2196216_1374289537_c6c36651d73ca3005c90c17cbf675340.jpg resize: (1080, 1632) 1374289537 -5.237676451824914 treat image : temp/1753778847_2196216_1374289536_c438d42b0dcb0dcc29b11fdf68e27a54.jpg resize: (1080, 1632) 1374289536 -5.1798750948093994 treat image : temp/1753778847_2196216_1374289535_6e61ee1a2a9e814daddffa310acbc1d6.jpg resize: (1080, 1632) 1374289535 -5.073070069755579 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 18 time used for this insertion : 0.013803958892822266 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 18 time used for this insertion : 0.01597452163696289 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.02090620994567871 save missing photos in datou_result : time spend for datou_step_exec : 13.263254642486572 time spend to save output : 0.0558476448059082 total time spend for step 1 : 13.31910228729248 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 18 set_done_treatment 12.29user 3.42system 0:17.34elapsed 90%CPU (0avgtext+0avgdata 139996maxresident)k 0inputs+7448outputs (4major+190990minor)pagefaults 0swaps