python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1299579 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 2287>100 please execute split_portfolio.py -i 26665669 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3681293'] with mtr_portfolio_ids : ['26665669'] and first list_photo_ids : [] new path : /proc/1299579/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.3399722576141357 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Tue Sep 9 15:07:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1757423249_1299579_1382779546_dfa8152de63846198f0d1f6e875218c6.jpg resize: (1080, 1632) 1382779546 -5.739089696186998 treat image : temp/1757423249_1299579_1382779544_311ed90defee70b748e9901fbc743ba8.jpg resize: (1080, 1632) 1382779544 -5.47772477922968 treat image : temp/1757423249_1299579_1382779542_a222680f0866c94dbdcb3b9323567ee2.jpg resize: (1080, 1632) 1382779542 -1.6550975289834782 treat image : temp/1757423249_1299579_1382779526_375efab2895f3ada819f2bb9d67f918f.jpg resize: (1080, 1632) 1382779526 -4.545736052934809 treat image : temp/1757423249_1299579_1382779524_25987ffbc6bd802724a9fa8e2ee17c80.jpg resize: (1080, 1632) 1382779524 -3.88052898314192 treat image : temp/1757423249_1299579_1382779519_e41f63beec8896069a551fa9042dac27.jpg resize: (1080, 1632) 1382779519 -5.3377842705202605 treat image : temp/1757423249_1299579_1382779514_d02d6c4d0e1ace5690d3afb7d1c81000.jpg resize: (1080, 1632) 1382779514 -4.547490234948448 treat image : temp/1757423249_1299579_1382779510_4ab21bbecdca00e1135f9621d4370748.jpg resize: (1080, 1632) 1382779510 -3.617327298129879 treat image : temp/1757423249_1299579_1382779505_f1f8a34ee93877341585462a71ac8817.jpg resize: (1080, 1632) 1382779505 -3.2117672000054847 treat image : temp/1757423249_1299579_1382779491_9ab377a633690882eeaba7481365f9e1.jpg resize: (1080, 1632) 1382779491 -5.946854446728636 treat image : temp/1757423249_1299579_1382779489_bfc9c3f030ddd42f361ecdb91286b3fe.jpg resize: (1080, 1632) 1382779489 -5.741900665897721 treat image : temp/1757423249_1299579_1382779488_a10e4892abe526f3d71bda634325f77a.jpg resize: (1080, 1632) 1382779488 -4.59398490735216 treat image : temp/1757423249_1299579_1382779487_ec5964d4e5752396dd64a9aec5d4bf7e.jpg resize: (1080, 1632) 1382779487 -0.3277887658147915 treat image : temp/1757423249_1299579_1382779479_72fab802b51b419bea400e6dd8cf3687.jpg resize: (1080, 1632) 1382779479 -3.130846144184432 treat image : temp/1757423249_1299579_1382779475_727b4df5c4e5e73f67e11fe07c630563.jpg resize: (1080, 1632) 1382779475 -3.1481338513102988 treat image : temp/1757423249_1299579_1382779472_9a3c0dbfd3f4738a4e8735d84a44f489.jpg resize: (1080, 1632) 1382779472 -5.456497482426399 treat image : temp/1757423249_1299579_1382779468_198da8e8f3b5b5e6267136ff7cb433b6.jpg resize: (1080, 1632) 1382779468 -5.847617601988146 treat image : temp/1757423249_1299579_1382779465_4e0623265e0f4fe4d0ff5bb4fb5a9159.jpg resize: (1080, 1632) 1382779465 -5.410123168385589 treat image : temp/1757423249_1299579_1382779463_9d18072cafb78e8bdac4977923bdddc8.jpg resize: (1080, 1632) 1382779463 -4.756213689767768 treat image : temp/1757423249_1299579_1382779451_b5be18aabc9b937a4d5c352c426c2ab3.jpg resize: (1080, 1632) 1382779451 -5.946854446728636 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.014843463897705078 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.013960123062133789 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.015723466873168945 save missing photos in datou_result : time spend for datou_step_exec : 14.543050050735474 time spend to save output : 0.04970049858093262 total time spend for step 1 : 14.592750549316406 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 13.81user 2.93system 0:20.93elapsed 79%CPU (0avgtext+0avgdata 138568maxresident)k 0inputs+9632outputs (0major+263753minor)pagefaults 0swaps