python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1973399 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 5218>100 please execute split_portfolio.py -i 24580131 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3234427'] with mtr_portfolio_ids : ['24580131'] and first list_photo_ids : [] new path : /proc/1973399/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.327531099319458 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Fri Jul 4 19:02:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1751648548_1973399_1370677043_4209decdd1073d00775bc4a6d1120f38.jpg resize: (1080, 1632) 1370677043 -5.9933946607212185 treat image : temp/1751648548_1973399_1370677033_18b1d41d8345f5d55cc195611c2c54fb.jpg resize: (1080, 1632) 1370677033 -5.9933946607212185 treat image : temp/1751648548_1973399_1370676988_31eded0e8761e3c4606a33ce863eb397.jpg resize: (1080, 1632) 1370676988 -5.238410742618205 treat image : temp/1751648548_1973399_1370676981_af9babf139b7dd6b7cc3a31bb7f8b984.jpg resize: (1080, 1632) 1370676981 -5.238410742618205 treat image : temp/1751648548_1973399_1370676949_03b50eb638083207c3b1eab822167af9.jpg resize: (1080, 1632) 1370676949 -4.7395992171223345 treat image : temp/1751648548_1973399_1370676945_889f6b8e72afd4f1492a2c546dc1e909.jpg resize: (1080, 1632) 1370676945 -4.7395992171223345 treat image : temp/1751648548_1973399_1370676908_3e50da01ac5d223fa06e35dc5c1a65ce.jpg resize: (1080, 1632) 1370676908 -4.64192361832152 treat image : temp/1751648548_1973399_1370676904_624da1408d2b81542431735bb6167aae.jpg resize: (1080, 1632) 1370676904 -4.64192361832152 treat image : temp/1751648548_1973399_1370676871_25057ee0c418541e09f8736856151399.jpg resize: (1080, 1632) 1370676871 -5.276340510181349 treat image : temp/1751648548_1973399_1370676867_61eefad25ef9fb68f3635564c88396c8.jpg resize: (1080, 1632) 1370676867 -5.276340510181349 treat image : temp/1751648548_1973399_1370676832_a5e0c806a8000c72767c9552ffd7c9c9.jpg resize: (1080, 1632) 1370676832 -3.3049159967828596 treat image : temp/1751648548_1973399_1370676830_6ec9240c93b87189fcda5e916c613d49.jpg resize: (1080, 1632) 1370676830 -3.3049159967828596 treat image : temp/1751648548_1973399_1370676679_6b96b7507681b439731151e46556d544.jpg resize: (1080, 1632) 1370676679 -4.411257013964941 treat image : temp/1751648548_1973399_1370676608_dc24707527612926643d85d14b044e4d.jpg resize: (1080, 1632) 1370676608 -5.745237908562738 treat image : temp/1751648548_1973399_1370676542_c012c0fdf68897ef2b87174c7be3df35.jpg resize: (1080, 1632) 1370676542 -5.791361407293911 treat image : temp/1751648548_1973399_1370676502_ce6d447f98ba5440ffb14be0e93cb1a4.jpg resize: (1080, 1632) 1370676502 -5.403645122519459 treat image : temp/1751648548_1973399_1370676432_acfda2eebd60a3fbc35d42736656bd4e.jpg resize: (1080, 1632) 1370676432 -5.381377859584907 treat image : temp/1751648548_1973399_1370676354_9018521210957e5607b7f81a43692d0f.jpg resize: (1080, 1632) 1370676354 -3.4890871326268385 treat image : temp/1751648548_1973399_1370676106_1560dbd590c5732ff90b859668cc4af4.jpg resize: (1080, 1632) 1370676106 -4.6716608016748005 treat image : temp/1751648548_1973399_1370676031_f7ba7d2f0a6e07000566c4e350d3e419.jpg resize: (1080, 1632) 1370676031 -5.5524306658893074 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.012532472610473633 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.011959314346313477 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.014731168746948242 save missing photos in datou_result : time spend for datou_step_exec : 16.370551586151123 time spend to save output : 0.04392385482788086 total time spend for step 1 : 16.414475440979004 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 13.89user 4.61system 0:22.27elapsed 83%CPU (0avgtext+0avgdata 137008maxresident)k 144inputs+9952outputs (4major+263564minor)pagefaults 0swaps