python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1869607 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 3942>100 please execute split_portfolio.py -i 24702204 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3248096'] with mtr_portfolio_ids : ['24702204'] and first list_photo_ids : [] new path : /proc/1869607/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.6664111614227295 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Tue Jul 8 11:07:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1751965647_1869607_1371181895_63ae8ebeaec1d7280aabbe65f9dfb70c.jpg resize: (1080, 1632) 1371181895 -3.185694353929393 treat image : temp/1751965647_1869607_1371181770_21eaea8ad41386aae3fb0284c75bb41c.jpg resize: (1080, 1632) 1371181770 -3.368975555311552 treat image : temp/1751965647_1869607_1371181651_f10aac90803513874b6453ef7cd8afda.jpg resize: (1080, 1632) 1371181651 -3.3938331068652485 treat image : temp/1751965647_1869607_1371181507_797c01a129edca9f9bd93ca51852259a.jpg resize: (1080, 1632) 1371181507 -3.402417453411558 treat image : temp/1751965647_1869607_1371181388_33affe5a13bb3c13830d2984aeaacdf0.jpg resize: (1080, 1632) 1371181388 -3.420883282875176 treat image : temp/1751965647_1869607_1371181295_51a0a10b4cb8fbad78686d3404aafc62.jpg resize: (1080, 1632) 1371181295 -3.429071816369409 treat image : temp/1751965647_1869607_1371150432_624d873a89af9cc020c2d983946e8b56.jpg resize: (1080, 1632) 1371150432 -3.8094744534994525 treat image : temp/1751965647_1869607_1371150428_bb479a02a29b84f57332e02a3d8b72b6.jpg resize: (1080, 1632) 1371150428 -3.821299151556294 treat image : temp/1751965647_1869607_1371150423_7f23da2fe59939c2bafc90493b6ab486.jpg resize: (1080, 1632) 1371150423 -3.8267195829217706 treat image : temp/1751965647_1869607_1371150421_144bb6ceacec15755bd3499bad6ea905.jpg resize: (1080, 1632) 1371150421 -3.8255486191393064 treat image : temp/1751965647_1869607_1371150419_8f06bda2570323275bde29756a0bf7ab.jpg resize: (1080, 1632) 1371150419 -3.828845237858336 treat image : temp/1751965647_1869607_1371150418_cc04bb9213cc8456b8d97737e79fe2b3.jpg resize: (1080, 1632) 1371150418 -3.820417865001978 treat image : temp/1751965647_1869607_1371150405_07a42e0aebb00df28fa1fe9796f31870.jpg resize: (1080, 1632) 1371150405 -3.7943388595843324 treat image : temp/1751965647_1869607_1371150399_84ea99d97135d677342bc2f89dce793e.jpg resize: (1080, 1632) 1371150399 -3.7920879816600124 treat image : temp/1751965647_1869607_1371150394_e2473961cce69deba6e821abbf39e8af.jpg resize: (1080, 1632) 1371150394 -3.7968933947314043 treat image : temp/1751965647_1869607_1371150391_c31a4c02e981e9609ea3a4a92691dcd6.jpg resize: (1080, 1632) 1371150391 -3.7990786805936145 treat image : temp/1751965647_1869607_1371150389_fbaac7de023d90d5c2fa70b1a55a0735.jpg resize: (1080, 1632) 1371150389 -3.7961395149681607 treat image : temp/1751965647_1869607_1371150386_19a080e8a60fc9c14e2ac138a20cd772.jpg resize: (1080, 1632) 1371150386 -3.796907618907104 treat image : temp/1751965647_1869607_1371150377_456494d31d3932b2644a4ac835b88760.jpg resize: (1080, 1632) 1371150377 -3.754922200686382 treat image : temp/1751965647_1869607_1371150372_30dbd04c73c5fd76711454fdcc15d768.jpg resize: (1080, 1632) 1371150372 -3.7770033273740786 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.011635780334472656 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.014867305755615234 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.016109704971313477 save missing photos in datou_result : time spend for datou_step_exec : 14.20313048362732 time spend to save output : 0.047657012939453125 total time spend for step 1 : 14.250787496566772 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 13.63user 3.07system 0:20.02elapsed 83%CPU (0avgtext+0avgdata 141372maxresident)k 48inputs+7672outputs (1major+260067minor)pagefaults 0swaps