python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2177826 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 7890>100 please execute split_portfolio.py -i 24978206 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3297606'] with mtr_portfolio_ids : ['24978206'] and first list_photo_ids : [] new path : /proc/2177826/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 3.819927930831909 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Fri Jul 18 02:12:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1752797548_2177826_1372329439_a4dac39590f12e23f5ae867abf2865e7.jpg resize: (1080, 1632) 1372329439 -1.1324913115361437 treat image : temp/1752797548_2177826_1372329437_95b891564e128536308e8ace122bc2f3.jpg resize: (1080, 1632) 1372329437 -3.727180915697643 treat image : temp/1752797548_2177826_1372329434_5e3fce3a5ee3f524432baa26bd9c3232.jpg resize: (1080, 1632) 1372329434 -3.2837466304518923 treat image : temp/1752797548_2177826_1372329416_d786b7df8409318d10e168256ab30a76.jpg resize: (1080, 1632) 1372329416 -4.262031552797908 treat image : temp/1752797548_2177826_1372329413_3c906cb3751ab3b62fd87b32a3fb0270.jpg resize: (1080, 1632) 1372329413 -4.64219852302669 treat image : temp/1752797548_2177826_1372329412_d1cf047cbef7f9af1374e81bc0cccd04.jpg resize: (1080, 1632) 1372329412 -4.032209115094153 treat image : temp/1752797548_2177826_1372329410_6878ca1443157ad6635f790479ca560d.jpg resize: (1080, 1632) 1372329410 -5.625922197479278 treat image : temp/1752797548_2177826_1372329409_2d6cfd46aa41c979c9018fc4c0a274d3.jpg resize: (1080, 1632) 1372329409 -5.099120726865244 treat image : temp/1752797548_2177826_1372329407_15b4e37167637c71f3bf0d6c5c345a4e.jpg resize: (1080, 1632) 1372329407 -1.5631338390255904 treat image : temp/1752797548_2177826_1372329380_75ae35da45d762cba63139c1c2917ab3.jpg resize: (1080, 1632) 1372329380 -2.8685532349332448 treat image : temp/1752797548_2177826_1372329378_496d82949d8ae11fa6da87c8dea2c888.jpg resize: (1080, 1632) 1372329378 -4.473755417078195 treat image : temp/1752797548_2177826_1372329377_65f37c46b72d74b5b22e262edece5065.jpg resize: (1080, 1632) 1372329377 -3.549666303380531 treat image : temp/1752797548_2177826_1372329376_cfb32e09992370f333c2e6344a817e05.jpg resize: (1080, 1632) 1372329376 -5.421972700315722 treat image : temp/1752797548_2177826_1372329374_aa19233e97a64921d03cdd6ae5499367.jpg resize: (1080, 1632) 1372329374 -4.151795734784278 treat image : temp/1752797548_2177826_1372329372_2208e14a81b066fddfa2ab0b01b6d6fa.jpg resize: (1080, 1632) 1372329372 -5.06663003831313 treat image : temp/1752797548_2177826_1372329348_4cf2e8e65d6534e99add0c70b2f79a32.jpg resize: (1080, 1632) 1372329348 -3.564575161686557 treat image : temp/1752797548_2177826_1372329346_e78da9838bdf1bd9689e2d471e458d2e.jpg resize: (1080, 1632) 1372329346 -5.1754036816809394 treat image : temp/1752797548_2177826_1372329345_b20bede6d4aea7eb78494d96a9c152df.jpg resize: (1080, 1632) 1372329345 -4.056763674047687 treat image : temp/1752797548_2177826_1372329344_0ce13676564270f2d36a33b8ab5e6cff.jpg resize: (1080, 1632) 1372329344 -1.7192355578659901 treat image : temp/1752797548_2177826_1372329343_d38705e539d10fc6b2272581aa8c9c8a.jpg resize: (1080, 1632) 1372329343 -2.810577020702068 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.018743515014648438 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.016907453536987305 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.01800680160522461 save missing photos in datou_result : time spend for datou_step_exec : 15.094731092453003 time spend to save output : 0.0588529109954834 total time spend for step 1 : 15.153584003448486 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.05user 3.78system 0:23.25elapsed 76%CPU (0avgtext+0avgdata 137556maxresident)k 0inputs+8608outputs (13major+239393minor)pagefaults 0swaps