python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1717559 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 10799>100 please execute split_portfolio.py -i 24815507 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3267785'] with mtr_portfolio_ids : ['24815507'] and first list_photo_ids : [] new path : /proc/1717559/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.3464601039886475 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Sat Jul 12 06:32:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1752294747_1717559_1371800609_5702f48632f543af596a06a34982ba0c.jpg resize: (1080, 1632) 1371800609 -5.545440063203609 treat image : temp/1752294747_1717559_1371800606_72b922a1b2396432297700c2c0db1b73.jpg resize: (1080, 1632) 1371800606 -5.547028443991513 treat image : temp/1752294747_1717559_1371800602_469d1760460efc22629698836a050961.jpg resize: (1080, 1632) 1371800602 -5.540923909027584 treat image : temp/1752294747_1717559_1371800600_590a8b23f7ee37c0c296443c5592bee7.jpg resize: (1080, 1632) 1371800600 -5.54645904885399 treat image : temp/1752294747_1717559_1371800596_a2eed29a794f450570ea1543e96adefe.jpg resize: (1080, 1632) 1371800596 -5.531445435782583 treat image : temp/1752294747_1717559_1371800591_022a10aef2ecdad799720969d2bd6a4f.jpg resize: (1080, 1632) 1371800591 -5.5344611536255375 treat image : temp/1752294747_1717559_1371800587_887a1280b101cc1957837384bb704102.jpg resize: (1080, 1632) 1371800587 -5.528324051870781 treat image : temp/1752294747_1717559_1371800586_88ca09dee6d99986dec9893d0771d35a.jpg resize: (1080, 1632) 1371800586 -5.535580160761824 treat image : temp/1752294747_1717559_1371800585_191ee8a39dc081fe58f927c99a0d7c5f.jpg resize: (1080, 1632) 1371800585 -5.531308092056348 treat image : temp/1752294747_1717559_1371800584_e26f517d1c5468388f629c45dc773702.jpg resize: (1080, 1632) 1371800584 -5.522540061088403 treat image : temp/1752294747_1717559_1371800581_787bde7ac2b6fc9ef58cc66bb24092b9.jpg resize: (1080, 1632) 1371800581 -5.536702529324866 treat image : temp/1752294747_1717559_1371800578_8d8b6e11c0e10b66ef1ac2f82f397ae5.jpg resize: (1080, 1632) 1371800578 -5.5474939963801635 treat image : temp/1752294747_1717559_1371800564_c44af3b29c095418d007dce9b45b7547.jpg resize: (1080, 1632) 1371800564 -5.533146721442672 treat image : temp/1752294747_1717559_1371800563_c0958ef3f85287b1f9f170c2d388e087.jpg resize: (1080, 1632) 1371800563 -5.533146721442672 treat image : temp/1752294747_1717559_1371800561_331635e68e4c581887769a4148de5a32.jpg resize: (1080, 1632) 1371800561 -5.543658037600934 treat image : temp/1752294747_1717559_1371800559_d7d35f215be5f9cf3bd3a9723cd863f2.jpg resize: (1080, 1632) 1371800559 -5.543658037600934 treat image : temp/1752294747_1717559_1371800554_edad5e67e345edeeaec135844b43da0e.jpg resize: (1080, 1632) 1371800554 -5.529403055667174 treat image : temp/1752294747_1717559_1371800553_06a7b18073f444784cd1553b45c886d3.jpg resize: (1080, 1632) 1371800553 -5.529403055667174 treat image : temp/1752294747_1717559_1371800543_7e8385a666007e0453d83aa83f51fffc.jpg resize: (1080, 1632) 1371800543 -5.5365594553932045 treat image : temp/1752294747_1717559_1371800537_0e59b342d7e7e64ac38f2dcd89acfd52.jpg resize: (1080, 1632) 1371800537 -5.5365594553932045 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.015796184539794922 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.01483607292175293 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.015978336334228516 save missing photos in datou_result : time spend for datou_step_exec : 14.831387519836426 time spend to save output : 0.0511019229888916 total time spend for step 1 : 14.882489442825317 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.04user 3.38system 0:19.46elapsed 89%CPU (0avgtext+0avgdata 139072maxresident)k 0inputs+10584outputs (12major+255743minor)pagefaults 0swaps