python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3507218 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 564>100 please execute split_portfolio.py -i 21570233 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2678697'] with mtr_portfolio_ids : ['21570233'] and first list_photo_ids : [] new path : /proc/3507218/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.0175418853759766 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Fri Mar 21 12:42:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1742557348_3507218_1345975901_8c1cdfb1eb94796fd30be6cb0ba264df.jpg resize: (1080, 1632) 1345975901 -4.923586206172157 treat image : temp/1742557348_3507218_1345975898_c57c92df37661fd24bfc1341ce9687c5.jpg resize: (1080, 1632) 1345975898 -6.011720129560556 treat image : temp/1742557348_3507218_1345975896_7e68f7e74976093d96df61b6bbdac0b0.jpg resize: (1080, 1632) 1345975896 -3.9640405018841425 treat image : temp/1742557348_3507218_1345975894_ac9cba5dbfdab5b98d58b836ca586566.jpg resize: (1080, 1632) 1345975894 -3.249533240431232 treat image : temp/1742557348_3507218_1345975880_610353dc54af1eba51a98bf432512ab3.jpg resize: (1080, 1632) 1345975880 -5.923276439045287 treat image : temp/1742557348_3507218_1345975875_9a57317b64d9baed0ca44ece4152a883.jpg resize: (1080, 1632) 1345975875 -5.960849414207727 treat image : temp/1742557348_3507218_1345975870_e81067a5b543486c21f03d8c7b93f7f9.jpg resize: (1080, 1632) 1345975870 -2.423180310344246 treat image : temp/1742557348_3507218_1345975866_7897b99085427d7da79e7539d55330e2.jpg resize: (1080, 1632) 1345975866 -5.350435008251934 treat image : temp/1742557348_3507218_1345975864_be4264bcfae4d5d819b82ff64e1e3eee.jpg resize: (1080, 1632) 1345975864 -6.1537009214321685 treat image : temp/1742557348_3507218_1345975862_0161067fce58145c28281d2adb45c0b2.jpg resize: (1080, 1632) 1345975862 -6.104413028113901 treat image : temp/1742557348_3507218_1345975742_d82e2e72a172adadadaa5dc68623a959.jpg resize: (1080, 1632) 1345975742 -5.8847106574667185 treat image : temp/1742557348_3507218_1345975727_ff81b7bb99364c7c0bdec2a4cc7e86d2.jpg resize: (1080, 1632) 1345975727 -4.232557172357646 treat image : temp/1742557348_3507218_1345975721_e68eb502dc0ba5a65a3fac3bbc6b16d8.jpg resize: (1080, 1632) 1345975721 -4.62983965309963 treat image : temp/1742557348_3507218_1345975715_da353323a12b2ddc79d7b6307b3d25fc.jpg resize: (1080, 1632) 1345975715 -1.0610379367628688 treat image : temp/1742557348_3507218_1345975459_63f0304dc1962a30b89f3f31f9cce612.jpg resize: (1080, 1632) 1345975459 -5.656380365587073 treat image : temp/1742557348_3507218_1345975451_8717839a2cc0a0ffc600de40743d43b8.jpg resize: (1080, 1632) 1345975451 -6.138741557274743 treat image : temp/1742557348_3507218_1345975434_4275083f1cd12af7e2ffb3217ee9786e.jpg resize: (1080, 1632) 1345975434 -4.530175674314063 treat image : temp/1742557348_3507218_1345975432_cebf7228eddba1182169899545ad10d9.jpg resize: (1080, 1632) 1345975432 -5.557472695597969 treat image : temp/1742557348_3507218_1345975430_9f125e6abaabdc4365632ad4fae4c558.jpg resize: (1080, 1632) 1345975430 -2.458127993331256 treat image : temp/1742557348_3507218_1345975427_435e69a45c671bbf6628b5016dfd4b45.jpg resize: (1080, 1632) 1345975427 -1.756905084045824 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.015834331512451172 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.01579117774963379 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.014903545379638672 save missing photos in datou_result : time spend for datou_step_exec : 16.18266248703003 time spend to save output : 0.0512545108795166 total time spend for step 1 : 16.233916997909546 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.57user 4.25system 0:22.09elapsed 85%CPU (0avgtext+0avgdata 140352maxresident)k 136inputs+10088outputs (10major+252607minor)pagefaults 0swaps