python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3182579 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 2195>100 please execute split_portfolio.py -i 22899558 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2832080'] with mtr_portfolio_ids : ['22899558'] and first list_photo_ids : [] new path : /proc/3182579/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.2529754638671875 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Tue May 13 15:32:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1747143149_3182579_1357858264_a5f4ceb265ac89bd9975dfc0f6c4837e.jpg resize: (1080, 1632) 1357858264 -5.8518661173299344 treat image : temp/1747143149_3182579_1357858260_7af7c4fe748c5324c5cc3b6c963a5ec9.jpg resize: (1080, 1632) 1357858260 -5.071647177195573 treat image : temp/1747143149_3182579_1357858257_a83d670332aecddc36a0fe8fc7335a5d.jpg resize: (1080, 1632) 1357858257 -5.073337766670256 treat image : temp/1747143149_3182579_1357858255_5be0ec8d76e658a0dfa9aa6cc862aa27.jpg resize: (1080, 1632) 1357858255 -4.352579145494497 treat image : temp/1747143149_3182579_1357858252_e73e8228d05a861b8a0b771fce0e7a38.jpg resize: (1080, 1632) 1357858252 -5.880757428953472 treat image : temp/1747143149_3182579_1357858218_0aa7a99974cb6adacd547948cfcd2149.jpg resize: (1080, 1632) 1357858218 -0.8253156270263243 treat image : temp/1747143149_3182579_1357858214_ccc8877552cd0f2d2bcd68e948369b22.jpg resize: (1080, 1632) 1357858214 -2.399747409288383 treat image : temp/1747143149_3182579_1357858211_0de3d3e9795d312224a3e7af3884fad5.jpg resize: (1080, 1632) 1357858211 -2.551962037204609 treat image : temp/1747143149_3182579_1357858208_7f3bfe820ee882d42cbc06af6587a177.jpg resize: (1080, 1632) 1357858208 -5.558903017762044 treat image : temp/1747143149_3182579_1357858204_311861e7cba288382832550b5f0d3901.jpg resize: (1080, 1632) 1357858204 -5.999668169090992 treat image : temp/1747143149_3182579_1357858163_ceb6d2c8ca9c79f94fc6061834b03d2f.jpg resize: (1080, 1632) 1357858163 -5.216661133630378 treat image : temp/1747143149_3182579_1357858161_31e1a90f370f66a233ba8a29de8739fb.jpg resize: (1080, 1632) 1357858161 -5.318569115393849 treat image : temp/1747143149_3182579_1357858159_2502ffe27a03d06a5ba7443fa00dd1c3.jpg resize: (1080, 1632) 1357858159 -3.163641504329863 treat image : temp/1747143149_3182579_1357858156_d2c2302b2da75a7cac4a0b4e74dcc756.jpg resize: (1080, 1632) 1357858156 -5.3102811153370615 treat image : temp/1747143149_3182579_1357858015_0776e43b325f530cd301c647aeaeedc6.jpg resize: (1080, 1632) 1357858015 -6.037136381877633 treat image : temp/1747143149_3182579_1357857999_33a61d25f5931e5e0c5333ee7a83e692.jpg resize: (1080, 1632) 1357857999 -3.2102296309458165 treat image : temp/1747143149_3182579_1357857994_50ede03d452d7f93d7d2102587919279.jpg resize: (1080, 1632) 1357857994 -3.607565493742875 treat image : temp/1747143149_3182579_1357857991_09e6d92c6df758e32b850eca260d2305.jpg resize: (1080, 1632) 1357857991 -5.0102718917366085 treat image : temp/1747143149_3182579_1357857989_02e87a2975dea946f1e0adc8361c1ef4.jpg resize: (1080, 1632) 1357857989 -3.486034596371906 treat image : temp/1747143149_3182579_1357857986_bb14c15d0ec099db45b04547708fdfa8.jpg resize: (1080, 1632) 1357857986 -5.332141041598152 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.013572216033935547 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.011968612670898438 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.014903545379638672 save missing photos in datou_result : time spend for datou_step_exec : 17.069674491882324 time spend to save output : 0.046762704849243164 total time spend for step 1 : 17.116437196731567 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 15.38user 4.57system 0:23.26elapsed 85%CPU (0avgtext+0avgdata 140892maxresident)k 10448inputs+9656outputs (70major+261234minor)pagefaults 0swaps