python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 981566 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 441>100 please execute split_portfolio.py -i 22870033 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2818969'] with mtr_portfolio_ids : ['22870033'] and first list_photo_ids : [] new path : /proc/981566/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.26318097114563 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Mon May 12 06:47:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1747025248_981566_1357600146_37f6d8eca6c66de8fcae06c44b4c5323.jpg resize: (1080, 1632) 1357600146 -2.8537094178376763 treat image : temp/1747025248_981566_1357600144_8347f8acbdbd88260bfee9bec06a99d8.jpg resize: (1080, 1632) 1357600144 -3.3417934086446905 treat image : temp/1747025248_981566_1357600143_d9516ca57f2f0f87ff44fe817049e1ca.jpg resize: (1080, 1632) 1357600143 -4.683306317140741 treat image : temp/1747025248_981566_1357600115_1d79e5b566cbe2b74d93cf2d03e4c16b.jpg resize: (1080, 1632) 1357600115 -5.103800591081171 treat image : temp/1747025248_981566_1357600113_9344bc5c3ab94e2210d66098508e3589.jpg resize: (1080, 1632) 1357600113 -2.9683817472432237 treat image : temp/1747025248_981566_1357600110_649ae822aad6acc848d8ee846c6b5c33.jpg resize: (1080, 1632) 1357600110 -1.4473496372385055 treat image : temp/1747025248_981566_1357600106_30c056b499c454722024191452666c46.jpg resize: (1080, 1632) 1357600106 -3.2926696929775408 treat image : temp/1747025248_981566_1357600078_783bcc36d1bf9d364ef4cc3d96c02586.jpg resize: (1080, 1632) 1357600078 -5.3404093176173335 treat image : temp/1747025248_981566_1357600076_5300be83b97eae41e06c653ee2a9dd73.jpg resize: (1080, 1632) 1357600076 -5.413524284072913 treat image : temp/1747025248_981566_1357600074_8859dd8a3f8a189b110477a30a246444.jpg resize: (1080, 1632) 1357600074 -5.193365280870528 treat image : temp/1747025248_981566_1357600072_13166f2e41a239d66becefa8ee77b3a0.jpg resize: (1080, 1632) 1357600072 -5.056041849903776 treat image : temp/1747025248_981566_1357600070_69c78d973c3b08519bb69d9f821f1e5d.jpg resize: (1080, 1632) 1357600070 -3.2194175836335117 treat image : temp/1747025248_981566_1357600031_74fcccf6b777c9fe66aee7e8c5983916.jpg resize: (1080, 1632) 1357600031 -3.712964416451796 treat image : temp/1747025248_981566_1357600030_bccaa9c22f2dbf1c8eb7e421da9d489c.jpg resize: (1080, 1632) 1357600030 -4.767384836550566 treat image : temp/1747025248_981566_1357600027_5b16741c8baac958220ced5f9297cb36.jpg resize: (1080, 1632) 1357600027 -3.566773190309719 treat image : temp/1747025248_981566_1357600026_f5be71f1b8b10591947264293146cbdc.jpg resize: (1080, 1632) 1357600026 -3.7251932408069504 treat image : temp/1747025248_981566_1357600025_084c8a08f979057a8ce12e103181799f.jpg resize: (1080, 1632) 1357600025 -4.862952298525589 treat image : temp/1747025248_981566_1357600023_a7f64db482365ef6faaa3cb75b9c3ad1.jpg resize: (1080, 1632) 1357600023 -4.6191968517493 treat image : temp/1747025248_981566_1357599781_58183c854c41aa021be366f0bc485174.jpg resize: (1080, 1632) 1357599781 -6.18880458492246 treat image : temp/1747025248_981566_1357599779_cbaa5530bc9783899b4d907d07150f67.jpg resize: (1080, 1632) 1357599779 -6.273709345836589 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.013765573501586914 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.012843847274780273 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.014794111251831055 save missing photos in datou_result : time spend for datou_step_exec : 21.656574010849 time spend to save output : 0.04625439643859863 total time spend for step 1 : 21.702828407287598 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.35user 10.08system 0:27.90elapsed 87%CPU (0avgtext+0avgdata 140612maxresident)k 160inputs+8904outputs (0major+264600minor)pagefaults 0swaps