python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 476000 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 287>100 please execute split_portfolio.py -i 22899558 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2832080'] with mtr_portfolio_ids : ['22899558'] and first list_photo_ids : [] new path : /proc/476000/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.3952836990356445 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Tue May 13 01:37:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1747093047_476000_1357757338_e70e0761358768bfddf1f9c24270c558.jpg resize: (1080, 1632) 1357757338 -3.1134143245820023 treat image : temp/1747093047_476000_1357757336_477bde130545b0f3f81f08edb2282049.jpg resize: (1080, 1632) 1357757336 -3.5950724565125287 treat image : temp/1747093047_476000_1357757335_f3db39565c09d5e21dec2abe721ee4f1.jpg resize: (1080, 1632) 1357757335 -4.0352544680608124 treat image : temp/1747093047_476000_1357757333_bcb1acaebf55186691c24432abae2e24.jpg resize: (1080, 1632) 1357757333 -5.971018294348301 treat image : temp/1747093047_476000_1357757325_81e625cb72d6e742eb418924bf0f1656.jpg resize: (1080, 1632) 1357757325 -5.729909605170848 treat image : temp/1747093047_476000_1357757298_198e8b46323564cd42dc60327eeeb3e3.jpg resize: (1080, 1632) 1357757298 -2.1269626360784577 treat image : temp/1747093047_476000_1357757296_63b03e0a41a413e4672b00f13380578a.jpg resize: (1080, 1632) 1357757296 -2.5910204202356626 treat image : temp/1747093047_476000_1357757295_479a8c546dac339c83f4636fce4b9e8b.jpg resize: (1080, 1632) 1357757295 -1.3371811740616442 treat image : temp/1747093047_476000_1357757294_787f78e49086eed5841489dab496afab.jpg resize: (1080, 1632) 1357757294 -3.5089480085453344 treat image : temp/1747093047_476000_1357757293_aa8444747b9bf3e13476385087a98ef4.jpg resize: (1080, 1632) 1357757293 -5.5280624085064956 treat image : temp/1747093047_476000_1357757270_8f034e53d6709ad27fa580f7d63153ba.jpg resize: (1080, 1632) 1357757270 -3.8335182689689913 treat image : temp/1747093047_476000_1357757269_e0dcabb67c13a4162a6a790bd51de244.jpg resize: (1080, 1632) 1357757269 -4.292640926834097 treat image : temp/1747093047_476000_1357757267_11b48f310314a61f1c1e1fdbc28143cf.jpg resize: (1080, 1632) 1357757267 -6.001260344813765 treat image : temp/1747093047_476000_1357757266_4ef119e622f6dbad17f6c70c79166a7f.jpg resize: (1080, 1632) 1357757266 -6.257236607857927 treat image : temp/1747093047_476000_1357757264_582c5a490656bcaefeacf943fe0ac1b4.jpg resize: (1080, 1632) 1357757264 -4.181009558749813 treat image : temp/1747093047_476000_1357757263_32435f2b17d6282b8da4f8206c3966b4.jpg resize: (1080, 1632) 1357757263 -0.18477856211843316 treat image : temp/1747093047_476000_1357757238_a10ac71254b947c17d1092121353b2f8.jpg resize: (1080, 1632) 1357757238 -5.736108033620569 treat image : temp/1747093047_476000_1357757237_d4daf2367d62c83cb98ef7fea1d63523.jpg resize: (1080, 1632) 1357757237 -5.693523662996337 treat image : temp/1747093047_476000_1357757236_59e840f3b44fd311ec87eebe062ea678.jpg resize: (1080, 1632) 1357757236 -4.756280713242221 treat image : temp/1747093047_476000_1357757234_0ac756c4ced70a607e6500d1f5b3f120.jpg resize: (1080, 1632) 1357757234 -5.761092308790626 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.03939008712768555 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.29589390754699707 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.28600168228149414 save missing photos in datou_result : time spend for datou_step_exec : 15.029821872711182 time spend to save output : 0.626946210861206 total time spend for step 1 : 15.656768083572388 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 13.95user 3.66system 0:21.31elapsed 82%CPU (0avgtext+0avgdata 140368maxresident)k 152inputs+9640outputs (13major+260257minor)pagefaults 0swaps