python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3722820 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 2431>100 please execute split_portfolio.py -i 21715706 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2691079'] with mtr_portfolio_ids : ['21715706'] and first list_photo_ids : [] new path : /proc/3722820/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.6879079341888428 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Wed Mar 26 17:17:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1743005850_3722820_1347545033_89bbd3ee39cbe41046203ecd43f6c7ba.jpg resize: (1080, 1632) 1347545033 -4.578128937018359 treat image : temp/1743005850_3722820_1347545029_657d5a5da40657fa538aa7897e451f67.jpg resize: (1080, 1632) 1347545029 -5.797158034423012 treat image : temp/1743005850_3722820_1347545027_c91525b112fe9f0626c70ea410238efa.jpg resize: (1080, 1632) 1347545027 -5.292479538974311 treat image : temp/1743005850_3722820_1347545024_fb93f2ef976f51b37d5db58bd3e069b0.jpg resize: (1080, 1632) 1347545024 -2.375723963604648 treat image : temp/1743005850_3722820_1347544950_42cc840945041b66734b1d37160bf48c.jpg resize: (1080, 1632) 1347544950 -3.753918286146171 treat image : temp/1743005850_3722820_1347544944_97d15bb507956b45e5407644d7a05791.jpg resize: (1080, 1632) 1347544944 -3.9503599104035803 treat image : temp/1743005850_3722820_1347544942_929da8bcdce62a099f6371144ec421d2.jpg resize: (1080, 1632) 1347544942 -3.2065916988198278 treat image : temp/1743005850_3722820_1347544919_aff7bf2d141541167c913c1676f0351a.jpg resize: (1080, 1632) 1347544919 -4.2120376516094735 treat image : temp/1743005850_3722820_1347544872_942ba7756e6c88c5ab0faff590a0ccfa.jpg resize: (1080, 1632) 1347544872 -4.842241378994915 treat image : temp/1743005850_3722820_1347544868_096da70ff417ba79270eeb4cf4969851.jpg resize: (1080, 1632) 1347544868 -4.262571706535832 treat image : temp/1743005850_3722820_1347456102_12bef6eec5937d18ff8ce9826ac25b28.jpg resize: (1080, 1632) 1347456102 -5.276775879566058 treat image : temp/1743005850_3722820_1347456064_599c140e2779b27483d15ab00e871a3b.jpg resize: (1080, 1632) 1347456064 -5.444179148417633 treat image : temp/1743005850_3722820_1347456056_b2d4ad6227a5a7b55b11de06e07f928a.jpg resize: (1080, 1632) 1347456056 -3.4367283986468133 treat image : temp/1743005850_3722820_1347456053_53af5614304397f91d6bf7f2977a7a6c.jpg resize: (1080, 1632) 1347456053 -5.390998032297438 treat image : temp/1743005850_3722820_1347456049_05e500627b2314f08aa81bb5e8fc60fe.jpg resize: (1080, 1632) 1347456049 -5.295031809514499 treat image : temp/1743005850_3722820_1347456008_11179c31a7615249361cbb6ab2d7fa8a.jpg resize: (1080, 1632) 1347456008 -4.257623642964658 treat image : temp/1743005850_3722820_1347456004_bfb996312814c95af7416273ea7fa708.jpg resize: (1080, 1632) 1347456004 -5.240106650606301 treat image : temp/1743005850_3722820_1347455999_ecc67954b6220b560a1019b9c4b221c0.jpg resize: (1080, 1632) 1347455999 -4.847601343370931 treat image : temp/1743005850_3722820_1347455957_40118ba2262024db4d841346f9605013.jpg resize: (1080, 1632) 1347455957 -3.0156111708748092 treat image : temp/1743005850_3722820_1347455953_417897fd9e53f2dca863e66ffcbe4144.jpg resize: (1080, 1632) 1347455953 -1.2362904629481932 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.015773773193359375 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.014962911605834961 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.017134666442871094 save missing photos in datou_result : time spend for datou_step_exec : 15.33863377571106 time spend to save output : 0.05220508575439453 total time spend for step 1 : 15.390838861465454 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.63user 3.71system 0:22.33elapsed 82%CPU (0avgtext+0avgdata 136920maxresident)k 128inputs+9312outputs (4major+260031minor)pagefaults 0swaps