python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3168648 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 3749>100 please execute split_portfolio.py -i 21089077 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2640530'] with mtr_portfolio_ids : ['21089077'] and first list_photo_ids : [] new path : /proc/3168648/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.322885751724243 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Thu Mar 6 19:37:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1741286248_3168648_1341288418_5d20e2cac8e5b640a0d2591e4c0e7ac5.jpg resize: (1080, 1632) 1341288418 -3.662012689244054 treat image : temp/1741286248_3168648_1341287523_ab3574753dbde421da2c2746e643be6c.jpg resize: (1080, 1632) 1341287523 -6.484958586588107 treat image : temp/1741286248_3168648_1341287422_9cd79bd1e117779af29129fedb93bf4e.jpg resize: (1080, 1632) 1341287422 -6.319336577857679 treat image : temp/1741286248_3168648_1341287332_1af9fb77da3c5f781d934c945973b28c.jpg resize: (1080, 1632) 1341287332 -6.307992543611567 treat image : temp/1741286248_3168648_1341287296_4e660da28d178f48a9a338f1dbffc2d1.jpg resize: (1080, 1632) 1341287296 -5.982599693357321 treat image : temp/1741286248_3168648_1341287294_7ce225c14e240aed978f0e3a48be6419.jpg resize: (1080, 1632) 1341287294 -5.667850979821435 treat image : temp/1741286248_3168648_1341269824_d172ef6c70d81f40f5bb217e2f70af59.jpg resize: (1080, 1632) 1341269824 -5.632324151285355 treat image : temp/1741286248_3168648_1341269820_4a31ec996dc066e8e58d69d15ca7349c.jpg resize: (1080, 1632) 1341269820 -5.327234999615785 treat image : temp/1741286248_3168648_1341269813_fc51e404a093867ee69f8cdd62ce0abd.jpg resize: (1080, 1632) 1341269813 -5.873164963914174 treat image : temp/1741286248_3168648_1341269810_c1fdceb9d948e121220842c6efe8cf42.jpg resize: (1080, 1632) 1341269810 -5.704979083300509 treat image : temp/1741286248_3168648_1341269804_1e6c256bc6f2fbcdcaa06bd3b2f45b6a.jpg resize: (1080, 1632) 1341269804 -4.334580404431663 treat image : temp/1741286248_3168648_1341269798_4b0e1d29c86f9323ce2831b999b5176e.jpg resize: (1080, 1632) 1341269798 -2.379692079581459 treat image : temp/1741286248_3168648_1341269795_5c52f8459264f0de9502aa26c63d8dfa.jpg resize: (1080, 1632) 1341269795 -2.468925650448967 treat image : temp/1741286248_3168648_1341269788_47e6d4b787267e8994e862b281ec7a82.jpg resize: (1080, 1632) 1341269788 -5.599874492540766 treat image : temp/1741286248_3168648_1341268524_2591c6e698b078e045d7c053b85b339b.jpg resize: (1080, 1632) 1341268524 -2.4440388783942724 treat image : temp/1741286248_3168648_1341268522_22dae4e62647a8fcbabd09c00ee67261.jpg resize: (1080, 1632) 1341268522 -2.4440388783942724 treat image : temp/1741286248_3168648_1341268521_92214e3621f4299ca87f7113d618806d.jpg resize: (1080, 1632) 1341268521 -2.588978785105648 treat image : temp/1741286248_3168648_1341268519_3dc776531e791fb7e2e5d21c2aa13414.jpg resize: (1080, 1632) 1341268519 -2.588978785105648 treat image : temp/1741286248_3168648_1341268514_d41c2b8ec3e4ff20629eb26926fe2b6a.jpg resize: (1080, 1632) 1341268514 -3.175963720717867 treat image : temp/1741286248_3168648_1341268512_0670692cda8a35a6003de995b31c8b5e.jpg resize: (1080, 1632) 1341268512 -3.175963720717867 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.014808177947998047 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.01438140869140625 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.01578211784362793 save missing photos in datou_result : time spend for datou_step_exec : 15.378971338272095 time spend to save output : 0.0497896671295166 total time spend for step 1 : 15.428761005401611 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.93user 2.95system 0:21.17elapsed 84%CPU (0avgtext+0avgdata 139500maxresident)k 2936inputs+9584outputs (35major+188475minor)pagefaults 0swaps