import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1973894 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 793>100 please execute split_portfolio.py -i 23034647 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2869780'] with mtr_portfolio_ids : ['23034647'] and first list_photo_ids : [] new path : /proc/1973894/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.377403736114502 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Fri May 16 03:42:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1747359746_1973894_1358764506_ffc18f1e3c2508f895aa7e0dbf4591f3.jpg resize: (1080, 1632) 1358764506 -5.41574750514542 treat image : temp/1747359746_1973894_1358764481_9f00b9d787481f7487fb15eca52e0774.jpg resize: (1080, 1632) 1358764481 -5.585243824251619 treat image : temp/1747359746_1973894_1358764479_bb16f3642d3f67eb65504d5e6841565d.jpg resize: (1080, 1632) 1358764479 -5.4254305697021055 treat image : temp/1747359746_1973894_1358764472_7d41b6a8afe013434c7dabd1fd31fb6e.jpg resize: (1080, 1632) 1358764472 -5.076329588427736 treat image : temp/1747359746_1973894_1358764162_926c48a53f42e27b6bcc608ebff72ab8.jpg resize: (1080, 1632) 1358764162 -5.5218636425160685 treat image : temp/1747359746_1973894_1358764112_80a5099ef25872a8e85dd788bef8d00d.jpg resize: (1080, 1632) 1358764112 -5.226846369453809 treat image : temp/1747359746_1973894_1358764052_8845db40146e216758e7753371b5c206.jpg resize: (1080, 1632) 1358764052 -5.55463482116808 treat image : temp/1747359746_1973894_1358764015_3d2f158dcae00db3825b3b9049e5efb0.jpg resize: (1080, 1632) 1358764015 -5.538696482485069 treat image : temp/1747359746_1973894_1358763963_9597df667b65af9e704937346b079789.jpg resize: (1080, 1632) 1358763963 -5.55271187542178 treat image : temp/1747359746_1973894_1358763337_02a8256fb8de16a6200b174e7589d791.jpg resize: (1080, 1632) 1358763337 -1.5903867251437342 treat image : temp/1747359746_1973894_1358763257_2ff27c564c3064b7d8aed15627fbbf61.jpg resize: (1080, 1632) 1358763257 -3.6140402853924143 treat image : temp/1747359746_1973894_1358763188_547544e2bcfbfeb6146006a61e3d32ba.jpg resize: (1080, 1632) 1358763188 -3.734558510426303 treat image : temp/1747359746_1973894_1358763136_5450019c89317b24a739a61c65a2bf12.jpg resize: (1080, 1632) 1358763136 -5.2103216988248215 treat image : temp/1747359746_1973894_1358763088_4f62d8242663eba22bbbbcf8473067da.jpg resize: (1080, 1632) 1358763088 -5.663169071308956 treat image : temp/1747359746_1973894_1358762563_18876ac064ef5b05ad169bf018239aa4.jpg resize: (1080, 1632) 1358762563 -6.0837805303351145 treat image : temp/1747359746_1973894_1358762491_550810c74aeec8a5333dec7e87e4e3c4.jpg resize: (1080, 1632) 1358762491 -4.809056050947157 treat image : temp/1747359746_1973894_1358761786_e2bc649c8d3a0c8edf2403e433c78a52.jpg resize: (1080, 1632) 1358761786 -5.635562093857691 treat image : temp/1747359746_1973894_1358761726_87342186b01b77378a2b8012cfc93581.jpg resize: (1080, 1632) 1358761726 -5.739672509474809 treat image : temp/1747359746_1973894_1358761673_4172d23f0a837f08e219ce9b8e739499.jpg resize: (1080, 1632) 1358761673 -5.479016972698455 treat image : temp/1747359746_1973894_1358761630_fdab5a216b4eea56ca8d67b7d9351174.jpg resize: (1080, 1632) 1358761630 -5.794414369653452 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.012509346008300781 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.014007329940795898 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.015931129455566406 save missing photos in datou_result : time spend for datou_step_exec : 16.197934865951538 time spend to save output : 0.047250986099243164 total time spend for step 1 : 16.24518585205078 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.79user 3.91system 0:21.16elapsed 88%CPU (0avgtext+0avgdata 142240maxresident)k 1264inputs+9992outputs (40major+259285minor)pagefaults 0swaps