python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3084926 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 2558>100 please execute split_portfolio.py -i 23145313 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2900260'] with mtr_portfolio_ids : ['23145313'] and first list_photo_ids : [] new path : /proc/3084926/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.2463786602020264 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Tue May 20 16:37:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1747751848_3084926_1359825963_588974a256c8c27b3b1c64b4be0ed2dd.jpg resize: (1080, 1632) 1359825963 -5.127766748194787 treat image : temp/1747751848_3084926_1359825960_6fb6875feef67a8ba340b9bdf8ffb96f.jpg resize: (1080, 1632) 1359825960 -4.987369154936844 treat image : temp/1747751848_3084926_1359825957_96b5156dc7685741947d4d57f42fc496.jpg resize: (1080, 1632) 1359825957 -4.666801177771706 treat image : temp/1747751848_3084926_1359825955_d73be4921144639573ce20e77e09db51.jpg resize: (1080, 1632) 1359825955 -4.772006207071252 treat image : temp/1747751848_3084926_1359825578_02f9e4ea24188d3a249afc9db8e1f774.jpg resize: (1080, 1632) 1359825578 -1.3868804076329464 treat image : temp/1747751848_3084926_1359825527_293f245d610e440e8cde8629401cdfa6.jpg resize: (1080, 1632) 1359825527 -2.9539887388165167 treat image : temp/1747751848_3084926_1359825433_e659467b33d1c87c44d074aafe33e9eb.jpg resize: (1080, 1632) 1359825433 -3.4969717396618054 treat image : temp/1747751848_3084926_1359825297_29c8da959aef94ce78a2dc9d009927df.jpg resize: (1080, 1632) 1359825297 -5.189951327382071 treat image : temp/1747751848_3084926_1359825116_cd5d8d90da6e657269c6fd5cfc227abe.jpg resize: (1080, 1632) 1359825116 -4.720028232550969 treat image : temp/1747751848_3084926_1359825113_8632be6d46e0c2bcd0d8951a17c124d0.jpg resize: (1080, 1632) 1359825113 -6.119755738895133 treat image : temp/1747751848_3084926_1359825111_34bae12c99736cc831edd909479ca4c4.jpg resize: (1080, 1632) 1359825111 -5.952299876650781 treat image : temp/1747751848_3084926_1359825108_06910f7ac97805b02f28c9244b2e6609.jpg resize: (1080, 1632) 1359825108 -4.908646214710572 treat image : temp/1747751848_3084926_1359825104_df662252541726283d38885eef10d808.jpg resize: (1080, 1632) 1359825104 -5.744908306597715 treat image : temp/1747751848_3084926_1359825091_55c8fc8458d6bd89db1b355276769e2f.jpg resize: (1080, 1632) 1359825091 -6.072752284486535 treat image : temp/1747751848_3084926_1359825054_7eedb2a477d903c82a3db933760adf06.jpg resize: (1080, 1632) 1359825054 -5.961308493329226 treat image : temp/1747751848_3084926_1359825050_e1f293a7ceb1f38f87545b087a3de774.jpg resize: (1080, 1632) 1359825050 -4.550601794919203 treat image : temp/1747751848_3084926_1359825045_45431649fb04449c6b9887f8eb9bbf0c.jpg resize: (1080, 1632) 1359825045 -5.836278528211759 treat image : temp/1747751848_3084926_1359825040_ac8909aa0335f5f955902a2db8f83a19.jpg resize: (1080, 1632) 1359825040 -5.869579783729848 treat image : temp/1747751848_3084926_1359825035_1127dd9e7dee4653429d6b72d9891b1b.jpg resize: (1080, 1632) 1359825035 -5.990264504668784 treat image : temp/1747751848_3084926_1359825031_a23030f4ce2ca95c16fbb51bf79cdf68.jpg resize: (1080, 1632) 1359825031 -6.0003642861243955 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.012358427047729492 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.01294708251953125 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.014747142791748047 save missing photos in datou_result : time spend for datou_step_exec : 18.566760301589966 time spend to save output : 0.0449678897857666 total time spend for step 1 : 18.611728191375732 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 15.35user 5.57system 0:25.13elapsed 83%CPU (0avgtext+0avgdata 140664maxresident)k 248inputs+10288outputs (3major+262759minor)pagefaults 0swaps