python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3183620 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 1482>100 please execute split_portfolio.py -i 25384748 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3365701'] with mtr_portfolio_ids : ['25384748'] and first list_photo_ids : [] new path : /proc/3183620/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 16 ; length of list_pids : 16 ; length of list_args : 16 time to download the photos : 1.772334337234497 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Mon Jul 28 09:37:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1753688248_3183620_1374113010_ea65c51b0fd123307ab0093255fab58b.jpg resize: (1080, 1632) 1374113010 -5.748271177328466 treat image : temp/1753688248_3183620_1374113007_380496d241ea9799968c0dc4180be1b8.jpg resize: (1080, 1632) 1374113007 -5.64163059586675 treat image : temp/1753688248_3183620_1374113006_09ef38303b053c35e93e4c8fef602acb.jpg resize: (1080, 1632) 1374113006 -5.135805247827518 treat image : temp/1753688248_3183620_1374113005_a34b50e333b672e2710a476e15e970b8.jpg resize: (1080, 1632) 1374113005 -5.182821065561049 treat image : temp/1753688248_3183620_1374113004_55c6cfc8e2f4ff55f7be2087d7abc5b6.jpg resize: (1080, 1632) 1374113004 -5.504823715028594 treat image : temp/1753688248_3183620_1374113003_dcc73533e068929b349643b095820411.jpg resize: (1080, 1632) 1374113003 -5.704508597438233 treat image : temp/1753688248_3183620_1374112983_3aa637142d0e4bf80a06ddb7e0a810c4.jpg resize: (1080, 1632) 1374112983 -3.205339365201965 treat image : temp/1753688248_3183620_1374112962_31bbdadfd0a430d073fc88d41f6493b9.jpg resize: (1080, 1632) 1374112962 -5.520353499165618 treat image : temp/1753688248_3183620_1374112960_0d510c973abec6022d7178603691072c.jpg resize: (1080, 1632) 1374112960 -5.533766608925004 treat image : temp/1753688248_3183620_1374112956_5cf548cc4555920d6c6778285762ea2c.jpg resize: (1080, 1632) 1374112956 -5.868688729758186 treat image : temp/1753688248_3183620_1374112944_f7c827992e9ff426a18e6ea684f5c513.jpg resize: (1080, 1632) 1374112944 -5.741534693581333 treat image : temp/1753688248_3183620_1374112941_be24ab1d908cd872934590a7100965b9.jpg resize: (1080, 1632) 1374112941 -5.73158336841773 treat image : temp/1753688248_3183620_1374112597_b3769ffb22d16d2a21f050413e059675.jpg resize: (1080, 1632) 1374112597 -5.296065833529782 treat image : temp/1753688248_3183620_1374112592_6bbd3f38978b60821fe6835bf22af67e.jpg resize: (1080, 1632) 1374112592 -5.031226523752574 treat image : temp/1753688248_3183620_1374112589_2bdfc496697df998cc140d76f511c155.jpg resize: (1080, 1632) 1374112589 -4.5822186461588785 treat image : temp/1753688248_3183620_1374112579_3e057c94482f5b1ae8cdd69984323afa.jpg resize: (1080, 1632) 1374112579 -4.5728831499744444 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 16 time used for this insertion : 0.012777090072631836 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 16 time used for this insertion : 0.014039278030395508 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.018877029418945312 save missing photos in datou_result : time spend for datou_step_exec : 11.974584102630615 time spend to save output : 0.05081748962402344 total time spend for step 1 : 12.025401592254639 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 16 set_done_treatment 11.62user 2.59system 0:17.45elapsed 81%CPU (0avgtext+0avgdata 139288maxresident)k 72inputs+8200outputs (21major+215201minor)pagefaults 0swaps