python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1299021 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 862>100 please execute split_portfolio.py -i 22870033 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2818969'] with mtr_portfolio_ids : ['22870033'] and first list_photo_ids : [] new path : /proc/1299021/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.3547346591949463 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Mon May 12 08:27:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1747031247_1299021_1357605540_f848bbd38d11d493335c6a9cf7892856.jpg resize: (1080, 1632) 1357605540 -6.260650951800883 treat image : temp/1747031247_1299021_1357605488_a4f8af2e33c0c401e3111a7257ebb804.jpg resize: (1080, 1632) 1357605488 -6.652173117842216 treat image : temp/1747031247_1299021_1357605485_67265dc2cc8e4db551f45a41d67843f2.jpg resize: (1080, 1632) 1357605485 -4.293419875875855 treat image : temp/1747031247_1299021_1357605447_c08d4d84776c6a7750e861c858b77b50.jpg resize: (1080, 1632) 1357605447 -5.854914902686854 treat image : temp/1747031247_1299021_1357605443_47ae2a4ddd816c6adcf785ec5b93071e.jpg resize: (1080, 1632) 1357605443 -1.9820874343322679 treat image : temp/1747031247_1299021_1357605439_0738f6b7066bb4230b8f0864c9a6f957.jpg resize: (1080, 1632) 1357605439 -4.2836621906027155 treat image : temp/1747031247_1299021_1357605417_b0e27684c2dee11b479c082034911414.jpg resize: (1080, 1632) 1357605417 -6.168864203204972 treat image : temp/1747031247_1299021_1357605405_0bd5131578a4063b1e6ff08ce240c75f.jpg resize: (1080, 1632) 1357605405 -6.209869021801146 treat image : temp/1747031247_1299021_1357605403_73f5030717137f66181551813bd4308f.jpg resize: (1080, 1632) 1357605403 -6.063346105871274 treat image : temp/1747031247_1299021_1357605401_0399819209f58793077c59b41eaffa6d.jpg resize: (1080, 1632) 1357605401 -3.6359187024881625 treat image : temp/1747031247_1299021_1357605398_6bc67ea6b898b83c3c7bca6184a79236.jpg resize: (1080, 1632) 1357605398 -3.3317930480426226 treat image : temp/1747031247_1299021_1357605395_65bb3211a6e29d23a327d8f965aea2c3.jpg resize: (1080, 1632) 1357605395 -5.942834665016436 treat image : temp/1747031247_1299021_1357605363_f2a3892c76b33f0d1753b233c86692ac.jpg resize: (1080, 1632) 1357605363 -1.7981424937142874 treat image : temp/1747031247_1299021_1357605361_b3d450547c4ce3f78a677e34feb994c8.jpg resize: (1080, 1632) 1357605361 -2.4921257115482542 treat image : temp/1747031247_1299021_1357605358_0a2a85a0316bf5b1036f96ecc2c1117c.jpg resize: (1080, 1632) 1357605358 -3.200455404300241 treat image : temp/1747031247_1299021_1357605354_9c34359764918b23fa9c36579112e534.jpg resize: (1080, 1632) 1357605354 -6.213334416302934 treat image : temp/1747031247_1299021_1357605348_f52e54e4704bc6400191327111d59876.jpg resize: (1080, 1632) 1357605348 -6.193955759740635 treat image : temp/1747031247_1299021_1357605303_ba88eb53e9d68ffc128e917de85ca94f.jpg resize: (1080, 1632) 1357605303 -5.740058809292699 treat image : temp/1747031247_1299021_1357605302_750c406b38dd2628749789a36fe275b2.jpg resize: (1080, 1632) 1357605302 -6.148814323972013 treat image : temp/1747031247_1299021_1357605300_a0731c749702420460469d3a81f31649.jpg resize: (1080, 1632) 1357605300 -6.146658244468092 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.012928485870361328 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.012726068496704102 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.017976760864257812 save missing photos in datou_result : time spend for datou_step_exec : 15.669979810714722 time spend to save output : 0.04875969886779785 total time spend for step 1 : 15.71873950958252 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.78user 3.45system 0:20.99elapsed 86%CPU (0avgtext+0avgdata 141056maxresident)k 64inputs+10400outputs (11major+260271minor)pagefaults 0swaps