python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 66518 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 6186>100 please execute split_portfolio.py -i 24747185 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3252349'] with mtr_portfolio_ids : ['24747185'] and first list_photo_ids : [] new path : /proc/66518/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.185234308242798 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Wed Jul 9 23:17:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1752095846_66518_1371446044_d3c2baafff775cabe1420c4e200b0346.jpg resize: (1080, 1632) 1371446044 -5.184253673224421 treat image : temp/1752095846_66518_1371446041_11cd2f3f4597da0de09cc87324776067.jpg resize: (1080, 1632) 1371446041 -4.991749019463715 treat image : temp/1752095846_66518_1371446038_617aa519411749d98afded94abbfeabc.jpg resize: (1080, 1632) 1371446038 -5.014543446297583 treat image : temp/1752095846_66518_1371446036_8761436fea97285c78c83a1338285bb8.jpg resize: (1080, 1632) 1371446036 -3.3165057702313434 treat image : temp/1752095846_66518_1371446031_50248cc37b20a31699e0b498c32ed168.jpg resize: (1080, 1632) 1371446031 -5.308188860917151 treat image : temp/1752095846_66518_1371446006_0bb45ac5a9701983e880317a66560d98.jpg resize: (1080, 1632) 1371446006 -4.953856210356638 treat image : temp/1752095846_66518_1371445966_1ded9865470ee8de092056278ef532e2.jpg resize: (1080, 1632) 1371445966 -2.734699033020786 treat image : temp/1752095846_66518_1371445962_8ef1251366620f00b22bdcdc403ef5fc.jpg resize: (1080, 1632) 1371445962 -4.423839114772544 treat image : temp/1752095846_66518_1371445936_57e15d9cb25123e3f26020128edefeba.jpg resize: (1080, 1632) 1371445936 -4.9931766070164905 treat image : temp/1752095846_66518_1371445911_d9855f1e534f2c515d3606e5038611c9.jpg resize: (1080, 1632) 1371445911 -5.338292910654863 treat image : temp/1752095846_66518_1371445883_f7de9748818b5bc44a49ff6eaa7380be.jpg resize: (1080, 1632) 1371445883 -5.6800517947928695 treat image : temp/1752095846_66518_1371445856_3f75cacb4ad00cf6b4757424a3687637.jpg resize: (1080, 1632) 1371445856 -3.8751662771159494 treat image : temp/1752095846_66518_1371445763_644719b93528e30d1e61602dcb4e7e03.jpg resize: (1080, 1632) 1371445763 -5.2736108998251465 treat image : temp/1752095846_66518_1371445746_179f2c5429ad9d0bc259dbd5f36e7467.jpg resize: (1080, 1632) 1371445746 -5.014658486907303 treat image : temp/1752095846_66518_1371445742_65b5d5a81ac371cde6c4d919beba628f.jpg resize: (1080, 1632) 1371445742 -5.237818349968148 treat image : temp/1752095846_66518_1371445740_e82815ad1eaccb11e7566e81f7ab2af7.jpg resize: (1080, 1632) 1371445740 -4.667318324700529 treat image : temp/1752095846_66518_1371445738_1afcac051eaed25532f662cff92c3157.jpg resize: (1080, 1632) 1371445738 -3.4575294927501257 treat image : temp/1752095846_66518_1371445736_d802d3d7909f02039d79586285d86aea.jpg resize: (1080, 1632) 1371445736 -1.237855697941409 treat image : temp/1752095846_66518_1371445729_f5a3aafe0bba12db07750c764915f82e.jpg resize: (1080, 1632) 1371445729 -4.282664171923805 treat image : temp/1752095846_66518_1371445720_d6dfb3e14fe533b84e13860d48542a99.jpg resize: (1080, 1632) 1371445720 -4.666835208741283 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.012570858001708984 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.011923789978027344 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.015163183212280273 save missing photos in datou_result : time spend for datou_step_exec : 15.23919939994812 time spend to save output : 0.04454493522644043 total time spend for step 1 : 15.28374433517456 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.40user 3.23system 0:19.28elapsed 91%CPU (0avgtext+0avgdata 139428maxresident)k 72inputs+9272outputs (2major+216030minor)pagefaults 0swaps