python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3708918 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 3114>100 please execute split_portfolio.py -i 24747185 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3252349'] with mtr_portfolio_ids : ['24747185'] and first list_photo_ids : [] new path : /proc/3708918/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.397444248199463 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Wed Jul 9 18:32:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1752078746_3708918_1371426777_8a27c09e8cdef86971f92b981b0364ec.jpg resize: (1080, 1632) 1371426777 -4.618269403514497 treat image : temp/1752078746_3708918_1371426776_525bd6075351c2c709b84d4dfbaf372e.jpg resize: (1080, 1632) 1371426776 -4.614513438281177 treat image : temp/1752078746_3708918_1371426774_97ffac69c4e50b766c87cb5490193a40.jpg resize: (1080, 1632) 1371426774 -5.355076240627136 treat image : temp/1752078746_3708918_1371426773_ea7dfa862ad1c6418b12de1dbb9c9b6d.jpg resize: (1080, 1632) 1371426773 -5.397390400496354 treat image : temp/1752078746_3708918_1371426772_faec603e199ad02bff3377153b5ea259.jpg resize: (1080, 1632) 1371426772 -3.665775404189488 treat image : temp/1752078746_3708918_1371426771_169d21e48a3091d2433781d3c27baa79.jpg resize: (1080, 1632) 1371426771 -4.77046057658866 treat image : temp/1752078746_3708918_1371426767_9a287b924a6cdc72ac8f403cb5d728cb.jpg resize: (1080, 1632) 1371426767 -4.171571618388634 treat image : temp/1752078746_3708918_1371426765_ccf54b451fc0050d62adadd19086f14e.jpg resize: (1080, 1632) 1371426765 -4.1901370294537115 treat image : temp/1752078746_3708918_1371426763_9c17288b576449b3c8155db424bd633f.jpg resize: (1080, 1632) 1371426763 -0.4442320905088042 treat image : temp/1752078746_3708918_1371426761_bb06bdc35688931c51dbb4673375f9aa.jpg resize: (1080, 1632) 1371426761 -1.7186326633546296 treat image : temp/1752078746_3708918_1371426759_a4cce50aadc4733bba6c9dac583e546d.jpg resize: (1080, 1632) 1371426759 -2.609265547949028 treat image : temp/1752078746_3708918_1371426757_87377fbc06c11a29c6210f07e057b1d2.jpg resize: (1080, 1632) 1371426757 -2.3363474944300378 treat image : temp/1752078746_3708918_1371426756_a2e9e59ecd746844cb3cfc871ed2e0a5.jpg resize: (1080, 1632) 1371426756 -4.2571497527625155 treat image : temp/1752078746_3708918_1371426755_05f16b4eac2ff02c74cb53a7a45ada9b.jpg resize: (1080, 1632) 1371426755 -4.3521201055971055 treat image : temp/1752078746_3708918_1371426754_47a422f22c02877caead8df7b5230b96.jpg resize: (1080, 1632) 1371426754 -4.34250094794229 treat image : temp/1752078746_3708918_1371426753_792ff836cc4407161f97f3726062b869.jpg resize: (1080, 1632) 1371426753 -4.608827543019228 treat image : temp/1752078746_3708918_1371426752_b518569e2789677606fb0f5b8442b216.jpg resize: (1080, 1632) 1371426752 -3.094299372909846 treat image : temp/1752078746_3708918_1371426750_0bb60ab378dea28dc90a7ab509207a95.jpg resize: (1080, 1632) 1371426750 -0.9955407568511965 treat image : temp/1752078746_3708918_1371426746_723ff37dd3c4f2a3beafc164f78cb284.jpg resize: (1080, 1632) 1371426746 -3.865347798446022 treat image : temp/1752078746_3708918_1371426744_4420c25352f1de8e901a16b4c91e3e94.jpg resize: (1080, 1632) 1371426744 -5.454491958300274 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.012368917465209961 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.012266874313354492 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.014731407165527344 save missing photos in datou_result : time spend for datou_step_exec : 13.577952146530151 time spend to save output : 0.04439592361450195 total time spend for step 1 : 13.622348070144653 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.44user 1.62system 0:17.79elapsed 90%CPU (0avgtext+0avgdata 138732maxresident)k 104inputs+8144outputs (16major+117199minor)pagefaults 0swaps