python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1793496 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 5641>100 please execute split_portfolio.py -i 24774035 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3262193'] with mtr_portfolio_ids : ['24774035'] and first list_photo_ids : [] new path : /proc/1793496/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.579110622406006 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Thu Jul 10 17:52:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1752162747_1793496_1371512453_3c878ad8e9c89569b162558a179d4ef5.jpg resize: (1080, 1632) 1371512453 -5.008303828613032 treat image : temp/1752162747_1793496_1371512447_cf98939289a1d218035cc8c33f4f6300.jpg resize: (1080, 1632) 1371512447 -5.034180551893359 treat image : temp/1752162747_1793496_1371512366_fcba7cffe7c22e9b3965a914dd7d7d3e.jpg resize: (1080, 1632) 1371512366 -5.002802074464614 treat image : temp/1752162747_1793496_1371512363_83450ff52a4787fbd41513a070687a19.jpg resize: (1080, 1632) 1371512363 -5.016428632954936 treat image : temp/1752162747_1793496_1371512079_5bbb00a756232989878a1f1002cd1a39.jpg resize: (1080, 1632) 1371512079 -4.987544442935223 treat image : temp/1752162747_1793496_1371512074_10c7ced25e96e12479a91a78680993f3.jpg resize: (1080, 1632) 1371512074 -5.03453157636002 treat image : temp/1752162747_1793496_1371511992_2cf7572d0326d3c7061d71cac2b07300.jpg resize: (1080, 1632) 1371511992 -5.022637606335239 treat image : temp/1752162747_1793496_1371511990_3bc52abedc91c34e930a0a6d23e75382.jpg resize: (1080, 1632) 1371511990 -5.014110578258484 treat image : temp/1752162747_1793496_1371511683_91baaa4dabd1550d9cfeda80082e67bc.jpg resize: (1080, 1632) 1371511683 -5.006472781922732 treat image : temp/1752162747_1793496_1371511682_46624dd30ba1bd18b6c82c98d9eff6cd.jpg resize: (1080, 1632) 1371511682 -5.042475388123048 treat image : temp/1752162747_1793496_1371511599_7d6f811025435187f18564888b03ca9c.jpg resize: (1080, 1632) 1371511599 -5.018508514859462 treat image : temp/1752162747_1793496_1371511598_9645334cf3758ff5162460a9cf4bccee.jpg resize: (1080, 1632) 1371511598 -5.023473864823004 treat image : temp/1752162747_1793496_1371511256_0acc49f91bb79b95d545a9bc9ae48063.jpg resize: (1080, 1632) 1371511256 -5.01764463072498 treat image : temp/1752162747_1793496_1371511253_1f15fca1ec64d455819cddaa80277748.jpg resize: (1080, 1632) 1371511253 -4.985179670276024 treat image : temp/1752162747_1793496_1371511211_55fd70e34a5d195867452674cd4075dd.jpg resize: (1080, 1632) 1371511211 -5.018505375475706 treat image : temp/1752162747_1793496_1371511171_79c63ab51292e3e6139716eee7bde898.jpg resize: (1080, 1632) 1371511171 -5.028547577148201 treat image : temp/1752162747_1793496_1371510848_7fd556bd4b840e72cc97ca300bc69adb.jpg resize: (1080, 1632) 1371510848 -5.006205843368858 treat image : temp/1752162747_1793496_1371510791_4e2ee8d028ab16b8bf5fc13753cf61ab.jpg resize: (1080, 1632) 1371510791 -5.023199315677878 treat image : temp/1752162747_1793496_1371510777_cc3081f21517ad66d9d22c1c76280dfd.jpg resize: (1080, 1632) 1371510777 -5.014105680363902 treat image : temp/1752162747_1793496_1371510775_31eb1f9cf63855f6c2b66293cf86e4ff.jpg resize: (1080, 1632) 1371510775 -5.047887978231771 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.01371622085571289 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.01275944709777832 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.015255212783813477 save missing photos in datou_result : time spend for datou_step_exec : 15.950861930847168 time spend to save output : 0.04693245887756348 total time spend for step 1 : 15.997794389724731 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 13.47user 4.91system 0:21.98elapsed 83%CPU (0avgtext+0avgdata 140084maxresident)k 120inputs+9488outputs (1major+257587minor)pagefaults 0swaps