python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 329891 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 4743>100 please execute split_portfolio.py -i 25001616 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['3300033'] with mtr_portfolio_ids : ['25001616'] and first list_photo_ids : [] new path : /proc/329891/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 3.2675673961639404 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Thu Jul 17 14:12:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1752754346_329891_1372342253_9d3f089ff1fdac1d43b45c774ea20090.jpg resize: (1080, 1632) 1372342253 -5.188772141254186 treat image : temp/1752754346_329891_1372342252_c2a681b7bd9b4657851b36e49491e616.jpg resize: (1080, 1632) 1372342252 -5.198234855595164 treat image : temp/1752754346_329891_1372342250_aac63a401fdb740763d12ffc0f952521.jpg resize: (1080, 1632) 1372342250 -5.19573797494226 treat image : temp/1752754346_329891_1372342248_d1fa3a7efec375a67963fb17122947f3.jpg resize: (1080, 1632) 1372342248 -5.194602397940863 treat image : temp/1752754346_329891_1372342246_df76748e045e9acd1202f2d712e5eb09.jpg resize: (1080, 1632) 1372342246 -5.191470532226669 treat image : temp/1752754346_329891_1372342223_fdd7632ec9da9ee10f536cddb785213f.jpg resize: (1080, 1632) 1372342223 -5.193415506345834 treat image : temp/1752754346_329891_1372342219_5b6d122803378fa0125ef2a989e261f4.jpg resize: (1080, 1632) 1372342219 -5.184766174376586 treat image : temp/1752754346_329891_1372342217_068588ffbd315c593e1edfa17918df97.jpg resize: (1080, 1632) 1372342217 -5.198279861437256 treat image : temp/1752754346_329891_1372342216_06f9011a635df7fcf7666c877084cca8.jpg resize: (1080, 1632) 1372342216 -5.196053648531618 treat image : temp/1752754346_329891_1372342214_b03054256fcf90f07edd0f354e734ab4.jpg resize: (1080, 1632) 1372342214 -5.196905601999534 treat image : temp/1752754346_329891_1372342212_06e578b56a3d3af616976b053fdba216.jpg resize: (1080, 1632) 1372342212 -5.195501259486702 treat image : temp/1752754346_329891_1372342198_f970358e289e7ff2663d71a89828f099.jpg resize: (1080, 1632) 1372342198 -5.163550213897108 treat image : temp/1752754346_329891_1372342195_bec4e4877f0379a0712a3a262de86774.jpg resize: (1080, 1632) 1372342195 -5.187245928843687 treat image : temp/1752754346_329891_1372342190_9c64b165e37b5c61d81973ee9734e732.jpg resize: (1080, 1632) 1372342190 -5.1795441866050105 treat image : temp/1752754346_329891_1372342187_f76bfee56e6dcaf086ac4461bac21423.jpg resize: (1080, 1632) 1372342187 -5.179451222573854 treat image : temp/1752754346_329891_1372342185_afe52a847ef3e872f36b63e031dafada.jpg resize: (1080, 1632) 1372342185 -5.190236786697897 treat image : temp/1752754346_329891_1372342182_469e44f91b7f5ec99714a0412124aefc.jpg resize: (1080, 1632) 1372342182 -5.183327864329329 treat image : temp/1752754346_329891_1372342159_1ca9a3dc36078efee59c22436586a77d.jpg resize: (1080, 1632) 1372342159 -4.574305022531266 treat image : temp/1752754346_329891_1372342156_0a7983c5f6e16d7519ce0dd566e5d6a2.jpg resize: (1080, 1632) 1372342156 -4.587509125067919 treat image : temp/1752754346_329891_1372342152_c288c7e740c37ca11b53ef13c4ee95b0.jpg resize: (1080, 1632) 1372342152 -4.584348368962896 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.044692039489746094 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.04461216926574707 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.04749178886413574 save missing photos in datou_result : time spend for datou_step_exec : 15.504271984100342 time spend to save output : 0.1565084457397461 total time spend for step 1 : 15.660780429840088 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.05user 3.87system 0:20.57elapsed 87%CPU (0avgtext+0avgdata 139000maxresident)k 40inputs+10152outputs (11major+254669minor)pagefaults 0swaps