python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 ~/workarea/git/Velours/python/prod/datou.py -j batch_current -a 4955 -P 23817124' -s crop_pancarte -M 0 -S 0 -U 100,80,95 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/home/admin/workarea/git/apy', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3071408 load datou : 4955 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut ĂȘtre local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? load thcls load pdts Running datou job : batch_current updating current state to 1 list_input_json: [] Current got : datou_id : 4955, datou_cur_ids : ['3712269'] with mtr_portfolio_ids : ['23817124'] and first list_photo_ids : [] new path : /proc/3071408/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : crop_condition over limit max, limiting to limit_max 300 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 204 ; length of list_pids : 204 ; length of list_args : 204 time to download the photos : 61.034560441970825 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:crop_condition Fri Sep 12 15:55:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Loading chi in step crop with photo_hashtag_type : 5006 Loading chi in step crop for list_pids : 204 ! batch 1 Loaded 115 chid ids of type : 5006 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++batch 2 Loaded 136 chid ids of type : 5006 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++batch 3 Loaded 6 chid ids of type : 5006 ++++++ begin to crop the class : badge param for this class : {} filtre for class : badge hashtag_id of this class : 492993645 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 26797058 init cache_photo without model_param ERROR in datou_step_exec, will save and exit ! Unauthorized. Check username/id, password, tenant name/id and user/tenant domain name/id. File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2329, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2507, in datou_step_exec return post_process.datou_step_exec_crop_condition(param, json_param, args, cache, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_post_processing.py", line 668, in datou_step_exec_crop_condition map_result_insert_loc, new_feed_id_loc = upload_batch(list_path_to_insert_loc, fc, File "/home/admin/workarea/git/Velours/python/mtr/utils/upload_batch.py", line 63, in upload_batch storage_photo = Cache_Photo_Data_s3(storage_server=storage_server) File "/home/admin/workarea/git/Velours/python/mtr/database_queries/CachePhotoData_queries.py", line 67, in __init__ server.connect() File "/home/admin/workarea/git/Velours/python/mtr/utils/cdn/swift_upload_manager.py", line 41, in connect resp_headers, containers = self._conn.get_account() File "/usr/lib/python3/dist-packages/swiftclient/client.py", line 1804, in get_account return self._retry(None, get_account, marker=marker, limit=limit, File "/usr/lib/python3/dist-packages/swiftclient/client.py", line 1738, in _retry self.url, self.token = self.get_auth() File "/usr/lib/python3/dist-packages/swiftclient/client.py", line 1682, in get_auth self.url, self.token = get_auth(self.authurl, self.user, self.key, File "/usr/lib/python3/dist-packages/swiftclient/client.py", line 729, in get_auth storage_url, token = get_auth_keystone(auth_url, user, File "/usr/lib/python3/dist-packages/swiftclient/client.py", line 644, in get_auth_keystone raise ClientException(msg) [1363482348, 1363482044, 1363481998, 1363481952, 1363481917, 1363481889, 1363481870, 1363480734, 1363480710, 1363480708, 1363480704, 1363480697, 1363480667, 1363480539, 1363480535, 1363480530, 1363480499, 1361493872, 1361493867, 1361493847, 1361493841, 1361493837, 1361493831, 1361493821, 1361493816, 1361298409, 1361298402, 1361269963, 1361269950, 1361269868, 1361269622, 1361269588, 1361269544, 1361269511, 1361054394, 1361054272, 1361054269, 1361054266, 1361054262, 1361054259, 1361054255, 1361053928, 1361053921, 1360723483, 1360723303, 1360723264, 1360723226, 1360722541, 1360722099, 1360524090, 1360523986, 1360523570, 1360523536, 1360523482, 1360523446, 1360523408, 1360523317, 1360028131, 1360028094, 1360027797, 1360027792, 1358654227, 1357676358, 1357676347, 1357676341, 1357676331, 1357676324, 1357676318, 1357647104, 1357647099, 1356998832, 1356998826, 1356998821, 1356998813, 1356998806, 1356998753, 1356998732, 1356998665, 1356998545, 1356998437, 1356998320, 1356998244, 1356998239, 1356998234, 1356998228, 1356998225, 1356998222, 1356998184, 1356998178, 1356983086, 1356983071, 1356983067, 1356983061, 1356983052, 1356983046, 1356983040, 1356982997, 1356982991, 1356982983, 1356982975, 1356982971, 1356982967, 1356446286, 1356446283, 1356446281, 1356446276, 1356446131, 1356446129, 1356446125, 1356446122, 1356446088, 1356446064, 1356445493, 1356445457, 1356445406, 1356445355, 1356445334, 1356445310, 1356445131, 1356445108, 1356445088, 1356445062, 1356445022, 1356444982, 1356361583, 1356361548, 1356361543, 1356361537, 1356361530, 1356361523, 1356361517, 1356332042, 1356332025, 1356332023, 1356332017, 1356332010, 1356332003, 1356331995, 1356331985, 1356331982, 1356331976, 1356331967, 1356331962, 1356331957, 1356331946, 1356331943, 1356331941, 1356331931, 1356331923, 1356331918, 1356331909, 1356331907, 1356331903, 1356331894, 1356331884, 1356331876, 1356331867, 1356331862, 1356331857, 1356331848, 1356331842, 1356331838, 1356331817, 1356331815, 1356331809, 1356331801, 1356331794, 1356331788, 1356331782, 1356331779, 1356331771, 1356331766, 1356331762, 1356331757, 1356331746, 1356331742, 1356331735, 1356331730, 1356331719, 1356331714, 1356331706, 1356331701, 1356331694, 1356331687, 1356331680, 1356331673, 1356331664, 1356331661, 1356331654, 1356331643, 1356331626, 1356331619, 1356331602, 1356331598, 1356331593, 1356331586, 1356331578, 1356331574, 1356331559, 1356331557, 1356331553, 1356331545, 1356331538, 1356331534] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 204 time used for this insertion : 0.09006619453430176 save_final ERROR in last step crop_condition, Unauthorized. Check username/id, password, tenant name/id and user/tenant domain name/id. time spend for datou_step_exec : 559.5380098819733 time spend to save output : 0.1350083351135254 total time spend for step 0 : 559.6730182170868 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 204 set_done_treatment 500.12user 58.95system 10:25.60elapsed 89%CPU (0avgtext+0avgdata 1018832maxresident)k 1707984inputs+1755824outputs (23132major+4948254minor)pagefaults 0swaps