python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4189' -s datou_current_4189 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2663243 load datou : 4189 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Date 2026-11-06 07:00:30.134388 Current got : datou_id : 4189, datou_cur_ids : ['4405852'] with mtr_portfolio_ids : ['31386348'] and first list_photo_ids : [] new path : /proc/2663243/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.06980514526367188 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Fri Nov 6 07:00:30 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 237),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 67} L05112026 31386348 Nombre de photos uploadées : 237 / 23040 (1%) 05112026 31386348 Nombre de photos taguées (types de déchets): 67 / 237 (28%) 05112026 31386348 Nombre de photos taguées (volume) : 67 / 237 (28%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 3.3855438232421875e-05 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL?????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.010692834854125977 LCatched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.6575601100921631 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None elapsed_time : list_photo_by_hashtags 0.07411408424377441 Creating list_photo_total elapsed_time : select_descriptors 5.938161849975586 05112026 31386348 Nombre de photos avec descriptors (type 5680) : 67 / 237 (28%) Missing descriptors for photos 0 and 1421990242 L0:00:00|ON:Missing descriptors for photos 1421990242 and 1421990243 LMissing descriptors for photos 1421990243 and 1421990244 LMissing descriptors for photos 1421990244 and 1421990245 LMissing descriptors for photos 1421990245 and 1421990247 LMissing descriptors for photos 1421990247 and 1421990249 LMissing descriptors for photos 1421990249 and 1421990260 LMissing descriptors for photos 1421990260 and 1421990261 LMissing descriptors for photos 1421990261 and 1421990262 LMissing descriptors for photos 1421990262 and 1421990264 LMissing descriptors for photos 1421990264 and 1421990265 LMissing descriptors for photos 1421990265 and 1421990266 LMissing descriptors for photos 1421990266 and 1421990279 LMissing descriptors for photos 1421990279 and 1421990280 LMissing descriptors for photos 1421990280 and 1421990281 LMissing descriptors for photos 1421990281 and 1421990282 LMissing descriptors for photos 1421990282 and 1421990284 LMissing descriptors for photos 1421990284 and 1421990286 LMissing descriptors for photos 1421990286 and 1421990302 LMissing descriptors for photos 1421990302 and 1421990303 LMissing descriptors for photos 1421990303 and 1421990304 LMissing descriptors for photos 1421990304 and 1421990305 LMissing descriptors for photos 1421990305 and 1421990307 LMissing descriptors for photos 1421990307 and 1421990308 LMissing descriptors for photos 1421990308 and 1421990324 LMissing descriptors for photos 1421990324 and 1421990325 LMissing descriptors for photos 1421990325 and 1421990327 LMissing descriptors for photos 1421990327 and 1421990329 LMissing descriptors for photos 1421990329 and 1421990330 LMissing descriptors for photos 1421990330 and 1421990331 LMissing descriptors for photos 1421990331 and 1421990347 LMissing descriptors for photos 1421990347 and 1421990348 LMissing descriptors for photos 1421990348 and 1421990350 LMissing descriptors for photos 1421990350 and 1421990351 LMissing descriptors for photos 1421990351 and 1421990352 LMissing descriptors for photos 1421990352 and 1421990353 LERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 1280 photo_id : 1421990371 photo_id_prec : 1421990353 ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 1280 vs 0 photo_id : 1421990402 photo_id_prec : 1421990391 LMissing descriptors for photos 1421990402 and 1421990403 LMissing descriptors for photos 1421990403 and 1421990404 LMissing descriptors for photos 1421990404 and 1421990405 LMissing descriptors for photos 1421990405 and 1421990407 LMissing descriptors for photos 1421990407 and 1421990409 LMissing descriptors for photos 1421990409 and 1421990422 LMissing descriptors for photos 1421990422 and 1421990423 LMissing descriptors for photos 1421990423 and 1421990424 LMissing descriptors for photos 1421990424 and 1421990425 LMissing descriptors for photos 1421990425 and 1421990426 LMissing descriptors for photos 1421990426 and 1421990427 LERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 1280 photo_id : 1421990437 photo_id_prec : 1421990427 LLLLLLLLLLERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 1280 vs 0 photo_id : 1421990572 photo_id_prec : 1421990555 LMissing descriptors for photos 1421990572 and 1421990573 LMissing descriptors for photos 1421990573 and 1421990574 LMissing descriptors for photos 1421990574 and 1421990575 LMissing descriptors for photos 1421990575 and 1421990577 LMissing descriptors for photos 1421990577 and 1421990579 LMissing descriptors for photos 1421990579 and 1421990589 LMissing descriptors for photos 1421990589 and 1421990590 LMissing descriptors for photos 1421990590 and 1421990591 LMissing descriptors for photos 1421990591 and 1421990593 LMissing descriptors for photos 1421990593 and 1421990595 LMissing descriptors for photos 1421990595 and 1421990596 LMissing descriptors for photos 1421990596 and 1421990629 LMissing descriptors for photos 1421990629 and 1421990630 LMissing descriptors for photos 1421990630 and 1421990631 LMissing descriptors for photos 1421990631 and 1421990632 LMissing descriptors for photos 1421990632 and 1421990633 LMissing descriptors for photos 1421990633 and 1421990635 LMissing descriptors for photos 1421990635 and 1421990644 LMissing descriptors for photos 1421990644 and 1421990654 LMissing descriptors for photos 1421990654 and 1421990656 LMissing descriptors for photos 1421990656 and 1421990658 LMissing descriptors for photos 1421990658 and 1421990660 LMissing descriptors for photos 1421990660 and 1421990661 LMissing descriptors for photos 1421990661 and 1421990684 LMissing descriptors for photos 1421990684 and 1421990686 LMissing descriptors for photos 1421990686 and 1421990687 LMissing descriptors for photos 1421990687 and 1421990688 LMissing descriptors for photos 1421990688 and 1421990689 LMissing descriptors for photos 1421990689 and 1421990690 LMissing descriptors for photos 1421990690 and 1421990724 LMissing descriptors for photos 1421990724 and 1421990727 LMissing descriptors for photos 1421990727 and 1421990728 LMissing descriptors for photos 1421990728 and 1421990729 LMissing descriptors for photos 1421990729 and 1421990731 LMissing descriptors for photos 1421990731 and 1421990732 LERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 1280 photo_id : 1421990765 photo_id_prec : 1421990732 LLLLLLLLLERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 1280 vs 0 photo_id : 1421990785 photo_id_prec : 1421990779 LMissing descriptors for photos 1421990785 and 1421990786 LMissing descriptors for photos 1421990786 and 1421990787 LMissing descriptors for photos 1421990787 and 1421990788 LMissing descriptors for photos 1421990788 and 1421990789 LMissing descriptors for photos 1421990789 and 1421990790 LMissing descriptors for photos 1421990790 and 1421990823 LMissing descriptors for photos 1421990823 and 1421990824 LMissing descriptors for photos 1421990824 and 1421990825 LMissing descriptors for photos 1421990825 and 1421990826 LMissing descriptors for photos 1421990826 and 1421990827 LMissing descriptors for photos 1421990827 and 1421990828 LMissing descriptors for photos 1421990828 and 1421990857 LMissing descriptors for photos 1421990857 and 1421990860 LMissing descriptors for photos 1421990860 and 1421990862 LMissing descriptors for photos 1421990862 and 1421990863 LMissing descriptors for photos 1421990863 and 1421990864 LMissing descriptors for photos 1421990864 and 1421990865 LERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 1280 photo_id : 1421990918 photo_id_prec : 1421990865 LLLLLLERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 1280 vs 0 photo_id : 1421990947 photo_id_prec : 1421990923 LMissing descriptors for photos 1421990947 and 1421990948 LMissing descriptors for photos 1421990948 and 1421990949 LMissing descriptors for photos 1421990949 and 1421990950 LMissing descriptors for photos 1421990950 and 1421990951 LMissing descriptors for photos 1421990951 and 1421990952 LMissing descriptors for photos 1421990952 and 1421990985 LMissing descriptors for photos 1421990985 and 1421990986 LMissing descriptors for photos 1421990986 and 1421990987 LMissing descriptors for photos 1421990987 and 1421990988 LMissing descriptors for photos 1421990988 and 1421990989 LMissing descriptors for photos 1421990989 and 1421990990 LMissing descriptors for photos 1421990990 and 1421991024 LMissing descriptors for photos 1421991024 and 1421991025 LMissing descriptors for photos 1421991025 and 1421991026 LMissing descriptors for photos 1421991026 and 1421991027 LMissing descriptors for photos 1421991027 and 1421991028 LMissing descriptors for photos 1421991028 and 1421991029 LERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 1280 photo_id : 1421991047 photo_id_prec : 1421991029 LLLLLLLLLERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 1280 vs 0 photo_id : 1421991162 photo_id_prec : 1421991103 LMissing descriptors for photos 1421991162 and 1421991163 LMissing descriptors for photos 1421991163 and 1421991165 LMissing descriptors for photos 1421991165 and 1421991169 LMissing descriptors for photos 1421991169 and 1421991172 LMissing descriptors for photos 1421991172 and 1421991176 LMissing descriptors for photos 1421991176 and 1421991234 LMissing descriptors for photos 1421991234 and 1421991235 LMissing descriptors for photos 1421991235 and 1421991237 LMissing descriptors for photos 1421991237 and 1421991239 LMissing descriptors for photos 1421991239 and 1421991241 LMissing descriptors for photos 1421991241 and 1421991244 LMissing descriptors for photos 1421991244 and 1421991301 LMissing descriptors for photos 1421991301 and 1421991302 LMissing descriptors for photos 1421991302 and 1421991303 LMissing descriptors for photos 1421991303 and 1421991304 LMissing descriptors for photos 1421991304 and 1421991305 LMissing descriptors for photos 1421991305 and 1421991307 LMissing descriptors for photos 1421991307 and 1421991429 LMissing descriptors for photos 1421991429 and 1421991430 LMissing descriptors for photos 1421991430 and 1421991431 LMissing descriptors for photos 1421991431 and 1421991432 LMissing descriptors for photos 1421991432 and 1421991434 LMissing descriptors for photos 1421991434 and 1421991437 LMissing descriptors for photos 1421991437 and 1421991473 LMissing descriptors for photos 1421991473 and 1421991478 LMissing descriptors for photos 1421991478 and 1421991480 LMissing descriptors for photos 1421991480 and 1421991483 LMissing descriptors for photos 1421991483 and 1421991485 LMissing descriptors for photos 1421991485 and 1421991486 LMissing descriptors for photos 1421991486 and 1421991500 LMissing descriptors for photos 1421991500 and 1421991501 LMissing descriptors for photos 1421991501 and 1421991502 LMissing descriptors for photos 1421991502 and 1421991503 LMissing descriptors for photos 1421991503 and 1421991504 LMissing descriptors for photos 1421991504 and 1421991505 LMissing descriptors for photos 1421991505 and 1421991506 LMissing descriptors for photos 1421991506 and 1421991507 LMissing descriptors for photos 1421991507 and 1421991508 LMissing descriptors for photos 1421991508 and 1421991509 LMissing descriptors for photos 1421991509 and 1421991516 LMissing descriptors for photos 1421991516 and 1421991517 LMissing descriptors for photos 1421991517 and 1421991518 LMissing descriptors for photos 1421991518 and 1421991519 LMissing descriptors for photos 1421991519 and 1421991520 LMissing descriptors for photos 1421991520 and 1421991521 LMissing descriptors for photos 1421991521 and 1421991522 LMissing descriptors for photos 1421991522 and 1421991523 LMissing descriptors for photos 1421991523 and 1421991524 LMissing descriptors for photos 1421991524 and 1421991525 L 05112026 Removing 0 photos because of the 'same image' condition Total on : 0 Total off : 0.0 list_time_off Warning in study_and_display_distrib_list : min=max : 0.0 0.0 dist_desc begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 237 time used for this insertion : 0.12278342247009277 photos_removed : len 0 elapsed_time : remove_photo_duplicate 0.22742414474487305 To do, maybe not at the correct place ! .L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L..........L.L.L.L.L.L.L.L.L.L.L.L.........................L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.028467416763305664 NUMBER BATCH : 3 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info LLLLLLLLLLresult_one_balle_Type_JRM:{'day': '05112026', 'map_nb_amount': {0: 3, 1: 34, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 778.7102591991425, 'nb_balles_papier': 0.0004100000000000004, 'begin_time_port': 'image_05112026_10_01_04_416144_0002.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0004100000000000004 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info LLLLLLLLLERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info LLLLLLERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info LLLLLLLLLresult_one_balle_Type_JRM:{'day': '05112026', 'map_nb_amount': {0: 3, 1: 15, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 840.0486090183258, 'nb_balles_papier': 0.00024, 'begin_time_port': 'image_05112026_10_15_03_016049_0000.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.00024 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info LLresult_one_balle_Type_JRM:{'day': '05112026', 'map_nb_amount': {0: 1, 1: 1, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 420.14156794548035, 'nb_balles_papier': 2e-05, 'begin_time_port': 'image_05112026_10_30_03_000880_0000.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 2e-05 We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 3 list_same_port_ids : [] list_same_port_ids : [] list_same_port_ids : [] # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=31386604 AND mptpi.`type`=3726 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=31386605 AND mptpi.`type`=3726 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=31386606 AND mptpi.`type`=3726 To do elapsed_time : count_nb_balles_and_create_portfolio 13.41720175743103 # DISPLAY ALL COLLECTED DATA : {'05112026': {'nb_upload': 237, 'nb_taggue_class': 67, 'nb_taggue_densite': 67, 'nb_descriptors': 67}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1421991525, 1421991524, 1421991523, 1421991522, 1421991521, 1421991520, 1421991519, 1421991518, 1421991517, 1421991516, 1421991509, 1421991508, 1421991507, 1421991506, 1421991505, 1421991504, 1421991503, 1421991502, 1421991501, 1421991500, 1421991486, 1421991485, 1421991483, 1421991480, 1421991478, 1421991473, 1421991437, 1421991434, 1421991432, 1421991431, 1421991430, 1421991429, 1421991307, 1421991305, 1421991304, 1421991303, 1421991302, 1421991301, 1421991244, 1421991241, 1421991239, 1421991237, 1421991235, 1421991234, 1421991176, 1421991172, 1421991169, 1421991165, 1421991163, 1421991162, 1421991103, 1421991100, 1421991099, 1421991098, 1421991097, 1421991096, 1421991049, 1421991048, 1421991047, 1421991029, 1421991028, 1421991027, 1421991026, 1421991025, 1421991024, 1421990990, 1421990989, 1421990988, 1421990987, 1421990986, 1421990985, 1421990952, 1421990951, 1421990950, 1421990949, 1421990948, 1421990947, 1421990923, 1421990922, 1421990921, 1421990920, 1421990919, 1421990918, 1421990865, 1421990864, 1421990863, 1421990862, 1421990860, 1421990857, 1421990828, 1421990827, 1421990826, 1421990825, 1421990824, 1421990823, 1421990790, 1421990789, 1421990788, 1421990787, 1421990786] Looping around the photos to save general results len do output : 1 /31386348Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991525', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991524', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991523', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991522', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991521', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991520', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991519', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991518', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991517', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991516', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991509', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991508', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991507', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991506', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991505', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991504', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991503', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991502', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991501', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991500', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991486', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991485', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991483', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991480', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991478', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991473', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991437', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991434', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991432', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991431', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991430', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991429', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991307', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991305', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991304', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991303', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991302', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991301', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991244', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991241', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991239', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991237', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991235', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991234', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991176', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991172', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991169', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991165', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991163', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991162', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991103', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991100', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991099', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991098', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991097', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991096', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991049', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991048', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991047', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991029', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991028', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991027', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991026', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991025', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421991024', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990990', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990989', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990988', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990987', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990986', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990985', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990952', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990951', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990950', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990949', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990948', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990947', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990923', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990922', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990921', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990920', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990919', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990918', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990865', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990864', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990863', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990862', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990860', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990857', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990828', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990827', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990826', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990825', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990824', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990823', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990790', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990789', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990788', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990787', None, None, None, None, None, '4405852') ('4189', None, None, None, None, None, None, None, '4405852') ('4189', '31386348', '1421990786', None, None, None, None, None, '4405852') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.06199932098388672 save_final save missing photos in datou_result : time spend for datou_step_exec : 20.639923572540283 time spend to save output : 0.06278395652770996 total time spend for step 1 : 20.702707529067993 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.66user 0.63system 0:25.03elapsed 9%CPU (0avgtext+0avgdata 114000maxresident)k 1072inputs+672outputs (2major+54756minor)pagefaults 0swaps