python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4189' -s datou_current_4189 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2892678 load datou : 4189 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Current got : datou_id : 4189, datou_cur_ids : ['3689627'] with mtr_portfolio_ids : ['26715006'] and first list_photo_ids : [] new path : /proc/2892678/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.06871771812438965 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Wed Sep 10 12:00:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 358),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 11} 10092025 26715006 Nombre de photos uploadées : 358 / 23040 (1%) 10092025 26715006 Nombre de photos taguées (types de déchets): 11 / 358 (3%) 10092025 26715006 Nombre de photos taguées (volume) : 11 / 358 (3%) elapsed_time : load_data_split_time_score 4.0531158447265625e-06 elapsed_time : order_list_meta_photo_and_scores 2.09808349609375e-05 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL??????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.016016721725463867 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.21953582763671875 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None elapsed_time : list_photo_by_hashtags 0.029955387115478516 Creating list_photo_total elapsed_time : select_descriptors 0.8376636505126953 10092025 26715006 Nombre de photos avec descriptors (type 5680) : 11 / 358 (3%) ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 1280 photo_id : 1382917377 photo_id_prec : 0 0:00:00|ON:ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 1280 vs 0 photo_id : 1382918667 photo_id_prec : 1382918381 LMissing descriptors for photos 1382918667 and 1382918745 LMissing descriptors for photos 1382918745 and 1382918904 LMissing descriptors for photos 1382918904 and 1382919031 LMissing descriptors for photos 1382919031 and 1382919064 LMissing descriptors for photos 1382919064 and 1382919151 LMissing descriptors for photos 1382919151 and 1382919440 LMissing descriptors for photos 1382919440 and 1382919545 LMissing descriptors for photos 1382919545 and 1382919643 LMissing descriptors for photos 1382919643 and 1382919711 LMissing descriptors for photos 1382919711 and 1382919759 LMissing descriptors for photos 1382919759 and 1382919819 LMissing descriptors for photos 1382919819 and 1382920323 LMissing descriptors for photos 1382920323 and 1382920401 LMissing descriptors for photos 1382920401 and 1382920497 LMissing descriptors for photos 1382920497 and 1382920578 LMissing descriptors for photos 1382920578 and 1382920657 LMissing descriptors for photos 1382920657 and 1382920727 LMissing descriptors for photos 1382920727 and 1382921021 LMissing descriptors for photos 1382921021 and 1382921124 LMissing descriptors for photos 1382921124 and 1382921223 LMissing descriptors for photos 1382921223 and 1382921320 LMissing descriptors for photos 1382921320 and 1382921421 LMissing descriptors for photos 1382921421 and 1382921482 LMissing descriptors for photos 1382921482 and 1382921681 LMissing descriptors for photos 1382921681 and 1382921717 LMissing descriptors for photos 1382921717 and 1382921772 LMissing descriptors for photos 1382921772 and 1382921837 LMissing descriptors for photos 1382921837 and 1382921912 LMissing descriptors for photos 1382921912 and 1382921983 LMissing descriptors for photos 1382921983 and 1382922326 LMissing descriptors for photos 1382922326 and 1382922410 LMissing descriptors for photos 1382922410 and 1382922443 LMissing descriptors for photos 1382922443 and 1382922497 LMissing descriptors for photos 1382922497 and 1382922556 LMissing descriptors for photos 1382922556 and 1382922608 LMissing descriptors for photos 1382922608 and 1382922727 LMissing descriptors for photos 1382922727 and 1382922733 LMissing descriptors for photos 1382922733 and 1382922739 LMissing descriptors for photos 1382922739 and 1382922745 LMissing descriptors for photos 1382922745 and 1382922750 LMissing descriptors for photos 1382922750 and 1382922752 LMissing descriptors for photos 1382922752 and 1382922913 LMissing descriptors for photos 1382922913 and 1382922957 LMissing descriptors for photos 1382922957 and 1382923033 LMissing descriptors for photos 1382923033 and 1382923084 LMissing descriptors for photos 1382923084 and 1382923133 LMissing descriptors for photos 1382923133 and 1382923185 LMissing descriptors for photos 1382923185 and 1382923367 LMissing descriptors for photos 1382923367 and 1382923463 LMissing descriptors for photos 1382923463 and 1382923528 LMissing descriptors for photos 1382923528 and 1382923561 LMissing descriptors for photos 1382923561 and 1382923625 LMissing descriptors for photos 1382923625 and 1382923714 LMissing descriptors for photos 1382923714 and 1382923956 LMissing descriptors for photos 1382923956 and 1382923968 LMissing descriptors for photos 1382923968 and 1382923979 LMissing descriptors for photos 1382923979 and 1382924028 LMissing descriptors for photos 1382924028 and 1382924061 LMissing descriptors for photos 1382924061 and 1382924095 LMissing descriptors for photos 1382924095 and 1382924315 LMissing descriptors for photos 1382924315 and 1382924367 LMissing descriptors for photos 1382924367 and 1382924485 LMissing descriptors for photos 1382924485 and 1382924561 LMissing descriptors for photos 1382924561 and 1382924651 LMissing descriptors for photos 1382924651 and 1382924716 LMissing descriptors for photos 1382924716 and 1382925124 LMissing descriptors for photos 1382925124 and 1382925212 LMissing descriptors for photos 1382925212 and 1382925288 LMissing descriptors for photos 1382925288 and 1382925367 LMissing descriptors for photos 1382925367 and 1382925437 LMissing descriptors for photos 1382925437 and 1382925483 LMissing descriptors for photos 1382925483 and 1382925797 LMissing descriptors for photos 1382925797 and 1382925832 LMissing descriptors for photos 1382925832 and 1382925874 LMissing descriptors for photos 1382925874 and 1382925917 LMissing descriptors for photos 1382925917 and 1382925957 LMissing descriptors for photos 1382925957 and 1382925990 LMissing descriptors for photos 1382925990 and 1382926014 LMissing descriptors for photos 1382926014 and 1382926019 LMissing descriptors for photos 1382926019 and 1382926061 LMissing descriptors for photos 1382926061 and 1382926095 LMissing descriptors for photos 1382926095 and 1382926131 LMissing descriptors for photos 1382926131 and 1382926187 LMissing descriptors for photos 1382926187 and 1382926494 LMissing descriptors for photos 1382926494 and 1382926558 LMissing descriptors for photos 1382926558 and 1382926618 LMissing descriptors for photos 1382926618 and 1382926669 LMissing descriptors for photos 1382926669 and 1382926701 LMissing descriptors for photos 1382926701 and 1382926731 LMissing descriptors for photos 1382926731 and 1382926960 LMissing descriptors for photos 1382926960 and 1382927028 LMissing descriptors for photos 1382927028 and 1382927096 LMissing descriptors for photos 1382927096 and 1382927160 LMissing descriptors for photos 1382927160 and 1382927227 LMissing descriptors for photos 1382927227 and 1382927266 LMissing descriptors for photos 1382927266 and 1382927467 LMissing descriptors for photos 1382927467 and 1382927501 LMissing descriptors for photos 1382927501 and 1382927551 LMissing descriptors for photos 1382927551 and 1382927588 LMissing descriptors for photos 1382927588 and 1382927641 LMissing descriptors for photos 1382927641 and 1382927707 LMissing descriptors for photos 1382927707 and 1382928529 LMissing descriptors for photos 1382928529 and 1382928597 LMissing descriptors for photos 1382928597 and 1382928691 LMissing descriptors for photos 1382928691 and 1382928783 LMissing descriptors for photos 1382928783 and 1382928826 LMissing descriptors for photos 1382928826 and 1382928872 LMissing descriptors for photos 1382928872 and 1382929068 LMissing descriptors for photos 1382929068 and 1382929105 LMissing descriptors for photos 1382929105 and 1382929144 LMissing descriptors for photos 1382929144 and 1382929181 LMissing descriptors for photos 1382929181 and 1382929233 LMissing descriptors for photos 1382929233 and 1382929296 LMissing descriptors for photos 1382929296 and 1382929558 LMissing descriptors for photos 1382929558 and 1382929562 LMissing descriptors for photos 1382929562 and 1382929566 LMissing descriptors for photos 1382929566 and 1382929572 LMissing descriptors for photos 1382929572 and 1382929602 LMissing descriptors for photos 1382929602 and 1382929670 LMissing descriptors for photos 1382929670 and 1382930077 LMissing descriptors for photos 1382930077 and 1382930109 LMissing descriptors for photos 1382930109 and 1382930121 LMissing descriptors for photos 1382930121 and 1382930128 LMissing descriptors for photos 1382930128 and 1382930132 LMissing descriptors for photos 1382930132 and 1382930136 LMissing descriptors for photos 1382930136 and 1382930150 LMissing descriptors for photos 1382930150 and 1382930153 LMissing descriptors for photos 1382930153 and 1382930159 LMissing descriptors for photos 1382930159 and 1382930164 LMissing descriptors for photos 1382930164 and 1382930169 LMissing descriptors for photos 1382930169 and 1382930172 LMissing descriptors for photos 1382930172 and 1382930454 LMissing descriptors for photos 1382930454 and 1382930524 LMissing descriptors for photos 1382930524 and 1382930593 LMissing descriptors for photos 1382930593 and 1382930653 LMissing descriptors for photos 1382930653 and 1382930784 LMissing descriptors for photos 1382930784 and 1382930812 LMissing descriptors for photos 1382930812 and 1382930881 LMissing descriptors for photos 1382930881 and 1382930883 LMissing descriptors for photos 1382930883 and 1382930887 LMissing descriptors for photos 1382930887 and 1382930889 LMissing descriptors for photos 1382930889 and 1382930891 LMissing descriptors for photos 1382930891 and 1382930894 LMissing descriptors for photos 1382930894 and 1382931057 LMissing descriptors for photos 1382931057 and 1382931115 LMissing descriptors for photos 1382931115 and 1382931173 LMissing descriptors for photos 1382931173 and 1382931250 LMissing descriptors for photos 1382931250 and 1382931347 LMissing descriptors for photos 1382931347 and 1382931410 LMissing descriptors for photos 1382931410 and 1382932004 LMissing descriptors for photos 1382932004 and 1382932080 LMissing descriptors for photos 1382932080 and 1382932106 LMissing descriptors for photos 1382932106 and 1382932123 LMissing descriptors for photos 1382932123 and 1382932150 LMissing descriptors for photos 1382932150 and 1382932180 LMissing descriptors for photos 1382932180 and 1382932392 LMissing descriptors for photos 1382932392 and 1382932461 LMissing descriptors for photos 1382932461 and 1382932529 LMissing descriptors for photos 1382932529 and 1382932592 LMissing descriptors for photos 1382932592 and 1382932634 LMissing descriptors for photos 1382932634 and 1382932673 LMissing descriptors for photos 1382932673 and 1382932739 LMissing descriptors for photos 1382932739 and 1382932741 LMissing descriptors for photos 1382932741 and 1382932744 LMissing descriptors for photos 1382932744 and 1382932748 LMissing descriptors for photos 1382932748 and 1382932751 LMissing descriptors for photos 1382932751 and 1382932754 LMissing descriptors for photos 1382932754 and 1382932862 LMissing descriptors for photos 1382932862 and 1382932935 LMissing descriptors for photos 1382932935 and 1382933007 LMissing descriptors for photos 1382933007 and 1382933077 LMissing descriptors for photos 1382933077 and 1382933147 LMissing descriptors for photos 1382933147 and 1382933212 LMissing descriptors for photos 1382933212 and 1382933517 LMissing descriptors for photos 1382933517 and 1382933553 LMissing descriptors for photos 1382933553 and 1382933572 LMissing descriptors for photos 1382933572 and 1382933577 LMissing descriptors for photos 1382933577 and 1382933581 LMissing descriptors for photos 1382933581 and 1382933600 LMissing descriptors for photos 1382933600 and 1382933847 LMissing descriptors for photos 1382933847 and 1382933867 LMissing descriptors for photos 1382933867 and 1382933902 LMissing descriptors for photos 1382933902 and 1382933922 LMissing descriptors for photos 1382933922 and 1382933925 LMissing descriptors for photos 1382933925 and 1382933927 LMissing descriptors for photos 1382933927 and 1382934157 LMissing descriptors for photos 1382934157 and 1382934200 LMissing descriptors for photos 1382934200 and 1382934244 LMissing descriptors for photos 1382934244 and 1382934290 LMissing descriptors for photos 1382934290 and 1382934325 LMissing descriptors for photos 1382934325 and 1382934360 LMissing descriptors for photos 1382934360 and 1382934567 LMissing descriptors for photos 1382934567 and 1382934574 LMissing descriptors for photos 1382934574 and 1382934578 LMissing descriptors for photos 1382934578 and 1382934581 LMissing descriptors for photos 1382934581 and 1382934584 LMissing descriptors for photos 1382934584 and 1382934587 LMissing descriptors for photos 1382934587 and 1382934686 LMissing descriptors for photos 1382934686 and 1382934706 LMissing descriptors for photos 1382934706 and 1382934720 LMissing descriptors for photos 1382934720 and 1382934725 LMissing descriptors for photos 1382934725 and 1382934745 LMissing descriptors for photos 1382934745 and 1382934776 LMissing descriptors for photos 1382934776 and 1382934814 LMissing descriptors for photos 1382934814 and 1382934818 LMissing descriptors for photos 1382934818 and 1382934823 LMissing descriptors for photos 1382934823 and 1382934828 LMissing descriptors for photos 1382934828 and 1382934833 LMissing descriptors for photos 1382934833 and 1382934859 LMissing descriptors for photos 1382934859 and 1382935060 LMissing descriptors for photos 1382935060 and 1382935107 LMissing descriptors for photos 1382935107 and 1382935142 LMissing descriptors for photos 1382935142 and 1382935176 LMissing descriptors for photos 1382935176 and 1382935209 LMissing descriptors for photos 1382935209 and 1382935243 LMissing descriptors for photos 1382935243 and 1382935445 LMissing descriptors for photos 1382935445 and 1382935476 LMissing descriptors for photos 1382935476 and 1382935512 LMissing descriptors for photos 1382935512 and 1382935551 LMissing descriptors for photos 1382935551 and 1382935587 LMissing descriptors for photos 1382935587 and 1382935624 LMissing descriptors for photos 1382935624 and 1382935837 LMissing descriptors for photos 1382935837 and 1382935874 LMissing descriptors for photos 1382935874 and 1382935919 LMissing descriptors for photos 1382935919 and 1382935981 LMissing descriptors for photos 1382935981 and 1382935985 LMissing descriptors for photos 1382935985 and 1382935987 LMissing descriptors for photos 1382935987 and 1382936434 LMissing descriptors for photos 1382936434 and 1382936503 LMissing descriptors for photos 1382936503 and 1382936560 LMissing descriptors for photos 1382936560 and 1382936605 LMissing descriptors for photos 1382936605 and 1382936648 LMissing descriptors for photos 1382936648 and 1382936682 LMissing descriptors for photos 1382936682 and 1382936873 LMissing descriptors for photos 1382936873 and 1382936934 LMissing descriptors for photos 1382936934 and 1382937007 LMissing descriptors for photos 1382937007 and 1382937077 LMissing descriptors for photos 1382937077 and 1382937143 LMissing descriptors for photos 1382937143 and 1382937212 LMissing descriptors for photos 1382937212 and 1382937580 LMissing descriptors for photos 1382937580 and 1382937675 LMissing descriptors for photos 1382937675 and 1382937776 LMissing descriptors for photos 1382937776 and 1382937873 LMissing descriptors for photos 1382937873 and 1382937921 LMissing descriptors for photos 1382937921 and 1382937960 LMissing descriptors for photos 1382937960 and 1382938437 LMissing descriptors for photos 1382938437 and 1382938512 LMissing descriptors for photos 1382938512 and 1382938581 LMissing descriptors for photos 1382938581 and 1382938644 LMissing descriptors for photos 1382938644 and 1382938718 LMissing descriptors for photos 1382938718 and 1382938816 LMissing descriptors for photos 1382938816 and 1382939458 LMissing descriptors for photos 1382939458 and 1382939548 LMissing descriptors for photos 1382939548 and 1382939643 LMissing descriptors for photos 1382939643 and 1382939717 LMissing descriptors for photos 1382939717 and 1382939790 LMissing descriptors for photos 1382939790 and 1382939856 LMissing descriptors for photos 1382939856 and 1382940331 LMissing descriptors for photos 1382940331 and 1382940399 LMissing descriptors for photos 1382940399 and 1382940463 LMissing descriptors for photos 1382940463 and 1382940527 LMissing descriptors for photos 1382940527 and 1382940593 LMissing descriptors for photos 1382940593 and 1382940665 LMissing descriptors for photos 1382940665 and 1382941016 LMissing descriptors for photos 1382941016 and 1382941066 LMissing descriptors for photos 1382941066 and 1382941106 LMissing descriptors for photos 1382941106 and 1382941170 LMissing descriptors for photos 1382941170 and 1382941245 LMissing descriptors for photos 1382941245 and 1382941309 LMissing descriptors for photos 1382941309 and 1382941701 LMissing descriptors for photos 1382941701 and 1382941769 LMissing descriptors for photos 1382941769 and 1382941836 LMissing descriptors for photos 1382941836 and 1382941925 LMissing descriptors for photos 1382941925 and 1382942002 LMissing descriptors for photos 1382942002 and 1382942064 LMissing descriptors for photos 1382942064 and 1382942510 LMissing descriptors for photos 1382942510 and 1382942609 LMissing descriptors for photos 1382942609 and 1382942703 LMissing descriptors for photos 1382942703 and 1382942805 LMissing descriptors for photos 1382942805 and 1382942886 LMissing descriptors for photos 1382942886 and 1382942951 LMissing descriptors for photos 1382942951 and 1382943197 LMissing descriptors for photos 1382943197 and 1382943261 LMissing descriptors for photos 1382943261 and 1382943328 LMissing descriptors for photos 1382943328 and 1382943391 LMissing descriptors for photos 1382943391 and 1382943459 LMissing descriptors for photos 1382943459 and 1382943499 LMissing descriptors for photos 1382943499 and 1382944092 LMissing descriptors for photos 1382944092 and 1382944215 LMissing descriptors for photos 1382944215 and 1382944313 LMissing descriptors for photos 1382944313 and 1382944410 LMissing descriptors for photos 1382944410 and 1382944512 LMissing descriptors for photos 1382944512 and 1382944640 LMissing descriptors for photos 1382944640 and 1382945044 LMissing descriptors for photos 1382945044 and 1382945103 LMissing descriptors for photos 1382945103 and 1382945145 LMissing descriptors for photos 1382945145 and 1382945180 LMissing descriptors for photos 1382945180 and 1382945213 LMissing descriptors for photos 1382945213 and 1382945250 LMissing descriptors for photos 1382945250 and 1382945532 LMissing descriptors for photos 1382945532 and 1382945599 LMissing descriptors for photos 1382945599 and 1382945670 LMissing descriptors for photos 1382945670 and 1382945720 LMissing descriptors for photos 1382945720 and 1382945752 LMissing descriptors for photos 1382945752 and 1382945785 LMissing descriptors for photos 1382945785 and 1382946185 LMissing descriptors for photos 1382946185 and 1382946271 LMissing descriptors for photos 1382946271 and 1382946340 LMissing descriptors for photos 1382946340 and 1382946402 LMissing descriptors for photos 1382946402 and 1382946483 LMissing descriptors for photos 1382946483 and 1382946545 LMissing descriptors for photos 1382946545 and 1382947038 LMissing descriptors for photos 1382947038 and 1382947078 LMissing descriptors for photos 1382947078 and 1382947111 LMissing descriptors for photos 1382947111 and 1382947153 LMissing descriptors for photos 1382947153 and 1382947218 LMissing descriptors for photos 1382947218 and 1382947287 LMissing descriptors for photos 1382947287 and 1382948259 LMissing descriptors for photos 1382948259 and 1382948362 LMissing descriptors for photos 1382948362 and 1382948465 LMissing descriptors for photos 1382948465 and 1382948697 LMissing descriptors for photos 1382948697 and 1382948870 LMissing descriptors for photos 1382948870 and 1382949036 LMissing descriptors for photos 1382949036 and 1382949389 LMissing descriptors for photos 1382949389 and 1382949602 LMissing descriptors for photos 1382949602 and 1382949696 LMissing descriptors for photos 1382949696 and 1382949797 LMissing descriptors for photos 1382949797 and 1382949900 LMissing descriptors for photos 1382949900 and 1382950077 LMissing descriptors for photos 1382950077 and 1382950670 LMissing descriptors for photos 1382950670 and 1382950785 LMissing descriptors for photos 1382950785 and 1382950951 LMissing descriptors for photos 1382950951 and 1382951114 LMissing descriptors for photos 1382951114 and 1382951238 LMissing descriptors for photos 1382951238 and 1382951400 LMissing descriptors for photos 1382951400 and 1382952205 LMissing descriptors for photos 1382952205 and 1382952297 LMissing descriptors for photos 1382952297 and 1382952397 LMissing descriptors for photos 1382952397 and 1382952486 LMissing descriptors for photos 1382952486 and 1382952570 LMissing descriptors for photos 1382952570 and 1382952671 LMissing descriptors for photos 1382952671 and 1382953019 LMissing descriptors for photos 1382953019 and 1382953063 LMissing descriptors for photos 1382953063 and 1382953107 LMissing descriptors for photos 1382953107 and 1382953161 LMissing descriptors for photos 1382953161 and 1382953203 L 10092025 Removing 0 photos because of the 'same image' condition Total on : 0 Total off : 0.0 list_time_off Warning in study_and_display_distrib_list : min=max : 0.0 0.0 dist_desc begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 358 time used for this insertion : 0.08197593688964844 photos_removed : len 0 elapsed_time : remove_photo_duplicate 0.13385963439941406 To do, maybe not at the correct place ! ............L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.015973806381225586 NUMBER BATCH : 4 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info Lresult_one_balle_Type_JRM:{'day': '10092025', 'map_nb_amount': {0: 2, 1: 9, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 839.8102669715881, 'nb_balles_papier': 0.00011, 'begin_time_port': 'image_10092025_10_00_02_918636m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.00011 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLWe filter photos on hashtag condition ! LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLWe filter photos on hashtag condition ! LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLWe filter photos on hashtag condition ! We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 1 list_same_port_ids : [26715838] find same portfolio which already exist 26715838 , we will use it Qualite : 0.06631690262626688 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26715838 AND mptpi.`type`=3726 To do elapsed_time : count_nb_balles_and_create_portfolio 0.14769792556762695 # DISPLAY ALL COLLECTED DATA : {'10092025': {'nb_upload': 358, 'nb_taggue_class': 11, 'nb_taggue_densite': 11, 'nb_descriptors': 11}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1382953203, 1382953161, 1382953107, 1382953063, 1382953019, 1382952671, 1382952570, 1382952486, 1382952397, 1382952297, 1382952205, 1382951400, 1382951238, 1382951114, 1382950951, 1382950785, 1382950670, 1382950077, 1382949900, 1382949797, 1382949696, 1382949602, 1382949389, 1382949036, 1382948870, 1382948697, 1382948465, 1382948362, 1382948259, 1382947287, 1382947218, 1382947153, 1382947111, 1382947078, 1382947038, 1382946545, 1382946483, 1382946402, 1382946340, 1382946271, 1382946185, 1382945785, 1382945752, 1382945720, 1382945670, 1382945599, 1382945532, 1382945250, 1382945213, 1382945180, 1382945145, 1382945103, 1382945044, 1382944640, 1382944512, 1382944410, 1382944313, 1382944215, 1382944092, 1382943499, 1382943459, 1382943391, 1382943328, 1382943261, 1382943197, 1382942951, 1382942886, 1382942805, 1382942703, 1382942609, 1382942510, 1382942064, 1382942002, 1382941925, 1382941836, 1382941769, 1382941701, 1382941309, 1382941245, 1382941170, 1382941106, 1382941066, 1382941016, 1382940665, 1382940593, 1382940527, 1382940463, 1382940399, 1382940331, 1382939856, 1382939790, 1382939717, 1382939643, 1382939548, 1382939458, 1382938816, 1382938718, 1382938644, 1382938581, 1382938512] Looping around the photos to save general results len do output : 1 /26715006Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382953203', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382953161', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382953107', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382953063', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382953019', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382952671', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382952570', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382952486', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382952397', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382952297', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382952205', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382951400', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382951238', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382951114', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382950951', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382950785', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382950670', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382950077', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382949900', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382949797', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382949696', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382949602', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382949389', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382949036', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382948870', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382948697', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382948465', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382948362', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382948259', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382947287', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382947218', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382947153', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382947111', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382947078', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382947038', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382946545', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382946483', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382946402', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382946340', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382946271', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382946185', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382945785', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382945752', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382945720', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382945670', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382945599', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382945532', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382945250', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382945213', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382945180', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382945145', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382945103', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382945044', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382944640', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382944512', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382944410', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382944313', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382944215', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382944092', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382943499', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382943459', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382943391', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382943328', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382943261', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382943197', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382942951', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382942886', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382942805', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382942703', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382942609', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382942510', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382942064', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382942002', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382941925', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382941836', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382941769', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382941701', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382941309', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382941245', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382941170', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382941106', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382941066', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382941016', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382940665', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382940593', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382940527', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382940463', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382940399', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382940331', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382939856', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382939790', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382939717', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382939643', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382939548', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382939458', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382938816', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382938718', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382938644', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382938581', None, None, None, None, None, '3689627') ('4189', None, None, None, None, None, None, None, '3689627') ('4189', '26715006', '1382938512', None, None, None, None, None, '3689627') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.05384707450866699 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.533116340637207 time spend to save output : 0.05469393730163574 total time spend for step 1 : 1.5878102779388428 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.54user 0.66system 0:04.56elapsed 48%CPU (0avgtext+0avgdata 103808maxresident)k 640inputs+216outputs (2major+49468minor)pagefaults 0swaps