python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4189' -s datou_current_4189 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 578013 load datou : 4189 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Current got : datou_id : 4189, datou_cur_ids : ['3924844'] with mtr_portfolio_ids : ['27687736'] and first list_photo_ids : [] new path : /proc/578013/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.07498049736022949 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Fri Oct 10 15:30:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 359), ('14', 358)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 717} 10102025 27687736 Nombre de photos uploadées : 717 / 23040 (3%) 10102025 27687736 Nombre de photos taguées (types de déchets): 717 / 717 (100%) 10102025 27687736 Nombre de photos taguées (volume) : 717 / 717 (100%) elapsed_time : load_data_split_time_score 3.337860107421875e-06 elapsed_time : order_list_meta_photo_and_scores 0.00026702880859375 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL elapsed_time : fill_and_build_computed_from_old_data 0.07606983184814453 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.7119333744049072 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags elapsed_time : list_photo_by_hashtags 0.14830565452575684 Creating list_photo_total elapsed_time : select_descriptors 20.22597575187683 10102025 27687736 Nombre de photos avec descriptors (type 5680) : 351 / 351 (100%) ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 1280 photo_id : 1388646670 photo_id_prec : 0 0:00:00|ON:LL0:06:00.327422|OFF:LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL0:06:00.344837|ON:LLMissing descriptors for photos 1388656158 and 1388656341 LMissing descriptors for photos 1388656341 and 1388656348 LMissing descriptors for photos 1388656348 and 1388656399 LMissing descriptors for photos 1388656399 and 1388656781 LMissing descriptors for photos 1388656781 and 1388656796 LMissing descriptors for photos 1388656796 and 1388656814 LMissing descriptors for photos 1388656814 and 1388657015 LMissing descriptors for photos 1388657015 and 1388657045 LMissing descriptors for photos 1388657045 and 1388657076 LMissing descriptors for photos 1388657076 and 1388657130 LMissing descriptors for photos 1388657130 and 1388657145 LMissing descriptors for photos 1388657145 and 1388657155 LMissing descriptors for photos 1388657155 and 1388658408 LMissing descriptors for photos 1388658408 and 1388658412 LMissing descriptors for photos 1388658412 and 1388658429 LMissing descriptors for photos 1388658429 and 1388658586 LMissing descriptors for photos 1388658586 and 1388658612 LMissing descriptors for photos 1388658612 and 1388658651 LMissing descriptors for photos 1388658651 and 1388658693 LMissing descriptors for photos 1388658693 and 1388658696 LMissing descriptors for photos 1388658696 and 1388658714 LMissing descriptors for photos 1388658714 and 1388658806 LMissing descriptors for photos 1388658806 and 1388658814 LMissing descriptors for photos 1388658814 and 1388659247 LMissing descriptors for photos 1388659247 and 1388659344 LMissing descriptors for photos 1388659344 and 1388659409 LMissing descriptors for photos 1388659409 and 1388659414 LMissing descriptors for photos 1388659414 and 1388659420 LMissing descriptors for photos 1388659420 and 1388659427 LMissing descriptors for photos 1388659427 and 1388659441 LMissing descriptors for photos 1388659441 and 1388659510 LLMissing descriptors for photos 1388659519 and 1388659522 LMissing descriptors for photos 1388659522 and 1388659526 LMissing descriptors for photos 1388659526 and 1388659531 LMissing descriptors for photos 1388659531 and 1388659552 LMissing descriptors for photos 1388659552 and 1388659578 LMissing descriptors for photos 1388659578 and 1388659587 LMissing descriptors for photos 1388659587 and 1388659592 LMissing descriptors for photos 1388659592 and 1388659610 LMissing descriptors for photos 1388659610 and 1388659615 LMissing descriptors for photos 1388659615 and 1388659636 LMissing descriptors for photos 1388659636 and 1388660610 LMissing descriptors for photos 1388660610 and 1388661033 LMissing descriptors for photos 1388661033 and 1388661036 LMissing descriptors for photos 1388661036 and 1388661039 LMissing descriptors for photos 1388661039 and 1388661043 LMissing descriptors for photos 1388661043 and 1388661102 LMissing descriptors for photos 1388661102 and 1388661163 LMissing descriptors for photos 1388661163 and 1388661540 LMissing descriptors for photos 1388661540 and 1388661947 LLMissing descriptors for photos 1388661951 and 1388662976 LMissing descriptors for photos 1388662976 and 1388663091 LMissing descriptors for photos 1388663091 and 1388663200 LMissing descriptors for photos 1388663200 and 1388663236 LMissing descriptors for photos 1388663236 and 1388663256 LMissing descriptors for photos 1388663256 and 1388663259 LLMissing descriptors for photos 1388663275 and 1388663276 LMissing descriptors for photos 1388663276 and 1388663277 LMissing descriptors for photos 1388663277 and 1388663280 LLLMissing descriptors for photos 1388739584 and 1388739588 LMissing descriptors for photos 1388739588 and 1388739591 LMissing descriptors for photos 1388739591 and 1388739594 LMissing descriptors for photos 1388739594 and 1388739595 LMissing descriptors for photos 1388739595 and 1388740464 LMissing descriptors for photos 1388740464 and 1388740476 LMissing descriptors for photos 1388740476 and 1388740479 LMissing descriptors for photos 1388740479 and 1388740499 LMissing descriptors for photos 1388740499 and 1388740513 LMissing descriptors for photos 1388740513 and 1388740654 LMissing descriptors for photos 1388740654 and 1388741039 LMissing descriptors for photos 1388741039 and 1388741060 LMissing descriptors for photos 1388741060 and 1388741097 LMissing descriptors for photos 1388741097 and 1388741100 LMissing descriptors for photos 1388741100 and 1388741107 LMissing descriptors for photos 1388741107 and 1388741121 LMissing descriptors for photos 1388741121 and 1388741495 LMissing descriptors for photos 1388741495 and 1388741882 LMissing descriptors for photos 1388741882 and 1388741883 LMissing descriptors for photos 1388741883 and 1388741888 LMissing descriptors for photos 1388741888 and 1388741891 LMissing descriptors for photos 1388741891 and 1388741895 LMissing descriptors for photos 1388741895 and 1388741920 LMissing descriptors for photos 1388741920 and 1388742218 LMissing descriptors for photos 1388742218 and 1388742227 LMissing descriptors for photos 1388742227 and 1388742233 LMissing descriptors for photos 1388742233 and 1388742305 LMissing descriptors for photos 1388742305 and 1388742395 LMissing descriptors for photos 1388742395 and 1388742455 LMissing descriptors for photos 1388742455 and 1388742457 LMissing descriptors for photos 1388742457 and 1388742465 LMissing descriptors for photos 1388742465 and 1388742478 LMissing descriptors for photos 1388742478 and 1388742483 LMissing descriptors for photos 1388742483 and 1388742499 LMissing descriptors for photos 1388742499 and 1388742545 LMissing descriptors for photos 1388742545 and 1388742547 LMissing descriptors for photos 1388742547 and 1388742550 LMissing descriptors for photos 1388742550 and 1388742556 LMissing descriptors for photos 1388742556 and 1388742560 LMissing descriptors for photos 1388742560 and 1388742565 LMissing descriptors for photos 1388742565 and 1388742577 LMissing descriptors for photos 1388742577 and 1388742580 LMissing descriptors for photos 1388742580 and 1388742583 LMissing descriptors for photos 1388742583 and 1388742587 LMissing descriptors for photos 1388742587 and 1388742590 LMissing descriptors for photos 1388742590 and 1388742602 LMissing descriptors for photos 1388742602 and 1388742624 LMissing descriptors for photos 1388742624 and 1388742626 LMissing descriptors for photos 1388742626 and 1388742632 LMissing descriptors for photos 1388742632 and 1388742635 LMissing descriptors for photos 1388742635 and 1388742639 LMissing descriptors for photos 1388742639 and 1388742645 LMissing descriptors for photos 1388742645 and 1388742653 LMissing descriptors for photos 1388742653 and 1388742656 LMissing descriptors for photos 1388742656 and 1388742662 LMissing descriptors for photos 1388742662 and 1388742678 LMissing descriptors for photos 1388742678 and 1388742715 LLLMissing descriptors for photos 1388742738 and 1388742744 LMissing descriptors for photos 1388742744 and 1388742753 LMissing descriptors for photos 1388742753 and 1388742769 LMissing descriptors for photos 1388742769 and 1388742772 LMissing descriptors for photos 1388742772 and 1388742774 LMissing descriptors for photos 1388742774 and 1388742786 LMissing descriptors for photos 1388742786 and 1388742789 LMissing descriptors for photos 1388742789 and 1388742807 LMissing descriptors for photos 1388742807 and 1388742814 LMissing descriptors for photos 1388742814 and 1388742818 LMissing descriptors for photos 1388742818 and 1388742826 LMissing descriptors for photos 1388742826 and 1388742908 LMissing descriptors for photos 1388742908 and 1388743139 LMissing descriptors for photos 1388743139 and 1388743146 LMissing descriptors for photos 1388743146 and 1388743156 LMissing descriptors for photos 1388743156 and 1388743159 LMissing descriptors for photos 1388743159 and 1388743162 LMissing descriptors for photos 1388743162 and 1388743170 LLLMissing descriptors for photos 1388743180 and 1388743186 LMissing descriptors for photos 1388743186 and 1388743191 LMissing descriptors for photos 1388743191 and 1388743192 LMissing descriptors for photos 1388743192 and 1388743253 LMissing descriptors for photos 1388743253 and 1388743256 LMissing descriptors for photos 1388743256 and 1388743259 LMissing descriptors for photos 1388743259 and 1388743263 LMissing descriptors for photos 1388743263 and 1388743266 LMissing descriptors for photos 1388743266 and 1388743388 LMissing descriptors for photos 1388743388 and 1388743425 LMissing descriptors for photos 1388743425 and 1388743451 LMissing descriptors for photos 1388743451 and 1388743478 LMissing descriptors for photos 1388743478 and 1388743485 LMissing descriptors for photos 1388743485 and 1388743498 LMissing descriptors for photos 1388743498 and 1388743501 LMissing descriptors for photos 1388743501 and 1388743626 LMissing descriptors for photos 1388743626 and 1388743631 LMissing descriptors for photos 1388743631 and 1388743639 LMissing descriptors for photos 1388743639 and 1388743644 LMissing descriptors for photos 1388743644 and 1388743649 LMissing descriptors for photos 1388743649 and 1388743660 LLLMissing descriptors for photos 1388743721 and 1388743723 LMissing descriptors for photos 1388743723 and 1388743726 LMissing descriptors for photos 1388743726 and 1388743741 LMissing descriptors for photos 1388743741 and 1388743747 LMissing descriptors for photos 1388743747 and 1388743751 LMissing descriptors for photos 1388743751 and 1388743754 LMissing descriptors for photos 1388743754 and 1388743757 LMissing descriptors for photos 1388743757 and 1388743761 LMissing descriptors for photos 1388743761 and 1388743798 LMissing descriptors for photos 1388743798 and 1388743805 LMissing descriptors for photos 1388743805 and 1388743814 LLMissing descriptors for photos 1388743818 and 1388743826 LMissing descriptors for photos 1388743826 and 1388743846 LMissing descriptors for photos 1388743846 and 1388743848 LMissing descriptors for photos 1388743848 and 1388743849 LMissing descriptors for photos 1388743849 and 1388743851 LMissing descriptors for photos 1388743851 and 1388743853 LMissing descriptors for photos 1388743853 and 1388743855 LLMissing descriptors for photos 1388743882 and 1388743905 LMissing descriptors for photos 1388743905 and 1388743914 LMissing descriptors for photos 1388743914 and 1388743919 LMissing descriptors for photos 1388743919 and 1388743945 LMissing descriptors for photos 1388743945 and 1388743985 LMissing descriptors for photos 1388743985 and 1388743991 LMissing descriptors for photos 1388743991 and 1388743994 LLL4:09:59.843728|OFF:L0:00:00|ON:Missing descriptors for photos 1388744009 and 1388744037 LMissing descriptors for photos 1388744037 and 1388744051 LMissing descriptors for photos 1388744051 and 1388744061 LMissing descriptors for photos 1388744061 and 1388744065 LMissing descriptors for photos 1388744065 and 1388744070 LMissing descriptors for photos 1388744070 and 1388744071 LMissing descriptors for photos 1388744071 and 1388744100 LMissing descriptors for photos 1388744100 and 1388744121 LLMissing descriptors for photos 1388744126 and 1388744128 LMissing descriptors for photos 1388744128 and 1388744130 LMissing descriptors for photos 1388744130 and 1388744154 LMissing descriptors for photos 1388744154 and 1388744161 LLL0:02:59.618355|OFF:L0:00:00|ON:Missing descriptors for photos 1388744209 and 1388744213 LMissing descriptors for photos 1388744213 and 1388744230 LMissing descriptors for photos 1388744230 and 1388744231 LMissing descriptors for photos 1388744231 and 1388744232 LMissing descriptors for photos 1388744232 and 1388744233 LMissing descriptors for photos 1388744233 and 1388744235 LMissing descriptors for photos 1388744235 and 1388744240 LMissing descriptors for photos 1388744240 and 1388744275 LMissing descriptors for photos 1388744275 and 1388744279 LMissing descriptors for photos 1388744279 and 1388744293 LMissing descriptors for photos 1388744293 and 1388744296 LMissing descriptors for photos 1388744296 and 1388744298 LLL0:01:59.816831|OFF:L0:01:00.773818|ON:Missing descriptors for photos 1388744336 and 1388744338 LMissing descriptors for photos 1388744338 and 1388744341 LMissing descriptors for photos 1388744341 and 1388744377 LMissing descriptors for photos 1388744377 and 1388744381 LMissing descriptors for photos 1388744381 and 1388744392 LMissing descriptors for photos 1388744392 and 1388744398 LLMissing descriptors for photos 1388744419 and 1388744424 LLMissing descriptors for photos 1388744494 and 1388744509 LMissing descriptors for photos 1388744509 and 1388744513 LMissing descriptors for photos 1388744513 and 1388744540 LMissing descriptors for photos 1388744540 and 1388744542 LMissing descriptors for photos 1388744542 and 1388744574 LMissing descriptors for photos 1388744574 and 1388744597 LMissing descriptors for photos 1388744597 and 1388744601 LMissing descriptors for photos 1388744601 and 1388744603 LMissing descriptors for photos 1388744603 and 1388744608 LMissing descriptors for photos 1388744608 and 1388744738 LMissing descriptors for photos 1388744738 and 1388744760 LMissing descriptors for photos 1388744760 and 1388744833 LMissing descriptors for photos 1388744833 and 1388744834 LLLL0:03:59.550816|OFF:L0:00:00|ON:Missing descriptors for photos 1388744963 and 1388744967 LLLMissing descriptors for photos 1388745021 and 1388745022 LLLMissing descriptors for photos 1388745034 and 1388745041 LLLMissing descriptors for photos 1388745124 and 1388745128 LLLMissing descriptors for photos 1388745135 and 1388745145 LMissing descriptors for photos 1388745145 and 1388745151 LMissing descriptors for photos 1388745151 and 1388745154 LMissing descriptors for photos 1388745154 and 1388745160 LLLMissing descriptors for photos 1388745167 and 1388745177 LLLMissing descriptors for photos 1388745206 and 1388745210 LMissing descriptors for photos 1388745210 and 1388745215 LMissing descriptors for photos 1388745215 and 1388745218 LMissing descriptors for photos 1388745218 and 1388745221 LMissing descriptors for photos 1388745221 and 1388745240 LMissing descriptors for photos 1388745240 and 1388745243 LMissing descriptors for photos 1388745243 and 1388745247 LMissing descriptors for photos 1388745247 and 1388745251 LMissing descriptors for photos 1388745251 and 1388745266 LMissing descriptors for photos 1388745266 and 1388745327 LMissing descriptors for photos 1388745327 and 1388745373 LMissing descriptors for photos 1388745373 and 1388745378 LMissing descriptors for photos 1388745378 and 1388745380 LLLMissing descriptors for photos 1388745481 and 1388745511 LMissing descriptors for photos 1388745511 and 1388745550 LMissing descriptors for photos 1388745550 and 1388745555 LMissing descriptors for photos 1388745555 and 1388745556 LMissing descriptors for photos 1388745556 and 1388745725 LMissing descriptors for photos 1388745725 and 1388745727 LMissing descriptors for photos 1388745727 and 1388745751 LMissing descriptors for photos 1388745751 and 1388745912 LMissing descriptors for photos 1388745912 and 1388745915 LMissing descriptors for photos 1388745915 and 1388745993 LMissing descriptors for photos 1388745993 and 1388745997 LMissing descriptors for photos 1388745997 and 1388746001 LMissing descriptors for photos 1388746001 and 1388746004 LMissing descriptors for photos 1388746004 and 1388746046 LMissing descriptors for photos 1388746046 and 1388746052 LMissing descriptors for photos 1388746052 and 1388746053 LMissing descriptors for photos 1388746053 and 1388746056 LMissing descriptors for photos 1388746056 and 1388746061 LMissing descriptors for photos 1388746061 and 1388746067 LMissing descriptors for photos 1388746067 and 1388746131 LMissing descriptors for photos 1388746131 and 1388746143 LMissing descriptors for photos 1388746143 and 1388746146 LMissing descriptors for photos 1388746146 and 1388746151 LLLL0:09:59.784970|OFF:L0:00:00|ON:Missing descriptors for photos 1388746183 and 1388746185 LMissing descriptors for photos 1388746185 and 1388746190 LMissing descriptors for photos 1388746190 and 1388746197 LMissing descriptors for photos 1388746197 and 1388746200 LMissing descriptors for photos 1388746200 and 1388746217 LMissing descriptors for photos 1388746217 and 1388746273 LMissing descriptors for photos 1388746273 and 1388746279 LMissing descriptors for photos 1388746279 and 1388746284 LMissing descriptors for photos 1388746284 and 1388746306 LMissing descriptors for photos 1388746306 and 1388746314 LMissing descriptors for photos 1388746314 and 1388746317 LMissing descriptors for photos 1388746317 and 1388746549 LMissing descriptors for photos 1388746549 and 1388747115 LLMissing descriptors for photos 1388747120 and 1388747124 LMissing descriptors for photos 1388747124 and 1388747130 LMissing descriptors for photos 1388747130 and 1388747391 LMissing descriptors for photos 1388747391 and 1388747397 LMissing descriptors for photos 1388747397 and 1388747412 LMissing descriptors for photos 1388747412 and 1388747414 LMissing descriptors for photos 1388747414 and 1388747520 LMissing descriptors for photos 1388747520 and 1388747535 LMissing descriptors for photos 1388747535 and 1388747554 LLL0:05:00.391191|OFF:L0:00:00|ON:Missing descriptors for photos 1388747561 and 1388747563 LLMissing descriptors for photos 1388747602 and 1388747617 LMissing descriptors for photos 1388747617 and 1388747618 LLMissing descriptors for photos 1388747646 and 1388747658 LLMissing descriptors for photos 1388747671 and 1388747675 LMissing descriptors for photos 1388747675 and 1388747683 LMissing descriptors for photos 1388747683 and 1388747688 LMissing descriptors for photos 1388747688 and 1388747700 LLLMissing descriptors for photos 1388747758 and 1388747761 LLL0:02:59.659457|OFF:L0:00:59.813773|ON:LLL0:00:00|OFF:L0:00:00|ON:Missing descriptors for photos 1388747793 and 1388747809 LLLL0:01:00.810805|OFF:LLL0:00:00|ON:Missing descriptors for photos 1388748115 and 1388748123 LLLL0:00:00|OFF:L0:00:59.818887|ON:LLLLMissing descriptors for photos 1388748958 and 1388749349 LMissing descriptors for photos 1388749349 and 1388749405 LLLMissing descriptors for photos 1388749418 and 1388749419 LMissing descriptors for photos 1388749419 and 1388749423 LLLL0:01:59.831448|OFF:LLL0:00:00|ON:Missing descriptors for photos 1388750447 and 1388750463 LLLMissing descriptors for photos 1388750549 and 1388750550 LMissing descriptors for photos 1388750550 and 1388750555 LLLL0:00:59.905307|OFF:L0:00:00|ON:LLMissing descriptors for photos 1388751143 and 1388751209 LMissing descriptors for photos 1388751209 and 1388751233 LLLLLMissing descriptors for photos 1388751246 and 1388751250 LMissing descriptors for photos 1388751250 and 1388751254 LMissing descriptors for photos 1388751254 and 1388751259 LMissing descriptors for photos 1388751259 and 1388751265 LLLL0:03:01.079446|OFF:L0:00:00|ON:Missing descriptors for photos 1388751303 and 1388751315 LMissing descriptors for photos 1388751315 and 1388751318 L 10102025 Removing 53 photos because of the 'same image' condition Total on : 17400.619776000003 list_time_on Total off : 540.751315 list_time_off dist_desc begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 717 Catched exception ! Connect or reconnect ! time used for this insertion : 3.596331834793091 photos_removed : len 53 elapsed_time : remove_photo_duplicate 3.707292318344116 To do, maybe not at the correct place ! .......................................L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.................................................L......L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L..L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L..L.L.L.L.L.L.L..L.L.L.L..L..................................................................................................................................................................L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L..L..L.L.L.L.L.L.L.L.L.L.L.L..L.L.L.L.L.L.L.L..L.L.L.L.L.L.L.L..L.L.L.L.L.L.L.L.L.L..L.L.L.L.L..L.L.L.L.L.L.L.L.L.L.L.L.L.L..L.L.L.L.L.L.L.L..L.L..L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L..L.L.L.L.L.L.L.L.L.L..L.L.L..L.L.L..L.L..L.L.L.L.L..L..L.L..L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.036965370178222656 NUMBER BATCH : 8 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] result_one_balle_Type_JRM:{'day': '10102025', 'map_nb_amount': {0: 3, 1: 49, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 840.3623960018158, 'nb_balles_papier': 0.0005200000000000007, 'begin_time_port': 'image_10102025_10_00_02_329975m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0005200000000000007 result_one_balle_Type_JRM:{'day': '10102025', 'map_nb_amount': {0: 2, 1: 38, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 720.4917938709259, 'nb_balles_papier': 0.0004000000000000004, 'begin_time_port': 'image_10102025_10_15_02_561979m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0004000000000000004 result_one_balle_Type_JRM:{'day': '10102025', 'map_nb_amount': {0: 8, 1: 63, 2: 3, 3: 1, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 840.5837790966034, 'nb_balles_papier': 0.0007500000000000013, 'begin_time_port': 'image_10102025_10_30_02_493547m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0007500000000000013 result_one_balle_Type_JRM:{'day': '10102025', 'map_nb_amount': {0: 10, 1: 70, 2: 8, 3: 1, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 839.5483829975128, 'nb_balles_papier': 0.0008900000000000017, 'begin_time_port': 'image_10102025_10_45_02_788038m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0008900000000000017 result_one_balle_Type_JRM:{'day': '10102025', 'map_nb_amount': {0: 0, 1: 10, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 782.3028070926666, 'nb_balles_papier': 0.0001, 'begin_time_port': 'image_10102025_14_16_02_707171m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0001 LLLLLLLLLLLLLLLLLLLLLLLLLLLresult_one_balle_Type_JRM:{'day': '10102025', 'map_nb_amount': {0: 0, 1: 21, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 781.8618838787079, 'nb_balles_papier': 0.00021, 'begin_time_port': 'image_10102025_14_45_03_152089m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.00021 We have rejected 11 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 6 list_same_port_ids : [27689733] find same portfolio which already exist 27689733 , we will use it list_same_port_ids : [27693193] find same portfolio which already exist 27693193 , we will use it list_same_port_ids : [27693195] find same portfolio which already exist 27693195 , we will use it list_same_port_ids : [27700349] find same portfolio which already exist 27700349 , we will use it list_same_port_ids : [27701664] find same portfolio which already exist 27701664 , we will use it list_same_port_ids : [] Qualite : 0.1451845639987979 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27689733 AND mptpi.`type`=3726 To do Qualite : 0.13518962550696728 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27693193 AND mptpi.`type`=3726 To do Qualite : 0.05765821644418072 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27693195 AND mptpi.`type`=3726 To do Qualite : 0.08617493390644929 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27700349 AND mptpi.`type`=3726 To do Qualite : 0.0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27701664 AND mptpi.`type`=3726 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27703074 AND mptpi.`type`=3726 To do elapsed_time : count_nb_balles_and_create_portfolio 4.742809772491455 # DISPLAY ALL COLLECTED DATA : {'10102025': {'nb_upload': 717, 'nb_taggue_class': 717, 'nb_taggue_densite': 717, 'nb_descriptors': 351}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1388751318, 1388751315, 1388751303, 1388751301, 1388751294, 1388751265, 1388751259, 1388751254, 1388751250, 1388751246, 1388751245, 1388751243, 1388751239, 1388751233, 1388751209, 1388751143, 1388751133, 1388750648, 1388750638, 1388750575, 1388750555, 1388750550, 1388750549, 1388750470, 1388750463, 1388750447, 1388750420, 1388750293, 1388749544, 1388749423, 1388749419, 1388749418, 1388749416, 1388749405, 1388749349, 1388748958, 1388748957, 1388748951, 1388748944, 1388748941, 1388748935, 1388748126, 1388748123, 1388748115, 1388748092, 1388748063, 1388747855, 1388747809, 1388747793, 1388747786, 1388747781, 1388747777, 1388747774, 1388747765, 1388747761, 1388747758, 1388747750, 1388747742, 1388747738, 1388747700, 1388747688, 1388747683, 1388747675, 1388747671, 1388747670, 1388747658, 1388747646, 1388747636, 1388747618, 1388747617, 1388747602, 1388747566, 1388747563, 1388747561, 1388747558, 1388747555, 1388747554, 1388747535, 1388747520, 1388747414, 1388747412, 1388747397, 1388747391, 1388747130, 1388747124, 1388747120, 1388747117, 1388747115, 1388746549, 1388746317, 1388746314, 1388746306, 1388746284, 1388746279, 1388746273, 1388746217, 1388746200, 1388746197, 1388746190, 1388746185] Looping around the photos to save general results len do output : 1 /27687736Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388751318', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388751315', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388751303', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388751301', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388751294', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388751265', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388751259', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388751254', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388751250', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388751246', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388751245', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388751243', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388751239', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388751233', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388751209', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388751143', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388751133', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388750648', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388750638', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388750575', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388750555', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388750550', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388750549', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388750470', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388750463', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388750447', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388750420', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388750293', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388749544', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388749423', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388749419', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388749418', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388749416', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388749405', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388749349', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388748958', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388748957', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388748951', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388748944', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388748941', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388748935', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388748126', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388748123', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388748115', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388748092', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388748063', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747855', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747809', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747793', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747786', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747781', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747777', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747774', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747765', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747761', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747758', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747750', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747742', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747738', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747700', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747688', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747683', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747675', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747671', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747670', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747658', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747646', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747636', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747618', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747617', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747602', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747566', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747563', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747561', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747558', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747555', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747554', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747535', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747520', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747414', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747412', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747397', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747391', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747130', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747124', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747120', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747117', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388747115', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388746549', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388746317', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388746314', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388746306', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388746284', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388746279', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388746273', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388746217', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388746200', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388746197', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388746190', None, None, None, None, None, '3924844') ('4189', None, None, None, None, None, None, None, '3924844') ('4189', '27687736', '1388746185', None, None, None, None, None, '3924844') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.04663801193237305 save_final save missing photos in datou_result : time spend for datou_step_exec : 29.97922992706299 time spend to save output : 0.04754185676574707 total time spend for step 1 : 30.026771783828735 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 2.43user 0.51system 0:34.87elapsed 8%CPU (0avgtext+0avgdata 108404maxresident)k 952inputs+3000outputs (1major+50394minor)pagefaults 0swaps