python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4189' -s datou_current_4189 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 4029520 load datou : 4189 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Date 2026-10-01 08:35:28.850292 Current got : datou_id : 4189, datou_cur_ids : ['4394941'] with mtr_portfolio_ids : ['31215379'] and first list_photo_ids : [] new path : /proc/4029520/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.08284783363342285 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Thu Oct 1 08:35:29 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 264),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 234} 24092026 31215379 Nombre de photos uploadées : 264 / 23040 (1%) 24092026 31215379 Nombre de photos taguées (types de déchets): 234 / 264 (88%) 24092026 31215379 Nombre de photos taguées (volume) : 234 / 264 (88%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 0.00010275840759277344 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL?????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.014281749725341797 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.6335783004760742 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None elapsed_time : list_photo_by_hashtags 0.1295154094696045 Creating list_photo_total [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device Unable to find some descriptors in ovh, trying to find them in s3 Number missing : 234 Warning this was a bad idea s3 ! elapsed_time : select_descriptors 25.521892786026 Missing descriptors : 234 24092026 31215379 Nombre de photos avec descriptors (type 5680) : 0 / 264 (0%) Missing descriptors for photos 0 and 1418552379 0:00:00|ON:Missing descriptors for photos 1418552379 and 1418552382 Missing descriptors for photos 1418552382 and 1418552386 Missing descriptors for photos 1418552386 and 1418552388 Missing descriptors for photos 1418552388 and 1418552389 Missing descriptors for photos 1418552389 and 1418552390 Missing descriptors for photos 1418552390 and 1418552457 Missing descriptors for photos 1418552457 and 1418552458 Missing descriptors for photos 1418552458 and 1418552460 Missing descriptors for photos 1418552460 and 1418552462 Missing descriptors for photos 1418552462 and 1418552466 Missing descriptors for photos 1418552466 and 1418552469 Missing descriptors for photos 1418552469 and 1418552940 Missing descriptors for photos 1418552940 and 1418552942 Missing descriptors for photos 1418552942 and 1418552944 Missing descriptors for photos 1418552944 and 1418552947 Missing descriptors for photos 1418552947 and 1418552950 Missing descriptors for photos 1418552950 and 1418552953 Missing descriptors for photos 1418552953 and 1418553991 Missing descriptors for photos 1418553991 and 1418553994 Missing descriptors for photos 1418553994 and 1418553997 Missing descriptors for photos 1418553997 and 1418553998 Missing descriptors for photos 1418553998 and 1418553999 Missing descriptors for photos 1418553999 and 1418554000 Missing descriptors for photos 1418554000 and 1418555462 Missing descriptors for photos 1418555462 and 1418555464 Missing descriptors for photos 1418555464 and 1418555468 Missing descriptors for photos 1418555468 and 1418555471 Missing descriptors for photos 1418555471 and 1418555473 Missing descriptors for photos 1418555473 and 1418555474 Missing descriptors for photos 1418555474 and 1418555565 Missing descriptors for photos 1418555565 and 1418555569 Missing descriptors for photos 1418555569 and 1418555573 Missing descriptors for photos 1418555573 and 1418555575 Missing descriptors for photos 1418555575 and 1418555576 Missing descriptors for photos 1418555576 and 1418555578 Missing descriptors for photos 1418555578 and 1418555662 Missing descriptors for photos 1418555662 and 1418555665 Missing descriptors for photos 1418555665 and 1418555668 Missing descriptors for photos 1418555668 and 1418555711 Missing descriptors for photos 1418555711 and 1418555713 Missing descriptors for photos 1418555713 and 1418555714 Missing descriptors for photos 1418555714 and 1418555715 Missing descriptors for photos 1418555715 and 1418555717 Missing descriptors for photos 1418555717 and 1418555719 Missing descriptors for photos 1418555719 and 1418556997 Missing descriptors for photos 1418556997 and 1418556999 Missing descriptors for photos 1418556999 and 1418557002 Missing descriptors for photos 1418557002 and 1418557006 Missing descriptors for photos 1418557006 and 1418557007 Missing descriptors for photos 1418557007 and 1418557009 Missing descriptors for photos 1418557009 and 1418557072 Missing descriptors for photos 1418557072 and 1418557073 Missing descriptors for photos 1418557073 and 1418557076 Missing descriptors for photos 1418557076 and 1418557079 Missing descriptors for photos 1418557079 and 1418557081 Missing descriptors for photos 1418557081 and 1418557083 Missing descriptors for photos 1418557083 and 1418557504 Missing descriptors for photos 1418557504 and 1418557505 Missing descriptors for photos 1418557505 and 1418557506 Missing descriptors for photos 1418557506 and 1418557507 Missing descriptors for photos 1418557507 and 1418557508 Missing descriptors for photos 1418557508 and 1418557510 Missing descriptors for photos 1418557510 and 1418558083 Missing descriptors for photos 1418558083 and 1418558141 Missing descriptors for photos 1418558141 and 1418558198 Missing descriptors for photos 1418558198 and 1418558362 Missing descriptors for photos 1418558362 and 1418558414 Missing descriptors for photos 1418558414 and 1418558632 Missing descriptors for photos 1418558632 and 1418559653 Missing descriptors for photos 1418559653 and 1418559655 Missing descriptors for photos 1418559655 and 1418559658 Missing descriptors for photos 1418559658 and 1418559661 Missing descriptors for photos 1418559661 and 1418559664 Missing descriptors for photos 1418559664 and 1418559665 Missing descriptors for photos 1418559665 and 1418560965 Missing descriptors for photos 1418560965 and 1418560967 Missing descriptors for photos 1418560967 and 1418560968 Missing descriptors for photos 1418560968 and 1418560982 Missing descriptors for photos 1418560982 and 1418560989 Missing descriptors for photos 1418560989 and 1418560990 Missing descriptors for photos 1418560990 and 1418560991 Missing descriptors for photos 1418560991 and 1418560994 Missing descriptors for photos 1418560994 and 1418560997 Missing descriptors for photos 1418560997 and 1418561321 Missing descriptors for photos 1418561321 and 1418561326 Missing descriptors for photos 1418561326 and 1418561349 Missing descriptors for photos 1418561349 and 1418561401 Missing descriptors for photos 1418561401 and 1418561413 Missing descriptors for photos 1418561413 and 1418561425 Missing descriptors for photos 1418561425 and 1418561499 Missing descriptors for photos 1418561499 and 1418561504 Missing descriptors for photos 1418561504 and 1418561506 Missing descriptors for photos 1418561506 and 1418561509 Missing descriptors for photos 1418561509 and 1418561510 Missing descriptors for photos 1418561510 and 1418561512 Missing descriptors for photos 1418561512 and 1418562086 Missing descriptors for photos 1418562086 and 1418562087 Missing descriptors for photos 1418562087 and 1418562088 Missing descriptors for photos 1418562088 and 1418562090 Missing descriptors for photos 1418562090 and 1418562092 Missing descriptors for photos 1418562092 and 1418562095 Missing descriptors for photos 1418562095 and 1418562579 Missing descriptors for photos 1418562579 and 1418562630 Missing descriptors for photos 1418562630 and 1418562765 Missing descriptors for photos 1418562765 and 1418562818 Missing descriptors for photos 1418562818 and 1418562924 Missing descriptors for photos 1418562924 and 1418562992 Missing descriptors for photos 1418562992 and 1418564583 LMissing descriptors for photos 1418564583 and 1418564586 LMissing descriptors for photos 1418564586 and 1418564588 LMissing descriptors for photos 1418564588 and 1418564591 LMissing descriptors for photos 1418564591 and 1418564592 LMissing descriptors for photos 1418564592 and 1418564593 LMissing descriptors for photos 1418564593 and 1418565659 Missing descriptors for photos 1418565659 and 1418565661 Missing descriptors for photos 1418565661 and 1418565662 Missing descriptors for photos 1418565662 and 1418565665 Missing descriptors for photos 1418565665 and 1418565668 Missing descriptors for photos 1418565668 and 1418565670 Missing descriptors for photos 1418565670 and 1418565732 Missing descriptors for photos 1418565732 and 1418565734 Missing descriptors for photos 1418565734 and 1418565737 Missing descriptors for photos 1418565737 and 1418565738 Missing descriptors for photos 1418565738 and 1418565742 Missing descriptors for photos 1418565742 and 1418565746 Missing descriptors for photos 1418565746 and 1418566204 Missing descriptors for photos 1418566204 and 1418566205 Missing descriptors for photos 1418566205 and 1418566206 Missing descriptors for photos 1418566206 and 1418566208 Missing descriptors for photos 1418566208 and 1418566212 Missing descriptors for photos 1418566212 and 1418566216 Missing descriptors for photos 1418566216 and 1418567140 Missing descriptors for photos 1418567140 and 1418567167 Missing descriptors for photos 1418567167 and 1418567169 Missing descriptors for photos 1418567169 and 1418567176 Missing descriptors for photos 1418567176 and 1418567209 Missing descriptors for photos 1418567209 and 1418567215 Missing descriptors for photos 1418567215 and 1418567705 Missing descriptors for photos 1418567705 and 1418567707 Missing descriptors for photos 1418567707 and 1418567710 Missing descriptors for photos 1418567710 and 1418567713 Missing descriptors for photos 1418567713 and 1418567714 Missing descriptors for photos 1418567714 and 1418567715 Missing descriptors for photos 1418567715 and 1418567768 LMissing descriptors for photos 1418567768 and 1418567769 LMissing descriptors for photos 1418567769 and 1418567771 LMissing descriptors for photos 1418567771 and 1418567773 LMissing descriptors for photos 1418567773 and 1418567777 LMissing descriptors for photos 1418567777 and 1418567781 LMissing descriptors for photos 1418567781 and 1418567841 LMissing descriptors for photos 1418567841 and 1418567845 LMissing descriptors for photos 1418567845 and 1418567849 LMissing descriptors for photos 1418567849 and 1418567851 LMissing descriptors for photos 1418567851 and 1418567852 LMissing descriptors for photos 1418567852 and 1418567853 LMissing descriptors for photos 1418567853 and 1418569041 LMissing descriptors for photos 1418569041 and 1418569042 LMissing descriptors for photos 1418569042 and 1418569044 LMissing descriptors for photos 1418569044 and 1418569045 LMissing descriptors for photos 1418569045 and 1418569046 LMissing descriptors for photos 1418569046 and 1418569048 LMissing descriptors for photos 1418569048 and 1418569122 Missing descriptors for photos 1418569122 and 1418569123 Missing descriptors for photos 1418569123 and 1418569125 Missing descriptors for photos 1418569125 and 1418569126 Missing descriptors for photos 1418569126 and 1418569128 Missing descriptors for photos 1418569128 and 1418569129 Missing descriptors for photos 1418569129 and 1418569196 Missing descriptors for photos 1418569196 and 1418569197 Missing descriptors for photos 1418569197 and 1418569198 Missing descriptors for photos 1418569198 and 1418569200 Missing descriptors for photos 1418569200 and 1418569202 Missing descriptors for photos 1418569202 and 1418569204 Missing descriptors for photos 1418569204 and 1418569772 Missing descriptors for photos 1418569772 and 1418569774 Missing descriptors for photos 1418569774 and 1418569775 Missing descriptors for photos 1418569775 and 1418569778 Missing descriptors for photos 1418569778 and 1418569782 Missing descriptors for photos 1418569782 and 1418569784 Missing descriptors for photos 1418569784 and 1418569846 Missing descriptors for photos 1418569846 and 1418569848 Missing descriptors for photos 1418569848 and 1418569849 Missing descriptors for photos 1418569849 and 1418569850 Missing descriptors for photos 1418569850 and 1418569854 Missing descriptors for photos 1418569854 and 1418569856 Missing descriptors for photos 1418569856 and 1418571106 Missing descriptors for photos 1418571106 and 1418571159 Missing descriptors for photos 1418571159 and 1418571228 Missing descriptors for photos 1418571228 and 1418571283 Missing descriptors for photos 1418571283 and 1418571338 Missing descriptors for photos 1418571338 and 1418571409 Missing descriptors for photos 1418571409 and 1418572596 Missing descriptors for photos 1418572596 and 1418572597 Missing descriptors for photos 1418572597 and 1418572598 Missing descriptors for photos 1418572598 and 1418572599 Missing descriptors for photos 1418572599 and 1418572602 Missing descriptors for photos 1418572602 and 1418572604 Missing descriptors for photos 1418572604 and 1418572674 Missing descriptors for photos 1418572674 and 1418572675 Missing descriptors for photos 1418572675 and 1418572676 Missing descriptors for photos 1418572676 and 1418572679 Missing descriptors for photos 1418572679 and 1418572682 Missing descriptors for photos 1418572682 and 1418572685 Missing descriptors for photos 1418572685 and 1418573194 LMissing descriptors for photos 1418573194 and 1418573196 LMissing descriptors for photos 1418573196 and 1418573197 LMissing descriptors for photos 1418573197 and 1418573199 LMissing descriptors for photos 1418573199 and 1418573200 LMissing descriptors for photos 1418573200 and 1418573201 LMissing descriptors for photos 1418573201 and 1418573281 Missing descriptors for photos 1418573281 and 1418573287 Missing descriptors for photos 1418573287 and 1418573320 Missing descriptors for photos 1418573320 and 1418573323 Missing descriptors for photos 1418573323 and 1418573325 Missing descriptors for photos 1418573325 and 1418573328 Missing descriptors for photos 1418573328 and 1418573329 Missing descriptors for photos 1418573329 and 1418573330 Missing descriptors for photos 1418573330 and 1418574274 Missing descriptors for photos 1418574274 and 1418574275 Missing descriptors for photos 1418574275 and 1418574277 Missing descriptors for photos 1418574277 and 1418574280 Missing descriptors for photos 1418574280 and 1418574282 Missing descriptors for photos 1418574282 and 1418574285 Missing descriptors for photos 1418574285 and 1418576132 Missing descriptors for photos 1418576132 and 1418576133 Missing descriptors for photos 1418576133 and 1418576135 Missing descriptors for photos 1418576135 and 1418576140 Missing descriptors for photos 1418576140 and 1418576143 Missing descriptors for photos 1418576143 and 1418576144 Missing descriptors for photos 1418576144 and 1418576200 Missing descriptors for photos 1418576200 and 1418576203 Missing descriptors for photos 1418576203 and 1418576206 Missing descriptors for photos 1418576206 and 1418576208 Missing descriptors for photos 1418576208 and 1418576209 Missing descriptors for photos 1418576209 and 1418576210 Missing descriptors for photos 1418576210 and 1418576272 Missing descriptors for photos 1418576272 and 1418576275 Missing descriptors for photos 1418576275 and 1418576276 Missing descriptors for photos 1418576276 and 1418576277 Missing descriptors for photos 1418576277 and 1418576280 Missing descriptors for photos 1418576280 and 1418576283 Missing descriptors for photos 1418576283 and 1418576381 LMissing descriptors for photos 1418576381 and 1418576383 LMissing descriptors for photos 1418576383 and 1418576388 LMissing descriptors for photos 1418576388 and 1418576389 LMissing descriptors for photos 1418576389 and 1418576390 LMissing descriptors for photos 1418576390 and 1418576391 LMissing descriptors for photos 1418576391 and 1418577894 LMissing descriptors for photos 1418577894 and 1418577897 LMissing descriptors for photos 1418577897 and 1418577903 LMissing descriptors for photos 1418577903 and 1418577904 LMissing descriptors for photos 1418577904 and 1418577905 LMissing descriptors for photos 1418577905 and 1418577906 LMissing descriptors for photos 1418577906 and 1418577968 LMissing descriptors for photos 1418577968 and 1418577970 LMissing descriptors for photos 1418577970 and 1418577971 LMissing descriptors for photos 1418577971 and 1418577976 LMissing descriptors for photos 1418577976 and 1418577979 LMissing descriptors for photos 1418577979 and 1418577980 LMissing descriptors for photos 1418577980 and 1418578097 LMissing descriptors for photos 1418578097 and 1418578098 LMissing descriptors for photos 1418578098 and 1418578099 LMissing descriptors for photos 1418578099 and 1418578100 L 24092026 Removing 0 photos because of the 'same image' condition Total on : 0 Total off : 0.0 list_time_off Warning in study_and_display_distrib_list : min=max : 0.0 0.0 dist_desc Warning in study_and_display_distrib_list : min=max : -1 -1 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 264 time used for this insertion : 0.1217641830444336 photos_removed : len 0 elapsed_time : remove_photo_duplicate 0.21687912940979004 To do, maybe not at the correct place ! .............................................................................................................L.L.L.L.L.L...............................L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L...........................................L.L.L.L.L.L.................................L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.025634288787841797 NUMBER BATCH : 3 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] result_one_balle_Type_JRM:{'day': '24092026', 'map_nb_amount': {0: 22, 1: 36, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 839.7873439788818, 'nb_balles_papier': 0.0009600000000000019, 'begin_time_port': 'image_24092026_10_00_03_312443m0.jpg 1e-05 for time 1, id_amount 1 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0009600000000000019 LLLLLLLLLLLLLLLLLLLLLLLLERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info result_one_balle_Type_JRM:{'day': '24092026', 'map_nb_amount': {0: 12, 1: 21, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 840.0704610347748, 'nb_balles_papier': 0.000620000000000001, 'begin_time_port': 'image_24092026_10_15_02_997350m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.000620000000000001 LLLLLLLLLLLLLLLLLLLLLLLLLLLLERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info LLLLLLLLLLLLLLLLLLLLLLLresult_one_balle_Type_JRM:{'day': '24092026', 'map_nb_amount': {0: 16, 1: 35, 2: 0, 3: 1, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 780.0777268409729, 'nb_balles_papier': 0.0007600000000000013, 'begin_time_port': 'image_24092026_10_30_03_009663m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0007600000000000013 We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 3 list_same_port_ids : [31216258] find same portfolio which already exist 31216258 , we will use it list_same_port_ids : [31216732] find same portfolio which already exist 31216732 , we will use it list_same_port_ids : [] Qualite : 0.14265806410516707 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=31216258 AND mptpi.`type`=3726 To do Qualite : 0.14070815178368976 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=31216732 AND mptpi.`type`=3726 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=31244516 AND mptpi.`type`=3726 To do elapsed_time : count_nb_balles_and_create_portfolio 4.928879022598267 # DISPLAY ALL COLLECTED DATA : {'24092026': {'nb_upload': 264, 'nb_taggue_class': 234, 'nb_taggue_densite': 234, 'nb_descriptors': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1418578100, 1418578099, 1418578098, 1418578097, 1418577980, 1418577979, 1418577976, 1418577971, 1418577970, 1418577968, 1418577906, 1418577905, 1418577904, 1418577903, 1418577897, 1418577894, 1418576391, 1418576390, 1418576389, 1418576388, 1418576383, 1418576381, 1418576283, 1418576280, 1418576277, 1418576276, 1418576275, 1418576272, 1418576210, 1418576209, 1418576208, 1418576206, 1418576203, 1418576200, 1418576144, 1418576143, 1418576140, 1418576135, 1418576133, 1418576132, 1418574285, 1418574282, 1418574280, 1418574277, 1418574275, 1418574274, 1418573330, 1418573329, 1418573328, 1418573325, 1418573323, 1418573320, 1418573287, 1418573281, 1418573201, 1418573200, 1418573199, 1418573197, 1418573196, 1418573194, 1418572685, 1418572682, 1418572679, 1418572676, 1418572675, 1418572674, 1418572604, 1418572602, 1418572599, 1418572598, 1418572597, 1418572596, 1418571409, 1418571338, 1418571283, 1418571228, 1418571159, 1418571106, 1418569856, 1418569854, 1418569850, 1418569849, 1418569848, 1418569846, 1418569784, 1418569782, 1418569778, 1418569775, 1418569774, 1418569772, 1418569204, 1418569202, 1418569200, 1418569198, 1418569197, 1418569196, 1418569129, 1418569128, 1418569126, 1418569125] Looping around the photos to save general results len do output : 1 /31215379Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418578100', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418578099', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418578098', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418578097', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418577980', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418577979', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418577976', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418577971', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418577970', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418577968', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418577906', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418577905', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418577904', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418577903', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418577897', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418577894', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576391', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576390', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576389', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576388', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576383', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576381', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576283', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576280', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576277', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576276', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576275', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576272', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576210', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576209', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576208', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576206', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576203', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576200', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576144', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576143', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576140', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576135', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576133', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418576132', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418574285', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418574282', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418574280', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418574277', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418574275', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418574274', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418573330', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418573329', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418573328', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418573325', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418573323', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418573320', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418573287', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418573281', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418573201', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418573200', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418573199', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418573197', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418573196', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418573194', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418572685', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418572682', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418572679', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418572676', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418572675', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418572674', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418572604', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418572602', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418572599', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418572598', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418572597', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418572596', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418571409', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418571338', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418571283', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418571228', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418571159', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418571106', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569856', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569854', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569850', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569849', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569848', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569846', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569784', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569782', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569778', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569775', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569774', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569772', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569204', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569202', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569200', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569198', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569197', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569196', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569129', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569128', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569126', None, None, None, None, None, '4394941') ('4189', None, None, None, None, None, None, None, '4394941') ('4189', '31215379', '1418569125', None, None, None, None, None, '4394941') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.053482770919799805 save_final save missing photos in datou_result : time spend for datou_step_exec : 31.747315645217896 time spend to save output : 0.054285526275634766 total time spend for step 1 : 31.80160117149353 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.69user 0.92system 0:36.10elapsed 7%CPU (0avgtext+0avgdata 119260maxresident)k 784inputs+160outputs (16major+58945minor)pagefaults 0swaps