python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4189' -s datou_current_4189 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2997243 load datou : 4189 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Current got : datou_id : 4189, datou_cur_ids : ['2692259'] with mtr_portfolio_ids : ['21725263'] and first list_photo_ids : [] new path : /proc/2997243/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.021910667419433594 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Wed Mar 26 14:20:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 217),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} L26032025 21725263 Nombre de photos uploadées : 217 / 23040 (0%) 26032025 21725263 Nombre de photos taguées (types de déchets): 0 / 217 (0%) 26032025 21725263 Nombre de photos taguées (volume) : 0 / 217 (0%) elapsed_time : load_data_split_time_score 4.76837158203125e-06 elapsed_time : order_list_meta_photo_and_scores 1.0967254638671875e-05 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.014916181564331055 L elapsed_time : insert_dashboard_record_day_entry 0.02399444580078125 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None elapsed_time : list_photo_by_hashtags 0.007663249969482422 Creating list_photo_total elapsed_time : select_descriptors 0.02008342742919922 26032025 21725263 Nombre de photos avec descriptors (type 5680) : 0 / 217 (0%) Missing descriptors for photos 0 and 1347457244 L0:00:00|ON:Missing descriptors for photos 1347457244 and 1347457248 LMissing descriptors for photos 1347457248 and 1347457254 LMissing descriptors for photos 1347457254 and 1347457264 LMissing descriptors for photos 1347457264 and 1347457275 LMissing descriptors for photos 1347457275 and 1347457281 LMissing descriptors for photos 1347457281 and 1347457561 LMissing descriptors for photos 1347457561 and 1347457563 LMissing descriptors for photos 1347457563 and 1347457567 LMissing descriptors for photos 1347457567 and 1347457573 LMissing descriptors for photos 1347457573 and 1347457581 LMissing descriptors for photos 1347457581 and 1347457589 LMissing descriptors for photos 1347457589 and 1347457895 LMissing descriptors for photos 1347457895 and 1347457901 LMissing descriptors for photos 1347457901 and 1347457905 LMissing descriptors for photos 1347457905 and 1347457907 LMissing descriptors for photos 1347457907 and 1347457910 LMissing descriptors for photos 1347457910 and 1347457913 LMissing descriptors for photos 1347457913 and 1347458217 LMissing descriptors for photos 1347458217 and 1347458225 LMissing descriptors for photos 1347458225 and 1347458230 LMissing descriptors for photos 1347458230 and 1347458235 LMissing descriptors for photos 1347458235 and 1347458239 LMissing descriptors for photos 1347458239 and 1347458244 LMissing descriptors for photos 1347458244 and 1347458536 LMissing descriptors for photos 1347458536 and 1347458543 LMissing descriptors for photos 1347458543 and 1347458549 LMissing descriptors for photos 1347458549 and 1347458553 LMissing descriptors for photos 1347458553 and 1347458556 LMissing descriptors for photos 1347458556 and 1347458559 LMissing descriptors for photos 1347458559 and 1347458839 LMissing descriptors for photos 1347458839 and 1347458848 LMissing descriptors for photos 1347458848 and 1347458857 LMissing descriptors for photos 1347458857 and 1347458860 LMissing descriptors for photos 1347458860 and 1347458862 LMissing descriptors for photos 1347458862 and 1347458865 LMissing descriptors for photos 1347458865 and 1347459155 LMissing descriptors for photos 1347459155 and 1347459160 LMissing descriptors for photos 1347459160 and 1347459167 LMissing descriptors for photos 1347459167 and 1347459170 LMissing descriptors for photos 1347459170 and 1347459173 LMissing descriptors for photos 1347459173 and 1347459174 LMissing descriptors for photos 1347459174 and 1347459425 LMissing descriptors for photos 1347459425 and 1347459426 LMissing descriptors for photos 1347459426 and 1347459432 LMissing descriptors for photos 1347459432 and 1347459443 LMissing descriptors for photos 1347459443 and 1347459450 LMissing descriptors for photos 1347459450 and 1347459714 LMissing descriptors for photos 1347459714 and 1347459719 LMissing descriptors for photos 1347459719 and 1347459727 LMissing descriptors for photos 1347459727 and 1347459736 LMissing descriptors for photos 1347459736 and 1347459746 LMissing descriptors for photos 1347459746 and 1347459753 LMissing descriptors for photos 1347459753 and 1347460025 LMissing descriptors for photos 1347460025 and 1347460029 LMissing descriptors for photos 1347460029 and 1347460034 LMissing descriptors for photos 1347460034 and 1347460039 LMissing descriptors for photos 1347460039 and 1347460047 LMissing descriptors for photos 1347460047 and 1347460053 LMissing descriptors for photos 1347460053 and 1347460315 LMissing descriptors for photos 1347460315 and 1347460320 LMissing descriptors for photos 1347460320 and 1347460325 LMissing descriptors for photos 1347460325 and 1347460330 LMissing descriptors for photos 1347460330 and 1347460335 LMissing descriptors for photos 1347460335 and 1347460339 LMissing descriptors for photos 1347460339 and 1347460599 LMissing descriptors for photos 1347460599 and 1347460609 LMissing descriptors for photos 1347460609 and 1347460615 LMissing descriptors for photos 1347460615 and 1347460622 LMissing descriptors for photos 1347460622 and 1347460625 LMissing descriptors for photos 1347460625 and 1347460627 LMissing descriptors for photos 1347460627 and 1347460863 LMissing descriptors for photos 1347460863 and 1347460869 LMissing descriptors for photos 1347460869 and 1347460875 LMissing descriptors for photos 1347460875 and 1347460880 LMissing descriptors for photos 1347460880 and 1347460886 LMissing descriptors for photos 1347460886 and 1347460891 LMissing descriptors for photos 1347460891 and 1347461123 LMissing descriptors for photos 1347461123 and 1347461128 LMissing descriptors for photos 1347461128 and 1347461130 LMissing descriptors for photos 1347461130 and 1347461135 LMissing descriptors for photos 1347461135 and 1347461142 LMissing descriptors for photos 1347461142 and 1347461148 LMissing descriptors for photos 1347461148 and 1347461390 LMissing descriptors for photos 1347461390 and 1347461396 LMissing descriptors for photos 1347461396 and 1347461400 LMissing descriptors for photos 1347461400 and 1347461405 LMissing descriptors for photos 1347461405 and 1347461411 LMissing descriptors for photos 1347461411 and 1347461416 LMissing descriptors for photos 1347461416 and 1347461672 LMissing descriptors for photos 1347461672 and 1347461680 LMissing descriptors for photos 1347461680 and 1347461686 LMissing descriptors for photos 1347461686 and 1347461693 LMissing descriptors for photos 1347461693 and 1347461699 LMissing descriptors for photos 1347461699 and 1347461704 LMissing descriptors for photos 1347461704 and 1347461920 LMissing descriptors for photos 1347461920 and 1347461921 LMissing descriptors for photos 1347461921 and 1347461926 LMissing descriptors for photos 1347461926 and 1347461935 LMissing descriptors for photos 1347461935 and 1347461944 LMissing descriptors for photos 1347461944 and 1347462205 LMissing descriptors for photos 1347462205 and 1347462215 LMissing descriptors for photos 1347462215 and 1347462218 LMissing descriptors for photos 1347462218 and 1347462220 LMissing descriptors for photos 1347462220 and 1347462223 LMissing descriptors for photos 1347462223 and 1347462228 LMissing descriptors for photos 1347462228 and 1347462489 LMissing descriptors for photos 1347462489 and 1347462496 LMissing descriptors for photos 1347462496 and 1347462502 LMissing descriptors for photos 1347462502 and 1347462510 LMissing descriptors for photos 1347462510 and 1347462519 LMissing descriptors for photos 1347462519 and 1347462524 LMissing descriptors for photos 1347462524 and 1347462757 LMissing descriptors for photos 1347462757 and 1347462761 LMissing descriptors for photos 1347462761 and 1347462763 LMissing descriptors for photos 1347462763 and 1347462764 LMissing descriptors for photos 1347462764 and 1347462768 LMissing descriptors for photos 1347462768 and 1347462772 LMissing descriptors for photos 1347462772 and 1347463021 LMissing descriptors for photos 1347463021 and 1347463024 LMissing descriptors for photos 1347463024 and 1347463029 LMissing descriptors for photos 1347463029 and 1347463032 LMissing descriptors for photos 1347463032 and 1347463036 LMissing descriptors for photos 1347463036 and 1347463043 LMissing descriptors for photos 1347463043 and 1347463295 LMissing descriptors for photos 1347463295 and 1347463301 LMissing descriptors for photos 1347463301 and 1347463306 LMissing descriptors for photos 1347463306 and 1347463311 LMissing descriptors for photos 1347463311 and 1347463317 LMissing descriptors for photos 1347463317 and 1347463323 LMissing descriptors for photos 1347463323 and 1347463562 LMissing descriptors for photos 1347463562 and 1347463570 LMissing descriptors for photos 1347463570 and 1347463576 LMissing descriptors for photos 1347463576 and 1347463581 LMissing descriptors for photos 1347463581 and 1347463587 LMissing descriptors for photos 1347463587 and 1347463590 LMissing descriptors for photos 1347463590 and 1347463806 LMissing descriptors for photos 1347463806 and 1347463809 LMissing descriptors for photos 1347463809 and 1347463818 LMissing descriptors for photos 1347463818 and 1347463822 LMissing descriptors for photos 1347463822 and 1347463828 LMissing descriptors for photos 1347463828 and 1347463833 LMissing descriptors for photos 1347463833 and 1347464037 LMissing descriptors for photos 1347464037 and 1347464044 LMissing descriptors for photos 1347464044 and 1347464049 LMissing descriptors for photos 1347464049 and 1347464055 LMissing descriptors for photos 1347464055 and 1347464061 LMissing descriptors for photos 1347464061 and 1347464064 LMissing descriptors for photos 1347464064 and 1347464231 LMissing descriptors for photos 1347464231 and 1347464234 LMissing descriptors for photos 1347464234 and 1347464236 LMissing descriptors for photos 1347464236 and 1347464242 LMissing descriptors for photos 1347464242 and 1347464247 LMissing descriptors for photos 1347464247 and 1347464475 LMissing descriptors for photos 1347464475 and 1347464482 LMissing descriptors for photos 1347464482 and 1347464485 LMissing descriptors for photos 1347464485 and 1347464489 LMissing descriptors for photos 1347464489 and 1347464491 LMissing descriptors for photos 1347464491 and 1347464493 LMissing descriptors for photos 1347464493 and 1347464696 LMissing descriptors for photos 1347464696 and 1347464698 LMissing descriptors for photos 1347464698 and 1347464700 LMissing descriptors for photos 1347464700 and 1347464702 LMissing descriptors for photos 1347464702 and 1347464704 LMissing descriptors for photos 1347464704 and 1347464707 LMissing descriptors for photos 1347464707 and 1347464887 LMissing descriptors for photos 1347464887 and 1347464890 LMissing descriptors for photos 1347464890 and 1347464892 LMissing descriptors for photos 1347464892 and 1347464894 LMissing descriptors for photos 1347464894 and 1347464900 LMissing descriptors for photos 1347464900 and 1347464905 LMissing descriptors for photos 1347464905 and 1347465087 LMissing descriptors for photos 1347465087 and 1347465093 LMissing descriptors for photos 1347465093 and 1347465100 LMissing descriptors for photos 1347465100 and 1347465105 LMissing descriptors for photos 1347465105 and 1347465108 LMissing descriptors for photos 1347465108 and 1347465113 LMissing descriptors for photos 1347465113 and 1347465696 LMissing descriptors for photos 1347465696 and 1347465698 LMissing descriptors for photos 1347465698 and 1347465703 LMissing descriptors for photos 1347465703 and 1347465709 LMissing descriptors for photos 1347465709 and 1347465715 LMissing descriptors for photos 1347465715 and 1347465720 LMissing descriptors for photos 1347465720 and 1347465985 LMissing descriptors for photos 1347465985 and 1347465990 LMissing descriptors for photos 1347465990 and 1347465994 LMissing descriptors for photos 1347465994 and 1347465999 LMissing descriptors for photos 1347465999 and 1347466001 LMissing descriptors for photos 1347466001 and 1347466003 LMissing descriptors for photos 1347466003 and 1347466281 LMissing descriptors for photos 1347466281 and 1347466282 LMissing descriptors for photos 1347466282 and 1347466284 LMissing descriptors for photos 1347466284 and 1347466288 LMissing descriptors for photos 1347466288 and 1347466295 LMissing descriptors for photos 1347466295 and 1347466305 LMissing descriptors for photos 1347466305 and 1347466467 LMissing descriptors for photos 1347466467 and 1347466468 LMissing descriptors for photos 1347466468 and 1347466473 LMissing descriptors for photos 1347466473 and 1347466481 LMissing descriptors for photos 1347466481 and 1347466778 LMissing descriptors for photos 1347466778 and 1347466786 LMissing descriptors for photos 1347466786 and 1347466791 LMissing descriptors for photos 1347466791 and 1347466798 LMissing descriptors for photos 1347466798 and 1347466800 LMissing descriptors for photos 1347466800 and 1347466803 LMissing descriptors for photos 1347466803 and 1347467073 LMissing descriptors for photos 1347467073 and 1347467077 LMissing descriptors for photos 1347467077 and 1347467083 LMissing descriptors for photos 1347467083 and 1347467087 LMissing descriptors for photos 1347467087 and 1347467091 LMissing descriptors for photos 1347467091 and 1347467097 LMissing descriptors for photos 1347467097 and 1347467350 LMissing descriptors for photos 1347467350 and 1347467357 LMissing descriptors for photos 1347467357 and 1347467363 LMissing descriptors for photos 1347467363 and 1347467367 LMissing descriptors for photos 1347467367 and 1347467374 LMissing descriptors for photos 1347467374 and 1347467380 L 26032025 Removing 0 photos because of the 'same image' condition Total on : 0 Total off : 0.0 list_time_off Warning in study_and_display_distrib_list : min=max : 0.0 0.0 dist_desc Warning in study_and_display_distrib_list : min=max : -1 -1 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 217 time used for this insertion : 0.055325984954833984 photos_removed : len 0 elapsed_time : remove_photo_duplicate 0.08726692199707031 To do, maybe not at the correct place ! .L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.0160825252532959 NUMBER BATCH : 3 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLWe filter photos on hashtag condition ! LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLWe filter photos on hashtag condition ! LLLLLLLLLLLLLLLLLLLLLLLWe filter photos on hashtag condition ! We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 0 elapsed_time : count_nb_balles_and_create_portfolio 0.02794933319091797 # DISPLAY ALL COLLECTED DATA : {'26032025': {'nb_upload': 217, 'nb_taggue_class': 0, 'nb_taggue_densite': 0, 'nb_descriptors': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1347467380, 1347467374, 1347467367, 1347467363, 1347467357, 1347467350, 1347467097, 1347467091, 1347467087, 1347467083, 1347467077, 1347467073, 1347466803, 1347466800, 1347466798, 1347466791, 1347466786, 1347466778, 1347466481, 1347466473, 1347466468, 1347466467, 1347466305, 1347466295, 1347466288, 1347466284, 1347466282, 1347466281, 1347466003, 1347466001, 1347465999, 1347465994, 1347465990, 1347465985, 1347465720, 1347465715, 1347465709, 1347465703, 1347465698, 1347465696, 1347465113, 1347465108, 1347465105, 1347465100, 1347465093, 1347465087, 1347464905, 1347464900, 1347464894, 1347464892, 1347464890, 1347464887, 1347464707, 1347464704, 1347464702, 1347464700, 1347464698, 1347464696, 1347464493, 1347464491, 1347464489, 1347464485, 1347464482, 1347464475, 1347464247, 1347464242, 1347464236, 1347464234, 1347464231, 1347464064, 1347464061, 1347464055, 1347464049, 1347464044, 1347464037, 1347463833, 1347463828, 1347463822, 1347463818, 1347463809, 1347463806, 1347463590, 1347463587, 1347463581, 1347463576, 1347463570, 1347463562, 1347463323, 1347463317, 1347463311, 1347463306, 1347463301, 1347463295, 1347463043, 1347463036, 1347463032, 1347463029, 1347463024, 1347463021, 1347462772] Looping around the photos to save general results len do output : 1 /21725263Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347467380', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347467374', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347467367', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347467363', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347467357', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347467350', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347467097', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347467091', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347467087', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347467083', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347467077', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347467073', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347466803', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347466800', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347466798', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347466791', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347466786', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347466778', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347466481', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347466473', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347466468', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347466467', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347466305', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347466295', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347466288', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347466284', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347466282', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347466281', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347466003', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347466001', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347465999', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347465994', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347465990', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347465985', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347465720', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347465715', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347465709', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347465703', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347465698', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347465696', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347465113', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347465108', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347465105', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347465100', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347465093', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347465087', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464905', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464900', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464894', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464892', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464890', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464887', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464707', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464704', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464702', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464700', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464698', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464696', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464493', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464491', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464489', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464485', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464482', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464475', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464247', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464242', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464236', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464234', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464231', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464064', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464061', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464055', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464049', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464044', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347464037', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463833', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463828', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463822', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463818', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463809', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463806', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463590', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463587', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463581', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463576', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463570', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463562', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463323', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463317', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463311', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463306', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463301', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463295', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463043', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463036', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463032', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463029', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463024', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347463021', None, None, None, None, None, '2692259') ('4189', None, None, None, None, None, None, None, '2692259') ('4189', '21725263', '1347462772', None, None, None, None, None, '2692259') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.038205623626708984 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.299426794052124 time spend to save output : 0.0403902530670166 total time spend for step 1 : 0.3398170471191406 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.23user 0.64system 0:03.87elapsed 48%CPU (0avgtext+0avgdata 99788maxresident)k 0inputs+72outputs (0major+49700minor)pagefaults 0swaps