python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4189' -s datou_current_4189 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2720868 load datou : 4189 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Date 2026-06-01 08:35:27.770160 Current got : datou_id : 4189, datou_cur_ids : ['4385068'] with mtr_portfolio_ids : ['31135091'] and first list_photo_ids : [] new path : /proc/2720868/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.05557441711425781 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Mon Jun 1 08:35:27 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 365), ('14', 335)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 520} L30052026 31135091 Nombre de photos uploadées : 700 / 23040 (3%) 30052026 31135091 Nombre de photos taguées (types de déchets): 520 / 700 (74%) 30052026 31135091 Nombre de photos taguées (volume) : 520 / 700 (74%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 0.00020837783813476562 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL???????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.028092145919799805 LCatched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.11162829399108887 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None elapsed_time : list_photo_by_hashtags 0.019789695739746094 Creating list_photo_total elapsed_time : select_descriptors 43.61147141456604 30052026 31135091 Nombre de photos avec descriptors (type 5680) : 520 / 700 (74%) ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 1280 photo_id : 1418038409 photo_id_prec : 0 L0:00:00|ON:0:00:00|OFF:LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 1280 vs 0 photo_id : 1418187020 photo_id_prec : 1418187019 L4:24:00.523748|ON:Missing descriptors for photos 1418187020 and 1418187021 LMissing descriptors for photos 1418187021 and 1418187022 LMissing descriptors for photos 1418187022 and 1418187023 LMissing descriptors for photos 1418187023 and 1418187024 LMissing descriptors for photos 1418187024 and 1418187025 LMissing descriptors for photos 1418187025 and 1418187031 LMissing descriptors for photos 1418187031 and 1418187032 LMissing descriptors for photos 1418187032 and 1418187033 LMissing descriptors for photos 1418187033 and 1418187034 LMissing descriptors for photos 1418187034 and 1418187035 LMissing descriptors for photos 1418187035 and 1418187036 LMissing descriptors for photos 1418187036 and 1418187037 LMissing descriptors for photos 1418187037 and 1418187038 LMissing descriptors for photos 1418187038 and 1418187047 LMissing descriptors for photos 1418187047 and 1418187514 LMissing descriptors for photos 1418187514 and 1418187515 LMissing descriptors for photos 1418187515 and 1418187516 LMissing descriptors for photos 1418187516 and 1418187698 LMissing descriptors for photos 1418187698 and 1418187699 LMissing descriptors for photos 1418187699 and 1418187700 LMissing descriptors for photos 1418187700 and 1418187701 LMissing descriptors for photos 1418187701 and 1418187702 LMissing descriptors for photos 1418187702 and 1418187703 LMissing descriptors for photos 1418187703 and 1418187704 LMissing descriptors for photos 1418187704 and 1418187705 LMissing descriptors for photos 1418187705 and 1418187706 LMissing descriptors for photos 1418187706 and 1418187707 LMissing descriptors for photos 1418187707 and 1418187708 LMissing descriptors for photos 1418187708 and 1418187709 LMissing descriptors for photos 1418187709 and 1418187715 LMissing descriptors for photos 1418187715 and 1418187716 LMissing descriptors for photos 1418187716 and 1418187717 LMissing descriptors for photos 1418187717 and 1418187718 LMissing descriptors for photos 1418187718 and 1418187973 LMissing descriptors for photos 1418187973 and 1418188217 LMissing descriptors for photos 1418188217 and 1418188362 LMissing descriptors for photos 1418188362 and 1418188364 LMissing descriptors for photos 1418188364 and 1418188365 LMissing descriptors for photos 1418188365 and 1418188366 LMissing descriptors for photos 1418188366 and 1418188367 LMissing descriptors for photos 1418188367 and 1418188368 LMissing descriptors for photos 1418188368 and 1418188369 LMissing descriptors for photos 1418188369 and 1418188449 LMissing descriptors for photos 1418188449 and 1418188625 LMissing descriptors for photos 1418188625 and 1418188626 LMissing descriptors for photos 1418188626 and 1418188688 LMissing descriptors for photos 1418188688 and 1418188706 LMissing descriptors for photos 1418188706 and 1418188707 LMissing descriptors for photos 1418188707 and 1418188708 LMissing descriptors for photos 1418188708 and 1418188709 LMissing descriptors for photos 1418188709 and 1418188710 LMissing descriptors for photos 1418188710 and 1418188711 LMissing descriptors for photos 1418188711 and 1418188712 LMissing descriptors for photos 1418188712 and 1418188713 LMissing descriptors for photos 1418188713 and 1418188714 LMissing descriptors for photos 1418188714 and 1418188715 LMissing descriptors for photos 1418188715 and 1418188716 LMissing descriptors for photos 1418188716 and 1418188717 LMissing descriptors for photos 1418188717 and 1418188718 LMissing descriptors for photos 1418188718 and 1418188719 LMissing descriptors for photos 1418188719 and 1418188720 LMissing descriptors for photos 1418188720 and 1418188721 LMissing descriptors for photos 1418188721 and 1418188722 LMissing descriptors for photos 1418188722 and 1418188723 LMissing descriptors for photos 1418188723 and 1418188724 LMissing descriptors for photos 1418188724 and 1418188725 LMissing descriptors for photos 1418188725 and 1418188726 LMissing descriptors for photos 1418188726 and 1418188727 LMissing descriptors for photos 1418188727 and 1418188728 LMissing descriptors for photos 1418188728 and 1418188729 LMissing descriptors for photos 1418188729 and 1418188730 LMissing descriptors for photos 1418188730 and 1418188735 LMissing descriptors for photos 1418188735 and 1418188737 LMissing descriptors for photos 1418188737 and 1418188738 LMissing descriptors for photos 1418188738 and 1418188739 LMissing descriptors for photos 1418188739 and 1418188740 LMissing descriptors for photos 1418188740 and 1418188741 LMissing descriptors for photos 1418188741 and 1418188742 LMissing descriptors for photos 1418188742 and 1418188743 LMissing descriptors for photos 1418188743 and 1418188744 LMissing descriptors for photos 1418188744 and 1418188745 LMissing descriptors for photos 1418188745 and 1418188746 LMissing descriptors for photos 1418188746 and 1418188747 LMissing descriptors for photos 1418188747 and 1418188753 LMissing descriptors for photos 1418188753 and 1418188754 LMissing descriptors for photos 1418188754 and 1418188755 LMissing descriptors for photos 1418188755 and 1418188756 LMissing descriptors for photos 1418188756 and 1418188757 LMissing descriptors for photos 1418188757 and 1418188758 LMissing descriptors for photos 1418188758 and 1418188759 LMissing descriptors for photos 1418188759 and 1418188760 LMissing descriptors for photos 1418188760 and 1418188761 LMissing descriptors for photos 1418188761 and 1418188762 LMissing descriptors for photos 1418188762 and 1418188763 LMissing descriptors for photos 1418188763 and 1418188764 LMissing descriptors for photos 1418188764 and 1418189844 LMissing descriptors for photos 1418189844 and 1418189845 LMissing descriptors for photos 1418189845 and 1418189846 LMissing descriptors for photos 1418189846 and 1418189847 LMissing descriptors for photos 1418189847 and 1418189849 LMissing descriptors for photos 1418189849 and 1418189850 LMissing descriptors for photos 1418189850 and 1418190237 LMissing descriptors for photos 1418190237 and 1418190238 LMissing descriptors for photos 1418190238 and 1418190239 LMissing descriptors for photos 1418190239 and 1418190240 LMissing descriptors for photos 1418190240 and 1418190241 LMissing descriptors for photos 1418190241 and 1418190242 LMissing descriptors for photos 1418190242 and 1418190243 LMissing descriptors for photos 1418190243 and 1418190244 LMissing descriptors for photos 1418190244 and 1418190245 LMissing descriptors for photos 1418190245 and 1418190246 LMissing descriptors for photos 1418190246 and 1418190247 LMissing descriptors for photos 1418190247 and 1418190248 LMissing descriptors for photos 1418190248 and 1418190253 LMissing descriptors for photos 1418190253 and 1418190255 LMissing descriptors for photos 1418190255 and 1418190256 LMissing descriptors for photos 1418190256 and 1418190257 LMissing descriptors for photos 1418190257 and 1418190258 LMissing descriptors for photos 1418190258 and 1418190259 LMissing descriptors for photos 1418190259 and 1418190260 LMissing descriptors for photos 1418190260 and 1418190261 LMissing descriptors for photos 1418190261 and 1418190262 LMissing descriptors for photos 1418190262 and 1418190263 LMissing descriptors for photos 1418190263 and 1418190264 LMissing descriptors for photos 1418190264 and 1418190265 LMissing descriptors for photos 1418190265 and 1418190271 LMissing descriptors for photos 1418190271 and 1418190272 LMissing descriptors for photos 1418190272 and 1418190273 LMissing descriptors for photos 1418190273 and 1418190274 LMissing descriptors for photos 1418190274 and 1418190275 LMissing descriptors for photos 1418190275 and 1418190276 LMissing descriptors for photos 1418190276 and 1418190277 LMissing descriptors for photos 1418190277 and 1418190278 LMissing descriptors for photos 1418190278 and 1418190279 LMissing descriptors for photos 1418190279 and 1418190280 LMissing descriptors for photos 1418190280 and 1418190281 LMissing descriptors for photos 1418190281 and 1418190282 LMissing descriptors for photos 1418190282 and 1418190287 LMissing descriptors for photos 1418190287 and 1418190289 LMissing descriptors for photos 1418190289 and 1418190290 LMissing descriptors for photos 1418190290 and 1418190291 LMissing descriptors for photos 1418190291 and 1418190292 LMissing descriptors for photos 1418190292 and 1418190293 LMissing descriptors for photos 1418190293 and 1418190294 LMissing descriptors for photos 1418190294 and 1418190295 LMissing descriptors for photos 1418190295 and 1418190296 LMissing descriptors for photos 1418190296 and 1418190297 LMissing descriptors for photos 1418190297 and 1418190298 LMissing descriptors for photos 1418190298 and 1418190299 LMissing descriptors for photos 1418190299 and 1418190795 LMissing descriptors for photos 1418190795 and 1418191179 LMissing descriptors for photos 1418191179 and 1418191518 LMissing descriptors for photos 1418191518 and 1418191829 LMissing descriptors for photos 1418191829 and 1418192120 LMissing descriptors for photos 1418192120 and 1418192273 LMissing descriptors for photos 1418192273 and 1418192274 LMissing descriptors for photos 1418192274 and 1418192275 LMissing descriptors for photos 1418192275 and 1418192276 LMissing descriptors for photos 1418192276 and 1418192277 LMissing descriptors for photos 1418192277 and 1418192278 LMissing descriptors for photos 1418192278 and 1418192279 LMissing descriptors for photos 1418192279 and 1418192766 LMissing descriptors for photos 1418192766 and 1418192798 LMissing descriptors for photos 1418192798 and 1418192799 LMissing descriptors for photos 1418192799 and 1418192800 LMissing descriptors for photos 1418192800 and 1418192801 LMissing descriptors for photos 1418192801 and 1418192802 LMissing descriptors for photos 1418192802 and 1418192803 LMissing descriptors for photos 1418192803 and 1418192804 LMissing descriptors for photos 1418192804 and 1418192805 LMissing descriptors for photos 1418192805 and 1418192806 LMissing descriptors for photos 1418192806 and 1418192807 LMissing descriptors for photos 1418192807 and 1418192808 LMissing descriptors for photos 1418192808 and 1418192814 LMissing descriptors for photos 1418192814 and 1418192815 LMissing descriptors for photos 1418192815 and 1418192816 LMissing descriptors for photos 1418192816 and 1418192817 LMissing descriptors for photos 1418192817 and 1418192818 LMissing descriptors for photos 1418192818 and 1418192819 L 30052026 Removing 519 photos because of the 'same image' condition Total on : 0.0 list_time_on Warning in study_and_display_distrib_list : min=max : 0.0 0.0 Total off : 15840.523748 list_time_off dist_desc begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 700 time used for this insertion : 0.42035841941833496 photos_removed : len 519 elapsed_time : remove_photo_duplicate 0.4824862480163574 To do, maybe not at the correct place ! .L..L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.02036762237548828 NUMBER BATCH : 4 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLWe filter photos on hashtag condition ! LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLWe filter photos on hashtag condition ! LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLWe filter photos on hashtag condition ! We have rejected 1 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 0 elapsed_time : count_nb_balles_and_create_portfolio 0.015134334564208984 # DISPLAY ALL COLLECTED DATA : {'30052026': {'nb_upload': 700, 'nb_taggue_class': 520, 'nb_taggue_densite': 520, 'nb_descriptors': 520}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1418192819, 1418192818, 1418192817, 1418192816, 1418192815, 1418192814, 1418192808, 1418192807, 1418192806, 1418192805, 1418192804, 1418192803, 1418192802, 1418192801, 1418192800, 1418192799, 1418192798, 1418192766, 1418192279, 1418192278, 1418192277, 1418192276, 1418192275, 1418192274, 1418192273, 1418192120, 1418191829, 1418191518, 1418191179, 1418190795, 1418190299, 1418190298, 1418190297, 1418190296, 1418190295, 1418190294, 1418190293, 1418190292, 1418190291, 1418190290, 1418190289, 1418190287, 1418190282, 1418190281, 1418190280, 1418190279, 1418190278, 1418190277, 1418190276, 1418190275, 1418190274, 1418190273, 1418190272, 1418190271, 1418190265, 1418190264, 1418190263, 1418190262, 1418190261, 1418190260, 1418190259, 1418190258, 1418190257, 1418190256, 1418190255, 1418190253, 1418190248, 1418190247, 1418190246, 1418190245, 1418190244, 1418190243, 1418190242, 1418190241, 1418190240, 1418190239, 1418190238, 1418190237, 1418189850, 1418189849, 1418189847, 1418189846, 1418189845, 1418189844, 1418188764, 1418188763, 1418188762, 1418188761, 1418188760, 1418188759, 1418188758, 1418188757, 1418188756, 1418188755, 1418188754, 1418188753, 1418188747, 1418188746, 1418188745, 1418188744] Looping around the photos to save general results len do output : 1 /31135091Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192819', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192818', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192817', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192816', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192815', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192814', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192808', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192807', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192806', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192805', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192804', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192803', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192802', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192801', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192800', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192799', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192798', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192766', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192279', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192278', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192277', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192276', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192275', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192274', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192273', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418192120', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418191829', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418191518', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418191179', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190795', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190299', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190298', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190297', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190296', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190295', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190294', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190293', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190292', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190291', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190290', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190289', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190287', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190282', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190281', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190280', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190279', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190278', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190277', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190276', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190275', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190274', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190273', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190272', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190271', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190265', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190264', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190263', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190262', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190261', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190260', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190259', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190258', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190257', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190256', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190255', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190253', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190248', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190247', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190246', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190245', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190244', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190243', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190242', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190241', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190240', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190239', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190238', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418190237', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418189850', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418189849', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418189847', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418189846', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418189845', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418189844', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418188764', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418188763', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418188762', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418188761', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418188760', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418188759', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418188758', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418188757', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418188756', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418188755', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418188754', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418188753', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418188747', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418188746', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418188745', None, None, None, None, None, '4385068') ('4189', None, None, None, None, None, None, None, '4385068') ('4189', '31135091', '1418188744', None, None, None, None, None, '4385068') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.0474703311920166 save_final save missing photos in datou_result : time spend for datou_step_exec : 44.44570827484131 time spend to save output : 0.04831695556640625 total time spend for step 1 : 44.494025230407715 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 2.28user 0.80system 0:47.11elapsed 6%CPU (0avgtext+0avgdata 117116maxresident)k 624inputs+4248outputs (16major+57901minor)pagefaults 0swaps