Dynamic topic models

Abstract

A family of probabilistic time series models is developed to analyze the time evolution of topics in large document collections. The approach is to use state space models on the natural parameters of the multinomial distributions that represent the topics. Variational approximations based on Kalman filters and nonparametric wavelet regression are developed to carry out approximate posterior inference over the latent topics. In addition to giving quantitative, predictive models of a sequential corpus, dynamic topic models provide a qualitative window into the contents of a large document collection. The models are demonstrated by analyzing the OCR'ed archives of the journal <i>Science</i> from 1880 through 2000.

DOI: 10.1145/1143844.1143859

Extracted Key Phrases

5 Figures and Tables

050100150'06'07'08'09'10'11'12'13'14'15'16'17
Citations per Year

1,216 Citations

Semantic Scholar estimates that this publication has 1,216 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@inproceedings{Blei2006DynamicTM, title={Dynamic topic models}, author={David M. Blei and John D. Lafferty}, booktitle={ICML}, year={2006} }