Topics in semantic representation.

Abstract

Processing language requires the retrieval of concepts from memory in response to an ongoing stream of information. This retrieval is facilitated if one can infer the gist of a sentence, conversation, or document and use that gist to predict related concepts and disambiguate words. This article analyzes the abstract computational problem underlying the extraction and use of gist, formulating this problem as a rational statistical inference. This leads to a novel approach to semantic representation in which word meanings are represented in terms of a set of probabilistic topics. The topic model performs well in predicting word association and the effects of semantic association and ambiguity on a variety of language-processing and memory tasks. It also provides a foundation for developing more richly structured statistical models of language, as the generative process assumed in the topic model can easily be extended to incorporate other kinds of semantic and syntactic structure.

Extracted Key Phrases

23 Figures and Tables

020406020072008200920102011201220132014201520162017
Citations per Year

459 Citations

Semantic Scholar estimates that this publication has 459 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@article{Griffiths2007TopicsIS, title={Topics in semantic representation.}, author={Thomas L Griffiths and Mark Steyvers and Joshua B Tenenbaum}, journal={Psychological review}, year={2007}, volume={114 2}, pages={211-44} }