• DOI:10.18653/v1/D19-1250
Corpus ID: 202539551

Language Models as Knowledge Bases?

@inproceedings{Petroni2019LanguageMA,
  title={Language Models as Knowledge Bases?},
  author={F. Petroni and Tim Rockt{\"a}schel and Patrick Lewis and A. Bakhtin and Yuxiang Wu and Alexander H. Miller and S. Riedel},
  booktitle={EMNLP},
  year={2019}
}

• F. Petroni, Tim Rocktäschel, +4 authors S. Riedel
• Published in EMNLP 2019
• Computer Science

Recent progress in pretraining language models on large textual corpora led to a surge of improvements for downstream NLP tasks. Whilst learning linguistic knowledge, these models may also be storing relational knowledge present in the training data, and may be able to answer queries structured as “fill-in-the-blank” cloze statements. Language models have many advantages over structured knowledge bases: they require no schema engineering, allow practitioners to query about an open class of… Expand

View on ACL

arxiv.org

Save to Library

Create Alert

Cite

Launch Research Feed