• DOI:10.18653/v1/D19-1383
Corpus ID: 202542261

Pretrained Language Models for Sequential Sentence Classification

@article{Cohan2019PretrainedLM,
  title={Pretrained Language Models for Sequential Sentence Classification},
  author={Arman Cohan and Iz Beltagy and Daniel King and Bhavana Dalvi and Daniel S. Weld},
  journal={ArXiv},
  year={2019},
  volume={abs/1909.04054}
}

• Arman Cohan, Iz Beltagy, +2 authors Daniel S. Weld
• Published 2019
• Computer Science
• ArXiv

As a step toward better document-level understanding, we explore classification of a sequence of sentences into their corresponding categories, a task that requires understanding sentences in context of the document. Recent successful models for this task have used hierarchical models to contextualize sentence representations, and Conditional Random Fields (CRFs) to incorporate dependencies between subsequent labels. In this work, we show that pretrained language models, BERT (Devlin et al… Expand

View on ACL

arxiv.org

Save to Library

Create Alert

Cite

Launch Research Feed