Arman Cohan

Publications
Influence

SciBERT: A Pretrained Language Model for Scientific Text

Iz Beltagy, Kyle Lo, Arman Cohan
Computer Science
EMNLP/IJCNLP
1 March 2019

We release SciBERT, a pretrained language model based on BERT (Devlin et al., 2018) to address the lack of high-quality, large-scale labeled scientific data. Expand

Longformer: The Long-Document Transformer

Iz Beltagy, Matthew E. Peters, Arman Cohan
Computer Science
ArXiv
10 April 2020

Transformer-based models are unable to process long sequences due to their self-attention operation, which scales quadratically with the sequence length, making it easy to process documents of thousands of tokens or longer. Expand

SciBERT: Pretrained Contextualized Embeddings for Scientific Text

Iz Beltagy, Arman Cohan, Kyle Lo
Computer Science
ArXiv
26 March 2019

We release SciBERT, a pretrained contextualized embedding model based on BERT (Devlin et al., 2018) to address the lack of high-quality, large-scale labeled scientific data. Expand

A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents

Arman Cohan, Franck Dernoncourt, +4 authors Nazli Goharian
Computer Science
NAACL-HLT
1 April 2018

We propose the first model for abstractive summarization of single, longer-form documents (e.g., research papers). Expand

CEDR: Contextualized Embeddings for Document Ranking

Sean MacAvaney, Andrew Yates, Arman Cohan, Nazli Goharian
Computer Science
SIGIR
15 April 2019

We propose a joint approach that incorporates BERT's classification vector into existing neural models and show that it outperforms state-of-the-art ad-hoc ranking baselines. Expand

Depression and Self-Harm Risk Assessment in Online Forums

Andrew Yates, Arman Cohan, Nazli Goharian
Computer Science
EMNLP
1 September 2017

We propose methods for identifying posts in support communities that may indicate a risk of self-harm, and demonstrate that our approach outperforms strong baselines on this general forum dataset. Expand

Scientific Article Summarization Using Citation-Context and Article's Discourse Structure

Arman Cohan, Nazli Goharian
Computer Science
EMNLP
1 September 2015

We propose a summarization approach for scientific articles which takes advantage of citation-context and the document discourse model to overcome the problem of inconsistency between the citation summary and the article’s content. Expand

Structural Scaffolds for Citation Intent Classification in Scientific Publications

Arman Cohan, Waleed Ammar, Madeleine van Zuylen, Field Cady
Computer Science
NAACL-HLT
1 April 2019

We propose structural scaffolds, a multitask model to incorporate structural information of scientific papers into citations for effective classification of citation intents. Expand

Pretrained Language Models for Sequential Sentence Classification

Arman Cohan, Iz Beltagy, Daniel King, Bhavana Dalvi, Daniel S. Weld
Computer Science
EMNLP
9 September 2019

We show that pretrained language models, BERT (Devlin et al., 2018) in particular, can be used for this task to capture contextual dependencies without the need for hierarchical encoding. Expand

Fact or Fiction: Verifying Scientific Claims

David Wadden, Kyle Lo, +4 authors Hannaneh Hajishirzi
Computer Science
EMNLP
30 April 2020

We introduce scientific claim verification, a new task to select abstracts from the research literature containing evidence that supports or refutes a given scientific claim, and to identify rationales justifying each decision. Expand

Recommended Authors