Kyle Lo

Publications
Influence

SciBERT: A Pretrained Language Model for Scientific Text

Iz Beltagy, Kyle Lo, Arman Cohan
Computer Science
EMNLP/IJCNLP
1 March 2019

We release SciBERT, a pretrained language model based on BERT (Devlin et al., 2018) to address the lack of high-quality, large-scale labeled scientific data. Expand

SciBERT: Pretrained Contextualized Embeddings for Scientific Text

Iz Beltagy, Arman Cohan, Kyle Lo
Computer Science
ArXiv
26 March 2019

We release SciBERT, a pretrained contextualized embedding model based on BERT (Devlin et al., 2018) to address the lack of high-quality, large-scale labeled scientific data. Expand

Don't Stop Pretraining: Adapt Language Models to Domains and Tasks

Suchin Gururangan, Ana Marasović, +4 authors Noah A. Smith
Computer Science
ACL
23 April 2020

We present a study across four domains (biomedical and computer science publications, news, and reviews) and eight classification tasks, showing that a second phase of pretraining in-domain (domain-adaptive pretraining) leads to performance gains, under both high- and low-resource settings. Expand

CORD-19: The Covid-19 Open Research Dataset

Lucy Lu Wang, Kyle Lo, +21 authors Sebastian Kohlmeier
Computer Science, Medicine
NLPCOVID19
22 April 2020

We describe the mechanics of dataset construction, highlighting challenges and key design decisions, provide an overview of how CORD-19 has been used, and preview tools and upcoming shared tasks built around the dataset. Expand

Construction of the Literature Graph in Semantic Scholar

Waleed Ammar, Dirk Groeneveld, +20 authors Oren Etzioni
Computer Science
NAACL-HLT
6 May 2018

We describe a deployed scalable system for organizing published scientific literature into a heterogeneous graph to facilitate algorithmic manipulation and discovery. Expand

TREC-COVID: rationale and structure of an information retrieval shared task for COVID-19

Kirk Roberts, Tasmeer Alam, +6 authors W. Hersh
Computer Science, Medicine
J. Am. Medical Informatics Assoc.
4 May 2020

TREC-COVID is an information retrieval (IR) shared task initiated to support clinicians and clinical research during the COVID-19 pandemic. Expand

S2ORC: The Semantic Scholar Open Research Corpus

Kyle Lo, Lucy Lu Wang, M. Neumann, Rodney Michael Kinney, Daniel S. Weld
Computer Science
ACL
2020

We introduce S2ORC, a large corpus of 81.1M English-language academic papers spanning many academic disciplines. Expand

TREC-COVID: Constructing a Pandemic Information Retrieval Test Collection

E. Voorhees, Tasmeer Alam, +6 authors Lucy Lu Wang
Computer Science
ArXiv
9 May 2020

TREC-COVID is a community evaluation designed to build a test collection that captures the information needs of biomedical researchers using the scientific literature during a pandemic. Expand

Fact or Fiction: Verifying Scientific Claims

David Wadden, Kyle Lo, +4 authors Hannaneh Hajishirzi
Computer Science
EMNLP
30 April 2020

We introduce scientific claim verification, a new task to select abstracts from the research literature containing evidence that supports or refutes a given scientific claim, and to identify rationales justifying each decision. Expand

COVID-19 Open Research Dataset (CORD-19)

Sebastian Kohlmeier, Kyle Lo, Lucy Lu Wang, J. Yang
Computer Science
16 March 2020

Recommended Authors