• DOI:10.18653/v1/N19-1246
Corpus ID: 67855846

DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs

@inproceedings{Dua2019DROPAR,
  title={DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs},
  author={Dheeru Dua and Yizhong Wang and Pradeep Dasigi and Gabriel Stanovsky and Sameer Singh and Matt Gardner},
  booktitle={NAACL-HLT},
  year={2019}
}

Dheeru Dua, Yizhong Wang, +3 authors Matt Gardner

Published in NAACL-HLT 2019

Computer Science

Reading comprehension has recently seen rapid progress, with systems matching humans on the most popular datasets for the task. However, a large body of work has highlighted the brittleness of these systems, showing that there is much work left to be done. We introduce a new reading comprehension benchmark, DROP, which requires Discrete Reasoning Over the content of Paragraphs. In this crowdsourced, adversarially-created, 55k-question benchmark, a system must resolve references in a question… CONTINUE READING

View PDF on arXiv

Save to Library

Create Alert

Cite

Launch Research Feed