Dheeru Dua

Publications16
h-index7
Citations796
Highly Influential Citations95
Author pages are created from data sourced from our academic publisher partnerships and public sources.

Recommended Authors

  • Matt Gardner
  • 79 Publications • 11,139 Citations
  • Luke Zettlemoyer
  • 203 Publications • 30,693 Citations
  • Christopher D. Manning
  • 484 Publications • 127,388 Citations
  • D. Roth
  • 540 Publications • 25,325 Citations
  • Publications
  • Influence
DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs
TLDR
A new reading comprehension benchmark, DROP, which requires Discrete Reasoning Over the content of Paragraphs, and presents a new model that combines reading comprehension methods with simple numerical reasoning to achieve 51% F1. Expand
Generating Natural Adversarial Examples
TLDR
This paper proposes a framework to generate natural and legible adversarial examples that lie on the data manifold, by searching in semantic space of dense and continuous data representation, utilizing the recent advances in generative adversarial networks. Expand
Evaluating Models’ Local Decision Boundaries via Contrast Sets
TLDR
A more rigorous annotation paradigm for NLP that helps to close systematic gaps in the test data, and recommends that the dataset authors manually perturb the test instances in small but meaningful ways that (typically) change the gold label, creating contrast sets. Expand
Evaluating NLP Models via Contrast Sets
TLDR
A new annotation paradigm for NLP is proposed that helps to close systematic gaps in the test data, and it is recommended that after a dataset is constructed, the dataset authors manually perturb the test instances in small but meaningful ways that change the gold label, creating contrast sets. Expand
Dynamic Sampling Strategies for Multi-Task Reading Comprehension
TLDR
This work shows that a simple dynamic sampling strategy, selecting instances for training proportional to the multi-task model’s current performance on a dataset relative to its single task performance, gives substantive gains over prior multi- Task sampling strategies, mitigating the catastrophic forgetting that is common in multi- task learning. Expand
Comprehensive Multi-Dataset Evaluation of Reading Comprehension
TLDR
An evaluation server, ORB, is presented, that reports performance on seven diverse reading comprehension datasets, encouraging and facilitating testing a single model’s capability in understanding a wide variety of reading phenomena. Expand
ORB: An Open Reading Benchmark for Comprehensive Evaluation of Machine Reading Comprehension
TLDR
An evaluation server, ORB, is presented, that reports performance on seven diverse reading comprehension datasets, encouraging and facilitating testing a single model's capability in understanding a wide variety of reading phenomena. Expand
Benefits of Intermediate Annotations in Reading Comprehension
TLDR
It is observed that for any collection budget, spending a fraction of it on intermediate annotations results in improved model performance, for two complex compositional datasets: DROP and Quoref. Expand
PoMo: Generating Entity-Specific Post-Modifiers in Context
TLDR
PoMo, a post-modifier dataset created automatically from news articles reflecting a journalistic need for incorporating entity information that is relevant to a particular news event, is built. Expand
CMU-LTI at KBP 2015 Event Track
TLDR
CMU LTI’s participation in the KBP 2015 Event Track is described and it is found that the combined system is competitive but have room to improve. Expand
...
1
2
...