Getting Closer to AI Complete Question Answering: A Set of Prerequisite Real Tasks

@inproceedings{Rogers2020GettingCT,
  title={Getting Closer to AI Complete Question Answering: A Set of Prerequisite Real Tasks},
  author={Anna Rogers and Olga Kovaleva and Matthew Downey and Anna Rumshisky},
  booktitle={AAAI},
  year={2020}
}
The recent explosion in question answering research produced a wealth of both factoid reading comprehension (RC) and commonsense reasoning datasets. Combining them presents a different kind of task: deciding not simply whether information is present in the text, but also whether a confident guess could be made for the missing information. We present QuAIL, the first RC dataset to combine text-based, world knowledge and unanswerable questions, and to provide question type annotation that would… Expand
14 Citations

Figures, Tables, and Topics from this paper

A guide to the dataset explosion in QA, NLI, and commonsense reasoning
  • PDF
Cross-lingual Training for Multiple-Choice Question Answering
  • Highly Influenced
CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLP
  • PDF
Machine Reading Comprehension: The Role of Contextualized Language Models and Beyond
  • 11
  • PDF
English Machine Reading Comprehension Datasets: A Survey
  • 1
  • Highly Influenced
  • PDF
Survey on evaluation methods for dialogue systems
  • 41
  • PDF
A Primer in BERTology: What We Know About How BERT Works
  • 193
  • PDF
...
1
2
...

References

SHOWING 1-10 OF 35 REFERENCES
QuAC : Question Answering in Context
  • 275
  • PDF
Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
  • 185
  • PDF
HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering
  • 420
  • PDF
DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs
  • 202
  • PDF
SQuAD: 100, 000+ Questions for Machine Comprehension of Text
  • 2,779
  • Highly Influential
  • PDF
TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension
  • 590
  • PDF
The NarrativeQA Reading Comprehension Challenge
  • 247
  • Highly Influential
  • PDF
Know What You Don't Know: Unanswerable Questions for SQuAD
  • 842
  • Highly Influential
  • PDF
...
1
2
3
4
...