MultiQA: An Empirical Investigation of Generalization and Transfer in Reading Comprehension

@inproceedings{Talmor2019MultiQAAE,
  title={MultiQA: An Empirical Investigation of Generalization and Transfer in Reading Comprehension},
  author={Alon Talmor and Jonathan Berant},
  booktitle={ACL},
  year={2019}
}
A large number of reading comprehension (RC) datasets has been created recently, but little analysis has been done on whether they generalize to one another, and the extent to which existing datasets can be leveraged for improving performance on new ones. In this paper, we conduct such an investigation over ten RC datasets, training on one or more source RC datasets, and evaluating generalization, as well as transfer to a target RC dataset. We analyze the factors that contribute to… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 19 CITATIONS

A Discrete Hard EM Approach for Weakly Supervised Question Answering

VIEW 13 EXCERPTS
CITES BACKGROUND
HIGHLY INFLUENCED

Coreference Resolution as Query-based Span Prediction

VIEW 1 EXCERPT
CITES BACKGROUND

References

Publications referenced by this paper.
SHOWING 1-10 OF 44 REFERENCES

NewsQA: A Machine Comprehension Dataset

VIEW 8 EXCERPTS
HIGHLY INFLUENTIAL

Adversarial Examples for Evaluating Reading Comprehension Systems

VIEW 9 EXCERPTS
HIGHLY INFLUENTIAL

AllenNLP: A Deep Semantic Natural Language Processing Platform

VIEW 3 EXCERPTS
HIGHLY INFLUENTIAL

Attention-Guided Answer Distillation for Machine Reading Comprehension

VIEW 1 EXCERPT
HIGHLY INFLUENTIAL