Looking Beyond the Surface: A Challenge Set for Reading Comprehension over Multiple Sentences

@inproceedings{Khashabi2018LookingBT,
  title={Looking Beyond the Surface: A Challenge Set for Reading Comprehension over Multiple Sentences},
  author={Daniel Khashabi and Snigdha Chaturvedi and Michael A. Roth and Shyam Upadhyay and Dan Roth},
  booktitle={NAACL-HLT},
  year={2018}
}
We present a reading comprehension challenge in which questions can only be answered by taking into account information from multiple sentences. We solicit and verify questions and answers for this challenge through a 4-step crowdsourcing experiment. Our challenge dataset contains ∼6k questions for +800 paragraphs across 7 different domains (elementary school science, news, travel guides, fiction stories, etc) bringing in linguistic diversity to the texts and to the questions wordings. On a… CONTINUE READING

From This Paper

Figures, tables, results, and topics from this paper.

Key Quantitative Results

  • On a subset of our dataset, we found human solvers to achieve an F1-score of 86.4%.

References

Publications referenced by this paper.
Showing 1-10 of 35 references

Similar Papers

Loading similar papers…