QuaRTz: An Open-Domain Dataset of Qualitative Relationship Questions

  title={QuaRTz: An Open-Domain Dataset of Qualitative Relationship Questions},
  author={Oyvind Tafjord and Matt Gardner and Kevin Lin and P. Clark},
  • Oyvind Tafjord, Matt Gardner, +1 author P. Clark
  • Published 2019
  • Computer Science
  • ArXiv
  • We introduce the first open-domain dataset, called QuaRTz, for reasoning about textual qualitative relationships. QuaRTz contains general qualitative statements, e.g., “A sunscreen with a higher SPF protects the skin longer.”, twinned with 3864 crowdsourced situated questions, e.g., “Billy is wearing sunscreen with a lower SPF than Lucy. Who will be best protected from the sun?”, plus annotations of the properties being compared. Unlike previous datasets, the general knowledge is textual and… CONTINUE READING
    9 Citations

    Figures, Tables, and Topics from this paper

    Evaluating Models' Local Decision Boundaries via Contrast Sets
    • 16
    • PDF
    Natural Language QA Approaches using Reasoning with External Knowledge
    • 2
    • PDF
    Joint Spatio-Textual Reasoning for Answering Tourism Questions
    • PDF
    Transformers as Soft Reasoners over Language
    • 24
    • PDF
    Can Transformers Reason About Effects of Actions?
    • Highly Influenced
    • PDF
    Critical Thinking for Language Models
    • PDF
    From 'F' to 'A' on the N.Y. Regents Science Exams: An Overview of the Aristo Project
    • 20
    • PDF


    QuaRel: A Dataset and Models for Answering Questions about Qualitative Relationships
    • 14
    • PDF
    Semantic Parsing on Freebase from Question-Answer Pairs
    • 1,027
    • PDF
    HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering
    • 359
    • PDF
    Neural Semantic Parsing with Type Constraints for Semi-Structured Tables
    • 131
    • PDF
    Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
    • 167
    • PDF
    Scaling up Linguistic Processing of Qualitative Processes
    • 6
    • PDF
    RACE: Large-scale ReAding Comprehension Dataset From Examinations
    • 392
    • PDF
    Simple and Effective Multi-Paragraph Reading Comprehension
    • 260
    • PDF
    AllenNLP: A Deep Semantic Natural Language Processing Platform
    • 581
    • PDF
    BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
    • 14,559
    • PDF