MCScript2.0: A Machine Comprehension Corpus Focused on Script Events and Participants

  title={MCScript2.0: A Machine Comprehension Corpus Focused on Script Events and Participants},
  author={Simon Ostermann and M. Roth and Manfred Pinkal},
  • Simon Ostermann, M. Roth, Manfred Pinkal
  • Published in *SEM@NAACL-HLT 2019
  • Computer Science
  • We introduce MCScript2.0, a machine comprehension corpus for the end-to-end evaluation of script knowledge. MCScript2.0 contains approx. 20,000 questions on approx. 3,500 texts, crowdsourced based on a new collection process that results in challenging questions. Half of the questions cannot be answered from the reading texts, but require the use of commonsense and, in particular, script knowledge. We give a thorough analysis of our corpus and show that while the task is not challenging to… CONTINUE READING
    Commonsense Inference in Natural Language Processing (COIN) - Shared Task Report
    • 4
    • PDF
    Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data
    • 18
    • PDF
    Detecting Everyday Scenarios in Narrative Texts
    • 1
    • PDF
    Cracking the Contextual Commonsense Code: Understanding Commonsense Reasoning Aptitude of Deep Contextual Representations
    • 3
    • Highly Influenced
    • PDF
    Adversarial Training for Commonsense Inference
    • 1
    • PDF


    Publications referenced by this paper.
    MCScript: A Novel Dataset for Assessing Machine Comprehension Using Script Knowledge
    • 43
    • PDF
    NewsQA: A Machine Comprehension Dataset
    • 320
    • PDF
    The NarrativeQA Reading Comprehension Challenge
    • 196
    • PDF
    RACE: Large-scale ReAding Comprehension Dataset From Examinations
    • 327
    • PDF
    A Thorough Examination of the CNN/Daily Mail Reading Comprehension Task
    • 405
    • PDF
    Teaching Machines to Read and Comprehend
    • 1,647
    • PDF
    SemEval-2018 Task 11: Machine Comprehension Using Commonsense Knowledge
    • 72
    • PDF
    Skip N-grams and Ranking Functions for Predicting Script Events
    • 69
    • PDF
    CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledge
    • 110
    • PDF