SemEval-2018 Task 11: Machine Comprehension Using Commonsense Knowledge

@inproceedings{Ostermann2018SemEval2018T1,
  title={SemEval-2018 Task 11: Machine Comprehension Using Commonsense Knowledge},
  author={Simon Ostermann and Michael Roth and Ashutosh Modi and Stefan Thater and Manfred Pinkal},
  booktitle={SemEval@NAACL-HLT},
  year={2018}
}
This report summarizes the results of the SemEval 2018 task on machine comprehension using commonsense knowledge. For this machine comprehension task, we created a new corpus, MCScript. It contains a high number of questions that require commonsense knowledge for finding the correct answer. 11 teams from 4 different countries participated in this shared task, most of them used neural approaches. The best performing system achieves an accuracy of 83.95%, outperforming the baselines by a large… CONTINUE READING

Figures, Tables, and Topics from this paper.

Citations

Publications citing this paper.
SHOWING 1-10 OF 27 CITATIONS

Evidence Extraction for Machine Reading Comprehension with Deep Probabilistic Logic

  • 2018
VIEW 7 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Jiangnan at SemEval-2018 Task 11: Deep Neural Network with Attention Method for Machine Comprehension Task

  • SemEval@NAACL-HLT
  • 2018
VIEW 4 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Improving Machine Reading Comprehension with General Reading Strategies

VIEW 5 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Commonsense Reasoning Using Theorem Proving and Machine Learning

Sophie Siebert, Claudia Schon, Frieder Stolzenburg
  • CD-MAKE
  • 2019
VIEW 2 EXCERPTS
CITES BACKGROUND

References

Publications referenced by this paper.
SHOWING 1-10 OF 48 REFERENCES