My Computer Is an Honor Student - but How Intelligent Is It? Standardized Tests as a Measure of AI

@article{Clark2016MyCI,
  title={My Computer Is an Honor Student - but How Intelligent Is It? Standardized Tests as a Measure of AI},
  author={Peter Clark and Oren Etzioni},
  journal={AI Magazine},
  year={2016},
  volume={37},
  pages={5-12}
}
Given the well-known limitations of the Turing Test, there is a need for objective tests to both focus attention on, and measure progress towards, the goals of AI. In this paper we argue that machine performance on standardized tests should be a key component of any new measure of AI, because attaining a high level of performance requires solving significant AI problems involving language understanding and world modeling - critical skills for any machine that lays claim to intelligence. In… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 41 CITATIONS

A Survey of Question Answering for Math and Science Problem

VIEW 3 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

From 'F' to 'A' on the N.Y. Regents Science Exams: An Overview of the Aristo Project

VIEW 3 EXCERPTS
CITES METHODS & BACKGROUND

Machine Reading Comprehension: a Literature Review

VIEW 1 EXCERPT
CITES BACKGROUND

References

Publications referenced by this paper.
SHOWING 1-10 OF 28 REFERENCES

The Winograd Schema Challenge

VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

Computing Machinery and Intelligence.

VIEW 3 EXCERPTS
HIGHLY INFLUENTIAL

Answering Elementary Science Questions via Coherent Scene Extraction from Knowledge Graphs

  • Y. Li, P. Clark
  • EMNLP '
  • 2015
VIEW 1 EXCERPT

Parsing Algebraic Word Problems into Equations

VIEW 2 EXCERPTS