Automated Scoring of a Summary-Writing Task Designed to Measure Reading Comprehension

@inproceedings{Madnani2013AutomatedSO,
  title={Automated Scoring of a Summary-Writing Task Designed to Measure Reading Comprehension},
  author={Nitin Madnani and Jill Burstein and John Sabatini and Tenaha O'Reilly},
  booktitle={BEA@NAACL-HLT},
  year={2013}
}
We introduce a cognitive framework for measuring reading comprehension that includes the use of novel summary writing tasks. We derive NLP features from the holistic rubric used to score the summaries written by students for such tasks and use them to design a preliminary, automated scoring system. Our results show that the automated approach performs well on summaries written by students for two different passages. 

From This Paper

Figures, tables, and topics from this paper.

Citations

Publications citing this paper.
Showing 1-10 of 11 extracted citations

References

Publications referenced by this paper.
Showing 1-10 of 20 references

The Erater Automated Essay Scoring System

  • J. Burstein, J. Tetreault, N. Madnani.
  • M.D. Shermis and J. Burstein, editors, Handbook…
  • 2013
1 Excerpt

Automated Essay Scoring and Evaluation

  • J. Burstein.
  • Carol Chapelle, editor, The Encyclopedia of…
  • 2012
2 Excerpts

Automatic Summarization

  • A. Nenkova, K. McKeown.
  • Foundations and Trends in Information Retrieval…
  • 2011
1 Excerpt

Summary Street: Computer-guided summary writing

  • E. Kintsch, D. Caccamise, M. Franzke, N. Johnson, S. Dooley.
  • T. K. Landauer, D. S. McNamara, S. Dennis, and W…
  • 2007
3 Excerpts

Summary Street: Computer support for comprehension and writing

  • M. Franzke, E. Kintsch, D. Caccamise, N. Johnson, S. Dooley.
  • Journal of Educational Computing Research, 33:53…
  • 2005
2 Excerpts

Similar Papers

Loading similar papers…