Measuring the effectiveness of error messages designed for novice programmers

@inproceedings{Marceau2011MeasuringTE,
  title={Measuring the effectiveness of error messages designed for novice programmers},
  author={Guillaume Marceau and Kathi Fisler and Shriram Krishnamurthi},
  booktitle={SIGCSE '11},
  year={2011}
}
  • Guillaume Marceau, Kathi Fisler, Shriram Krishnamurthi
  • Published in SIGCSE '11 2011
  • Computer Science
  • Good error messages are critical for novice programmers. Re-cognizing this, the DrRacket programming environment provides a series of pedagogically-inspired language subsets with error messages customized to each subset. We apply human-factors research methods to explore the effectiveness of these messages. Unlike existing work in this area, we study messages at a fine-grained level by analyzing the edits students make in response to various classes of errors. We present a rubric (which is not… CONTINUE READING

    Create an AI-powered research feed to stay up to date with new papers like this posted to ArXiv

    Figures, Tables, and Topics from this paper.

    Citations

    Publications citing this paper.
    SHOWING 1-10 OF 63 CITATIONS

    Examining the effects of enhanced compilers on student productivity

    VIEW 6 EXCERPTS
    CITES BACKGROUND, METHODS & RESULTS
    HIGHLY INFLUENCED

    On Novices' Interaction with Compiler Error Messages: A Human Factors Approach

    VIEW 5 EXCERPTS
    CITES BACKGROUND & METHODS
    HIGHLY INFLUENCED

    Usability of Error Messages for Introductory Students

    VIEW 7 EXCERPTS
    CITES BACKGROUND, RESULTS & METHODS
    HIGHLY INFLUENCED

    Report on a User Test and Extension of a Type Debugger for Novice Programmers

    VIEW 7 EXCERPTS
    CITES METHODS
    HIGHLY INFLUENCED

    Experience report: growing programming languages for beginning students

    VIEW 4 EXCERPTS
    CITES BACKGROUND
    HIGHLY INFLUENCED

    FSM Error Messages

    VIEW 5 EXCERPTS
    CITES BACKGROUND
    HIGHLY INFLUENCED

    Beyond Automated Assessment: Building Metacognitive Awareness in Novice Programmers in CS1

    VIEW 9 EXCERPTS
    CITES BACKGROUND & METHODS
    HIGHLY INFLUENCED

    Making Python easier to learn with improved syntax error reporting

    VIEW 3 EXCERPTS
    CITES BACKGROUND
    HIGHLY INFLUENCED

    FILTER CITATIONS BY YEAR

    2010
    2020

    CITATION STATISTICS

    • 15 Highly Influenced Citations

    • Averaged 10 Citations per year from 2017 through 2019

    References

    Publications referenced by this paper.
    SHOWING 1-4 OF 4 REFERENCES

    Identifying Top Java Errors for Novice Programmers

    VIEW 7 EXCERPTS
    HIGHLY INFLUENTIAL

    A First Look at Novice Compilation Behaviour Using BlueJ

    VIEW 8 EXCERPTS
    HIGHLY INFLUENTIAL

    Teaching Java with the BlueJ Environment

    VIEW 8 EXCERPTS
    HIGHLY INFLUENTIAL