Accountability in peer assessment: examining the effects of reviewing grades on peer ratings and peer feedback

  title={Accountability in peer assessment: examining the effects of reviewing grades on peer ratings and peer feedback},
  author={Melissa Patchan and Christian D. Schunn and Russell Clark},
  journal={Studies in Higher Education},
  pages={2263 - 2278}
ABSTRACT We examined the influence of accountability on the consistency of peer ratings and quality of peer feedback by comparing three conditions: only rating accountability, only feedback accountability, or both rating and feedback accountability. From a large undergraduate course, 287 students’ peer ratings and peer feedback were coded for rating consistency, comment helpfulness, amount of feedback, and feedback features. Because only 30% of the students accurately perceived their assigned… 
Learning to improve the quality peer feedback through experience with peer feedback
Abstract Peer review is regularly found to be a powerful and efficient technique for assessment and feedback, but many students are inexperienced and sometimes struggle to provide meaningful
Does peer assessment promote student learning? A meta-analysis
Abstract In recent years, there has been an increasing use of peer assessment in classrooms and other learning settings. Despite the prevailing view that peer assessment has a positive effect on
The influence of peer assessment training on assessment knowledge and reflective writing skill
  • B. Hoffman
  • Education
    Journal of Applied Research in Higher Education
  • 2019
Purpose The purpose of this paper is to examine the influence of peer-assessment training as a catalyst to enhance student assessment knowledge and the ability to effectively evaluate reflective
The factor structure of the peer-feedback orientation scale (PFOS): toward a measure for assessing students’ peer-feedback dispositions
Abstract This study reports on the quantitative findings of an exploratory sequential mixed methods study in which the underlying factor structure of students’ peer-feedback orientation (i.e.
Machine Learning for the Peer Assessment Credibility
The focus of this research is to detect the credibility level of each assessment performed by students during peer assessment, and to build a classifier that attempts to automatically assess its level of credibility in C5.0 Decision Tree classifier.
The Effects of Providing and Receiving Peer Feedback on Writing Performance and Learning of Secondary School Students
Research has shown that engaging students in peer feedback can help students revise documents and improve their writing skills. But the mechanistic pathways by which skills develop have remained


Online peer assessment: effects of cognitive and affective feedback
This study reports the effects of online peer assessment, in the form of peer grading and peer feedback, on students’ learning. One hundred and eighty one high school students engaged in peer
Validity and reliability of scaffolded peer assessment of writing from instructor and student perspectives
Although peer reviewing of writing is a way to create more writing opportunities in college and university settings, the validity and reliability of peer-generated grades are a major concern. This
Students’ perceptions about peer assessment for writing: their origin and impact on revision work
We investigate students’ negative perceptions about an online peer assessment system for undergraduate writing across the disciplines. Specifically, we consider the nature of students’ resistance to
Learning by reviewing
Peer review of writing provides an alternative to the traditional approach of practicing writing with feedback from an instructor. Most of the limited research on peer review has examined the general
A validation study of students' end comments: Comparing comments by students, a writing instructor, and a content instructor
Analysis of students' comments in comparison with a writing instructor's and a content instructor's comments supports the use of peer review and draws implications for training students and instructors on providing feedback.
Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks
Forty-eight quantitative peer assessment studies comparing peer and teacher marks were subjected to meta-analysis. Peer assessments were found to resemble more closely teacher assessments when global
The Effects of Feedback Elaboration on the Giver of Feedback
This study was designed to measure the effects of varying the degree of elaboration and the use of prototypical examples during reviewing activities on reviewers’ subsequent writing. The assignment
Commenting on Writing
How do comments on student writing from peers compare to those from subject-matter experts? This study examined the types of comments that reviewers produce as well as their perceived helpfulness.
Toward Better Training in Peer Assessment: Does Calibration Help?
This paper categorizes two modes of calibration for peer assessment and discusses the experience with both of them in a pilot study with Expertiza system.
Writing in Natural Sciences: Understanding the Effects of Different Types of Reviewers on the Writing Process
Despite all of the benefits seen with peers as evaluators, there was only a moderate difference in final draft quality, indicating that while peer-review is helpful, there continues to be a need for research regarding how to enhance the benefits.