Dynamics of Peer Grading: An Empirical Study

  title={Dynamics of Peer Grading: An Empirical Study},
  author={Luca de Alfaro and Michael Shavlovsky},
Peer grading is widely used in MOOCs and in standard university settings. The quality of grades obtained via peer grading is essential for the educational process. In this work, we study the factors that influence errors in peer grading. We analyze 288 assignments with 25,633 submissions and 113,169 reviews conducted with CrowdGrader, a web based peer grading tool. First, we found that large grading errors are generally more closely correlated with hard-tograde submission, rather than with… CONTINUE READING

From This Paper

Figures, tables, and topics from this paper.


Publications citing this paper.


Publications referenced by this paper.
Showing 1-10 of 21 references

Tuned Models of Peer Assessment in MOOCs

EDM • 2013
View 6 Excerpts
Highly Influenced

Dynamics of peer grading: An empirical study

L. de Alfaro, M. Shavlovsky
Technical Report UCSC-SOE-16-04, School of Engineering, University of California, • 2016
View 2 Excerpts

An analysis of peer-submitted and peer-reviewed answer rationales, in an asynchronous peer instruction based learning environment

S. Bhatnagar, M. Desmarais, +3 authors E. S. Charles
Proceedings of the 8th International Conference on Educational Data Mining, • 2015
View 2 Excerpts

Shavlovsky. CrowdGrader: A tool for crowdsourcing the evaluation of homework assignments

M. L. de Alfaro
In Proceedings of the 45th ACM technical symposium on Computer science education, • 2014
View 2 Excerpts

Students’ and instructors’ use of massive open online courses (MOOCs): Motivations and challenges

K. F. Hew, W. S. Cheung
Educational Research Review, • 2014
View 1 Excerpt

Assessing Writing in MOOCs: Automated Essay Scoring and Calibrated Peer Review (TM)

S. P. Balfour
Research & Practice in Assessment, • 2013
View 1 Excerpt

CritViz: A Network Peer Critique Structure for Large Classrooms

J. Sadauskas, D. Tinapple, L. Olson, R. Atkinson
In EdMedia: World Conference on Educational Media and Technology, • 2013
View 1 Excerpt

Similar Papers

Loading similar papers…