Combining assessment scores--a variable feast.

Abstract

BACKGROUND In medical education grades are often determined by combining the scores of different assessments. While the psychometric literature recommends that the variance in each assessment be identical, there is limited discussion of the impact of different methods of combining scores. METHOD Eight mock assessment results were created and used to develop an overall assessment that consisted of four types of assessments that were undertaken twice in a year. Various methods of combining scores were then used. The methods used two mechanisms for standardising results and a number of algorithms for combining scores. The impact of using the standard error of measurement was also investigated. RESULTS The number of 'students' failing ranged from five (simple addition of scores/8) to 30 (standardisation of scores, add scores/8, plus pass each type of assessment). DISCUSSION There is a large variation in the number of students failing associated with different methods of combining scores. CONCLUSION Choosing a method to produce a combined score is a non-trivial exercise. The impact on student progression can be significant and whatever method is chosen will require justification.

DOI: 10.1080/01421590802043843

Cite this paper

@article{Wilson2008CombiningAS, title={Combining assessment scores--a variable feast.}, author={Ian Wilson}, journal={Medical teacher}, year={2008}, volume={30 4}, pages={428-30} }