A practical application of analysing weighted kappa for panels of experts and EQA schemes in pathology.

@article{Wright2011APA,
  title={A practical application of analysing weighted kappa for panels of experts and EQA schemes in pathology.},
  author={Karen C Wright and Patricia M Harnden and Sue Moss and Daniel Berney and Jane Westfield Melia},
  journal={Journal of clinical pathology},
  year={2011},
  volume={64 3},
  pages={257-60}
}
BACKGROUND Kappa statistics are frequently used to analyse observer agreement for panels of experts and External Quality Assurance (EQA) schemes and generally treat all disagreements as total disagreement. However, the differences between ordered categories may not be of equal importance (eg, the difference between grades 1 vs 2 compared with 1 vs 3). Weighted kappa can be used to adjust for this when comparing a small number of readers, but this has not as yet been applied to the large number… CONTINUE READING