A Formal Proof of a Paradox Associated with Cohen's Kappa


Suppose two judges each classify a group of objects into one of several nominal categories. It has been observed in the literature that, for fixed observed agreement between the judges, Cohen’s kappa penalizes judges with similar marginals compared to judges who produce different marginals. This paper presents a formal proof of this phenomenon. 
DOI: 10.1007/s00357-010-9060-x

2 Figures and Tables



Citations per Year

72 Citations

Semantic Scholar estimates that this publication has 72 citations based on the available data.

See our FAQ for additional information.

  • Presentations referencing similar topics