Answering the Call for a Standard Reliability Measure for Coding Data

@article{Hayes2007AnsweringTC,
  title={Answering the Call for a Standard Reliability Measure for Coding Data},
  author={A. Hayes and K. Krippendorff},
  journal={Communication Methods and Measures},
  year={2007},
  volume={1},
  pages={77 - 89}
}
In content analysis and similar methods, data are typically generated by trained human observers who record or transcribe textual, pictorial, or audible matter in terms suitable for analysis. [...] Key Method It is general in that it can be used regardless of the number of observers, levels of measurement, sample sizes, and presence or absence of missing data. To facilitate the adoption of this recommendation, we describe a freely available macro written for SPSS and SAS to calculate Krippendorff's alpha and…Expand
2,606 Citations
Agreement and Information in the Reliability of Coding
  • 223
Systematic and Random Disagreement and the Reliability of Nominal Data
  • 24
The Reliability of Multi-Valued Coding of Data
  • 11
Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial.
  • Kevin A Hallgren
  • Computer Science, Medicine
  • Tutorials in quantitative methods for psychology
  • 2012
  • 2,137
  • PDF
Computing Krippendorff's Alpha-Reliability
  • 466
  • PDF
Inter-Coder Agreement for Improving Reliability in Software Engineering Qualitative Research
  • Highly Influenced
  • PDF
Correcting Measurement Error in Content Analysis
  • 8
  • PDF
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 32 REFERENCES
Estimating the Reliability, Systematic Error and Random Error of Interval Data
  • 260
Coefficient Kappa: Some Uses, Misuses, and Alternatives
  • 899
A Call for Standardization in Content Analysis Reliability
  • 54
On Agreement Indices for Nominal Data
  • 90
A SAS MACRO for calculating intercoder agreement in content analysis
  • 39
Another look at interrater agreement.
  • R. Zwick
  • Medicine
  • Psychological bulletin
  • 1988
  • 64
  • PDF
A Coefficient of Agreement for Nominal Scales
  • 28,094
  • PDF
...
1
2
3
4
...