Apples-to-apples in cross-validation studies: pitfalls in classifier performance measurement

@article{Forman2010ApplestoapplesIC,
  title={Apples-to-apples in cross-validation studies: pitfalls in classifier performance measurement},
  author={George Forman and Martin Scholz},
  journal={SIGKDD Explorations},
  year={2010},
  volume={12},
  pages={49-57}
}
Cross-validation is a mainstay for measuring performance and progress in machine learning. There are subtle differences in how exactly to compute accuracy, F-measure and Area Under the ROC Curve (AUC) in cross-validation studies. However, these details are not discussed in the literature, and incompatible methods are used by various papers and software packages. This leads to inconsistency across the research literature. Anomalies in performance calculations for particular folds and situations… CONTINUE READING
Highly Influential
This paper has highly influenced a number of papers. REVIEW HIGHLY INFLUENTIAL CITATIONS
Highly Cited
This paper has 155 citations. REVIEW CITATIONS

9 Figures & Tables

Topics

Statistics

02040201020112012201320142015201620172018
Citations per Year

155 Citations

Semantic Scholar estimates that this publication has 155 citations based on the available data.

See our FAQ for additional information.