AUC: a misleading measure of the performance of predictive distribution models

@article{Lobo2008AUCAM,
  title={AUC: a misleading measure of the performance of predictive distribution models},
  author={J. Lobo and A. Jim{\'e}nez-Valverde and R. Real},
  journal={Global Ecology and Biogeography},
  year={2008},
  volume={17},
  pages={145-151}
}
The area under the receiver operating characteristic (ROC) curve, known as the AUC, is currently considered to be the standard method to assess the accuracy of predictive distribution models. It avoids the supposed subjectivity in the threshold selection process, when continuous probability derived scores are converted to a binary presence‐absence variable, by summarizing overall model performance over all possible thresholds. In this manuscript we review some of the features of this measure… Expand
2,159 Citations

Figures from this paper

Recommendations for using the relative operating characteristic (ROC)
  • 72
Novel Nonparametric Methods For ROC Curves
Revisiting the ROC curve for diagnostic applications with an unbalanced class distribution
  • C. O’Reilly, T. Nielsen
  • Mathematics
  • 2013 8th International Workshop on Systems, Signal Processing and their Applications (WoSSPA)
  • 2013
  • 14
A new concordant partial AUC and partial c statistic for imbalanced data in the evaluation of machine learning algorithms
  • 18
Rethinking receiver operating characteristic analysis applications in ecological niche modeling
  • 895
  • PDF
Threshold-dependence as a desirable attribute for discrimination assessment: implications for the evaluation of species distribution models
  • 52
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 70 REFERENCES
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
  • 17,074
  • PDF
The use of the area under the ROC curve in the evaluation of machine learning algorithms
  • 4,417
  • PDF
Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine.
  • 5,878
  • PDF
Beware the Null Hypothesis: Critical Value Tables for Evaluating Classifiers
  • 7
  • PDF
A comparison of goodness-of-fit tests for the logistic regression model.
  • 1,436
  • PDF
Measuring the accuracy of diagnostic systems.
  • J. Swets
  • Computer Science, Medicine
  • Science
  • 1988
  • 7,335
  • PDF
...
1
2
3
4
5
...