# AUC: a misleading measure of the performance of predictive distribution models

@article{Lobo2008AUCAM, title={AUC: a misleading measure of the performance of predictive distribution models}, author={J. Lobo and A. Jim{\'e}nez-Valverde and R. Real}, journal={Global Ecology and Biogeography}, year={2008}, volume={17}, pages={145-151} }

The area under the receiver operating characteristic (ROC) curve, known as the AUC, is currently considered to be the standard method to assess the accuracy of predictive distribution models. It avoids the supposed subjectivity in the threshold selection process, when continuous probability derived scores are converted to a binary presence‐absence variable, by summarizing overall model performance over all possible thresholds. In this manuscript we review some of the features of this measure… Expand

#### Figures from this paper

#### 2,159 Citations

Insights into the area under the receiver operating characteristic curve (AUC) as a discrimination measure in species distribution modelling

- Mathematics
- 2012

397- PDF

Recommendations for using the relative operating characteristic (ROC)

- Mathematics
- Landscape Ecology
- 2013

72

Revisiting the ROC curve for diagnostic applications with an unbalanced class distribution

- Mathematics
- 2013 8th International Workshop on Systems, Signal Processing and their Applications (WoSSPA)
- 2013

14

A new concordant partial AUC and partial c statistic for imbalanced data in the evaluation of machine learning algorithms

- Mathematics, Computer Science
- BMC Medical Informatics and Decision Making
- 2020

18

Prevalence affects the evaluation of discrimination capacity in presence-absence species distribution models

- Mathematics
- 2021

Rethinking receiver operating characteristic analysis applications in ecological niche modeling

- Computer Science
- 2008

895- PDF

Threshold-dependence as a desirable attribute for discrimination assessment: implications for the evaluation of species distribution models

- Mathematics
- Biodiversity and Conservation
- 2013

52

Deep ROC Analysis and AUC as Balanced Average Accuracy to Improve Model Selection, Understanding and Interpretation

- Computer Science, Mathematics
- ArXiv
- 2021

- PDF

#### References

SHOWING 1-10 OF 70 REFERENCES

The meaning and use of the area under a receiver operating characteristic (ROC) curve.

- Medicine
- Radiology
- 1982

17,074- PDF

The use of the area under the ROC curve in the evaluation of machine learning algorithms

- Computer Science
- Pattern Recognit.
- 1997

4,417- PDF

Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine.

- Chemistry, Medicine
- Clinical chemistry
- 1993

5,878- PDF

Beware the Null Hypothesis: Critical Value Tables for Evaluating Classifiers

- Computer Science
- ECML
- 2005

7- PDF

A comparison of goodness-of-fit tests for the logistic regression model.

- Mathematics, Medicine
- Statistics in medicine
- 1997

1,436- PDF

Selecting thresholds of occurrence in the prediction of species distributions

- Biology, Environmental Science
- 2005

1,934