# The meaning and use of the area under a receiver operating characteristic (ROC) curve.

@article{Hanley1982TheMA, title={The meaning and use of the area under a receiver operating characteristic (ROC) curve.}, author={James A. Hanley and Barbara J. McNeil}, journal={Radiology}, year={1982}, volume={143 1}, pages={ 29-36 } }

Key ResultA representation and interpretation of the area under a receiver operating characteristic (ROC) curve obtained by the "rating" method, or by mathematical predictions based on patient characteristics, is presented. It is shown that in such a setting the area represents the probability that a randomly chosen diseased subject is (correctly) rated or ranked with greater suspicion than a randomly chosen non-diseased subject. Expand

## 18,745 Citations

### Direct estimation of the area under the receiver operating characteristic curve in the presence of verification bias

- MathematicsStatistics in medicine
- 2009

A new method for directly estimating the AUC in the setting of verification bias based on U-statistics and inverse probability weighting (IPW) is developed and it is shown that the new estimator is equivalent to the empirical AUC derived from the bias-corrected ROC curve arising from the IPW approach.

### A method of comparing the areas under receiver operating characteristic curves derived from the same cases.

- Computer Science, MathematicsRadiology
- 1983

This paper refines the statistical comparison of the areas under two ROC curves derived from the same set of patients by taking into account the correlation between the areas that is induced by the paired nature of the data.

### An Evaluation of Methods for Estimating the Area Under the Receiver Operating Characteristic (ROC) Curve

- MathematicsMedical decision making : an international journal of the Society for Medical Decision Making
- 1985

Generally, the nonparametric method yields lower area estimates than the maximum-likelihood-estimation technique, however, these differences generally were small, particularly with ROC curves derived from five or more cutoff points.

### The ROC Curve and the Area under It as Performance Measures

- Physics
- 2004

Abstract The receiver operating characteristic (ROC) curve is a two-dimensional measure of classification performance. The area under the ROC curve (AUC) is a scalar measure gauging one facet ofâ€¦

### Exact Bootstrap Variances of the Area Under ROC Curve

- Mathematics
- 2007

The area under the Receiver Operating Characteristic (ROC) curve (AUC) and related summary indices are widely used for assessment of accuracy of an individual and comparison of performances ofâ€¦

### The Stata Journal

- Computer Science
- 2002

Three algorithms for computing the variance for the area under the nonparametric ROC curve are commonly used, although ambiguity exists about their behavior under diverse study conditions, and similar asymptotic performance is found.

### Estimating the Area under a Receiver Operating Characteristic Curve For Repeated Measures Design

- Mathematics
- 2003

The receiver operating characteristic (ROC) curve is widely used for diagnosing as well as for judging the discrimination ability of different statistical models. Although theories about ROC curvesâ€¦

### Assessing classifiers in terms of the partial area under the ROC curve

- Computer ScienceComput. Stat. Data Anal.
- 2013

### ROC Curves and the Areas under Them for Dichotomized Tests

- MathematicsMedical decision making : an international journal of the Society for Medical Decision Making
- 1994

The authors present equations for estimating the area under the ROC curve and the AUC when only one pair of a true- and a false-positive rate is given, for inherently logistically and normally distributed data.

### ROC area discrimination (ROCAD) curve: a new method of evaluating the discriminating ability of ordinal scales.

- MedicineJournal of clinical epidemiology
- 2008

## References

SHOWING 1-10 OF 17 REFERENCES

### Basic principles of ROC analysis.

- MedicineSeminars in nuclear medicine
- 1978

### The area above the ordinal dominance graph and the area below the receiver operating characteristic graph

- Mathematics
- 1975

### ROC analysis applied to the evaluation of medical imaging techniques.

- MedicineInvestigative radiology
- 1979

This paper presents a brief description of the ROC, and shows how it provides a measure of diagnostic accuracy that is free of judgmental bias.

### Radiographic applications of receiver operating characteristic (ROC) curves.

- MedicineRadiology
- 1974

The basic concepts underlying the theory and experimental determination of receiver operating characteristic (ROC) curves are discussed and such curves were used to describe the detectability of the image of 2 min Lucite beads in a noisy background of radiographic mottle.

### Maximum-likelihood estimation of parameters of signal-detection theory and determination of confidence intervalsâ€”Rating-method data

- Mathematics
- 1969

### Assessment of diagnostic technologies.

- MedicineScience
- 1979

A general protocol for rigorous evaluation of diagnostic systems in medicine was applied successfully in a comparative study of two radiologic techniques, and computed tomography was found to be substantially more accurate than radionuclide scanning.

### Signal detection theory and psychophysics

- Psychology
- 1966

This book discusses statistical decision theory and sensory processes in signal detection theory and psychophysics and describes how these processes affect decision-making.

### On the equivalence of two recognition measures of short-term memory.

- PsychologyPsychological bulletin
- 1966