The meaning and use of the area under a receiver operating characteristic (ROC) curve.

@article{Hanley1982TheMA,
  title={The meaning and use of the area under a receiver operating characteristic (ROC) curve.},
  author={James A. Hanley and Barbara J. McNeil},
  journal={Radiology},
  year={1982},
  volume={143 1},
  pages={
          29-36
        }
}
Key ResultA representation and interpretation of the area under a receiver operating characteristic (ROC) curve obtained by the "rating" method, or by mathematical predictions based on patient characteristics, is presented. It is shown that in such a setting the area represents the probability that a randomly chosen diseased subject is (correctly) rated or ranked with greater suspicion than a randomly chosen non-diseased subject.

Figures and Tables from this paper

Direct estimation of the area under the receiver operating characteristic curve in the presence of verification bias

TLDR
A new method for directly estimating the AUC in the setting of verification bias based on U-statistics and inverse probability weighting (IPW) is developed and it is shown that the new estimator is equivalent to the empirical AUC derived from the bias-corrected ROC curve arising from the IPW approach.

A method of comparing the areas under receiver operating characteristic curves derived from the same cases.

TLDR
This paper refines the statistical comparison of the areas under two ROC curves derived from the same set of patients by taking into account the correlation between the areas that is induced by the paired nature of the data.

An Evaluation of Methods for Estimating the Area Under the Receiver Operating Characteristic (ROC) Curve

  • R. CentorJ. Schwartz
  • Mathematics
    Medical decision making : an international journal of the Society for Medical Decision Making
  • 1985
TLDR
Generally, the nonparametric method yields lower area estimates than the maximum-likelihood-estimation technique, however, these differences generally were small, particularly with ROC curves derived from five or more cutoff points.

The ROC Curve and the Area under It as Performance Measures

Abstract The receiver operating characteristic (ROC) curve is a two-dimensional measure of classification performance. The area under the ROC curve (AUC) is a scalar measure gauging one facet of

Exact Bootstrap Variances of the Area Under ROC Curve

The area under the Receiver Operating Characteristic (ROC) curve (AUC) and related summary indices are widely used for assessment of accuracy of an individual and comparison of performances of

The Stata Journal

TLDR
Three algorithms for computing the variance for the area under the nonparametric ROC curve are commonly used, although ambiguity exists about their behavior under diverse study conditions, and similar asymptotic performance is found.

Estimating the Area under a Receiver Operating Characteristic Curve For Repeated Measures Design

The receiver operating characteristic (ROC) curve is widely used for diagnosing as well as for judging the discrimination ability of different statistical models. Although theories about ROC curves

Assessing classifiers in terms of the partial area under the ROC curve

  • W. Yousef
  • Computer Science
    Comput. Stat. Data Anal.
  • 2013

ROC Curves and the Areas under Them for Dichotomized Tests

TLDR
The authors present equations for estimating the area under the ROC curve and the AUC when only one pair of a true- and a false-positive rate is given, for inherently logistically and normally distributed data.
...

References

SHOWING 1-10 OF 17 REFERENCES

Basic principles of ROC analysis.

  • C. Metz
  • Medicine
    Seminars in nuclear medicine
  • 1978

Statistical significance tests for binormal ROC curves

ROC analysis applied to the evaluation of medical imaging techniques.

  • J. Swets
  • Medicine
    Investigative radiology
  • 1979
TLDR
This paper presents a brief description of the ROC, and shows how it provides a measure of diagnostic accuracy that is free of judgmental bias.

Radiographic applications of receiver operating characteristic (ROC) curves.

TLDR
The basic concepts underlying the theory and experimental determination of receiver operating characteristic (ROC) curves are discussed and such curves were used to describe the detectability of the image of 2 min Lucite beads in a noisy background of radiographic mottle.

Assessment of diagnostic technologies.

TLDR
A general protocol for rigorous evaluation of diagnostic systems in medicine was applied successfully in a comparative study of two radiologic techniques, and computed tomography was found to be substantially more accurate than radionuclide scanning.

Signal detection theory and psychophysics

TLDR
This book discusses statistical decision theory and sensory processes in signal detection theory and psychophysics and describes how these processes affect decision-making.

Biometrika tables for statisticians