Regularized Discriminant Analysis

@article{Friedman1989RegularizedDA,
  title={Regularized Discriminant Analysis},
  author={J. Friedman},
  journal={Journal of the American Statistical Association},
  year={1989},
  volume={84},
  pages={165-175}
}
  • J. Friedman
  • Published 1989
  • Mathematics
  • Journal of the American Statistical Association
    • Abstract Linear and quadratic discriminant analysis are considered in the small-sample, high-dimensional setting. Alternatives to the usual maximum likelihood (plug-in) estimates for the covariance matrices are proposed. These alternatives are characterized by two parameters, the values of which are customized to individual situations by jointly minimizing a sample-based estimate of future misclassification risk. Computationally fast implementations are presented, and the efficacy of the… CONTINUE READING
    View via Publisher
    slac.stanford.edu
    2,189 Citations
    Highly Influential Citations
    260
    Background Citations
    514
    Methods Citations
    907
    Results Citations
    13

    Tables from this paper

    Tables

    2,189 Citations
    Citation Type

    Citation Type

    Shrinkage parameter for the modified linear discriminant analysis
    • A. Mkhadri
    • Mathematics, Computer Science
    • Pattern Recognit. Lett.
    • 1995
    • 16
    • PDF
    Asymptotically Bias-Corrected Regularized Linear Discriminant Analysis for Cost-Sensitive Binary Classification
    A Simple Regularization Procedure for Discriminant Analysis
    • 1
    • Highly Influenced
    Regularization in discriminant analysis: an overview
    • 32
    Dimensionality reduction in quadratic discriminant analysis
    • 24
    On BIC's Selection Consistency for Discriminant Analysis
    • 10
    Computation of Regularized Linear Discriminant Analysis
    • PDF
    Asymptotic Expansion of the Misclassification Probabilities of D- and A-Criteria for Discrimination from Two High Dimensional Populations Using the Theory of Large Dimensional Random Matrices
    • 29
    A deterministic approach to regularized linear discriminant analysis
    • 30
    • Highly Influenced
    • PDF
    Penalized classification using Fisher's linear discriminant.
    • D. Witten, R. Tibshirani
    • Mathematics, Medicine
    • Journal of the Royal Statistical Society. Series B, Statistical methodology
    • 2011
    • 300
    • PDF

    References

    SHOWING 1-10 OF 44 REFERENCES
    Discriminant functions when covariances are unequal and sample sizes are moderate
    • 127
    Multivariate Empirical Bayes and Estimation of Covariance Matrices
    • 159
    An orthogonally invariant minimax estimator of the covariance matrix of a multivariate normal population
    • 58
    Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation
    • 2,208
    Discrimination, Allocatory and Separatory, Linear Aspects
    • 38
    • PDF
    ESTIMATING COVARIANCES IN A MULTIVARIATE NORMAL DISTRIBUTION
    • 46
    A Statistical Perspective on Ill-posed Inverse Problems
    • 635
    Robust estimation and outlier detection with correlation coefficients
    • 332
    Cross-Validation, the Jackknife, and the Bootstrap: Excess Error Estimation in Forward Logistic Regression
    • 231
    Introduction To Multivariate Analysis
    • 648
    • PDF