Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition

@article{Lu2005RegularizationSO,
  title={Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition},
  author={Juwei Lu and Konstantinos N. Plataniotis and Anastasios N. Venetsanopoulos},
  journal={Pattern Recognit. Lett.},
  year={2005},
  volume={26},
  pages={181-191}
}
It is well-known that the applicability of linear discriminant analysis (LDA) to high-dimensional pattern classification tasks such as face recognition often suffers from the so-called ''small sample size'' (SSS) problem arising from the small number of available training samples compared to the dimensionality of the sample space. In this paper, we propose a new LDA method that attempts to address the SSS problem using a regularized Fisher's separability criterion. In addition, a scheme of… Expand
On application of generalized Jacobi method in face recognition by linear discriminant analysis and principal component analysis
  • V. Mokeyev
  • Mathematics
  • 2016 2nd International Conference on Industrial Engineering, Applications and Manufacturing (ICIEAM)
  • 2016
The paper considers efficiency of linear discriminant and principal component analysis regarding to “small sample size problems” for face recognition. Small sample size problem arises from a smallExpand
A modification of kernel discriminant analysis for high-dimensional data - with application to face recognition
TLDR
This paper presents a variant of KDA that deals with both of the shortcomings in an efficient and cost effective manner and uses simultaneous diagonalization technique for optimization and a modified Fisher criterion that is more closely related to classification error. Expand
Kernel Discriminant Learning with Application to Face Recognition
When applied to high-dimensional pattern classification tasks such as face recognition, traditional kernel discriminant analysis methods often suffer from two problems: (1) small training sample sizeExpand
Face recognition using adaptive margin fisher's criterion and linear discriminant analysis (AMFC-LDA)
TLDR
An Adaptive Margin Fisher's Criterion Linear Discriminant Analysis (AMFC/LDA) is proposed that a ddresses issues and overcomes the limitations of intra class problems and reveals encouraging performance. Expand
Regularized complete linear discriminant analysis
TLDR
A system of regularized complete linear discriminant analysis (RCLDA) is developed that can be directly applied to small sample size (SSS) problems in which the number of available training samples is smaller than the dimensionality of the sample space. Expand
Kernel-based improved discriminant analysis and its application to face recognition
TLDR
This paper presents a variant of KDA called kernel-based improved discriminant analysis (KIDA), which can effectively deal with the small sample size problem and experiments show that the proposed method is superior to the traditional KDA and LDA. Expand
Weighted Piecewise LDA for Solving the Small Sample Size Problem in Face Verification
TLDR
A novel algorithm that can be used to boost the performance of face-verification methods that utilize Fisher's criterion is presented and evaluated and Experimental results indicate that the proposed framework greatly improves the face- Verification performance. Expand
Face recognition using enhanced linear discriminant analysis
There are two fundamental problems with the linear discriminant analysis (LDA) for face recognition. First one is LDA is not stable because of the small training sample size problem. The other isExpand
A parameterized direct LDA and its application to face recognition
TLDR
Experimental results conducted on two benchmark face image databases demonstrate that PD-LDA is much more effective and robust than D-L DA and outperforms state-of-the-art facial feature extraction methods such as KLB, eigenfaces, and Fisherfaces. Expand
Investigation of KLIM algorithm applied to face recognition
Face recognition often suffers from the small sample size problem. Regularization is one of the solutions to this problem. In this paper, we investigate the Kullback-Leibler information measureExpand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 29 REFERENCES
Regularized discriminant analysis for the small sample size problem in face recognition
TLDR
A new QDA like method is proposed that effectively addresses the SSS problem using a regularization technique and outperforms traditional methods such as Eigenfaces, direct QDA and direct LDA in a number of SSS setting scenarios. Expand
Face recognition using LDA-based algorithms
TLDR
A new algorithm is proposed that deals with both of the shortcomings in an efficient and cost effective manner of traditional linear discriminant analysis methods for face recognition systems. Expand
A new LDA-based face recognition system which can solve the small sample size problem
TLDR
It is proved that the most expressive vectors derived in the null space of the within-class scatter matrix using principal component analysis (PCA) are equal to the optimal discriminant vectorsderived in the original space using LDA. Expand
Face recognition using kernel direct discriminant analysis algorithms
TLDR
This paper proposes a kernel machine-based discriminant analysis method, which deals with the nonlinearity of the face patterns' distribution and effectively solves the so-called "small sample size" (SSS) problem, which exists in most FR tasks. Expand
Dual-space linear discriminant analysis for face recognition
Linear discriminant analysis (LDA) is a popular feature extraction technique for face recognition. However, it often suffers from the small sample size problem when dealing with the high dimensionalExpand
Component-based LDA method for face recognition with one training sample
TLDR
A component-based linear discriminant analysis (LDA) method to solve the one training sample problem of face recognition by constructing local facial feature component bunches by moving each local feature region in four directions. Expand
A direct LDA algorithm for high-dimensional data - with application to face recognition
TLDR
However, for a task with very high dimensional data such as images, the traditional LDA algorithm encounters several difficulties, and before LDA can be used to reduce dimensionality, another procedure has to be first applied for dimensionality reduction. Expand
Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition
TLDR
A novel Gabor-Fisher (1936) classifier (GFC) for face recognition is introduced, which applies the enhanced Fisher linear discriminant model (EFM) to an augmented Gabor feature vector derived from the Gabor wavelet representation of face images. Expand
Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection
TLDR
A face recognition algorithm which is insensitive to large variation in lighting direction and facial expression is developed, based on Fisher's linear discriminant and produces well separated classes in a low-dimensional subspace, even under severe variations in lighting and facial expressions. Expand
Optimal discriminant plane for a small number of samples and design method of classifier on the plane
TLDR
It is proved that the generalized eigenequations on the optimal discriminant plane are stable in respect of eigenvalues and the generalized Eigenvectors are indeed the optimal discriminate directions, if the perturbation is subject to some certain conditions. Expand
...
1
2
3
...