Determining the number of components from the matrix of partial correlations

@article{Velicer1976DeterminingTN,
  title={Determining the number of components from the matrix of partial correlations},
  author={Wayne F. Velicer},
  journal={Psychometrika},
  year={1976},
  volume={41},
  pages={321-327}
}
  • W. Velicer
  • Published 1 September 1976
  • Business, Mathematics
  • Psychometrika
A common problem for both principal component analysis and image component analysis is determining how many components to retain. A number of solutions have been proposed, none of which is totally satisfactory. An alternative solution which employs a matrix of partial correlations is considered. No components are extracted after the average squared partial correlation reaches a minimum. This approach gives an exact stopping point, has a direct operational interpretation, and can be applied to… 
View on Springer
1,867 Citations
Highly Influential Citations
134
Background Citations
210
Methods Citations
760
Results Citations
18

1,867 Citations

Citation Type

Citation Type

Cross-Validatory Choice of the Number of Components From a Principal Component Analysis
TLDR
The method is based on successively predicting each element in the data matrix after deleting the corresponding row and column of the matrix, and makes use of recently published algorithms for updating a singular value decomposition.
Minimum average partial correlation and parallel analysis: The influence of oblique structures
TLDR
Parallel analysis and the minimum average partial correlation had the best performances as it was more powerful and accurate than PA when the component structure was modestly oblique and both stopping rules performed poorly in the presence of highly oblique factors.
Information Maximization in Sparse Principal Components Analysis: An Exact Approach for Sparse and Interpretable Dimension Reduction
TLDR
The approach can choose between enforcing orthogonality of the coefficients and uncorrelation of the components, and can explicitly set the degree of sparsity as the number of variables used by each derived component.
An empirical comparison of alternative methods for principal component extraction
Three-mode principal components analysis: choosing the numbers of components and sensitivity to local optima.
  • M. Timmerman, H. Kiers
  • Mathematics
    The British journal of mathematical and statistical psychology
  • 2000
TLDR
A method that indicates the numbers of components to use in fitting the three-mode principal components analysis (3MPCA) model is proposed, and it was found that DIFFIT performed considerably better than the other methods in indicating the number of components.
Parallel Analysis: a method for determining significant principal components
Numerous ecological studies use Principal Compo- nents Analysis (PCA) for exploratory analysis and data reduc- tion. Determination of the number of components to retain is the most crucial problem…
Determining the number of components in principal components analysis: A comparison of statistical, crossvalidation and approximated methods
Selection of components in principal component analysis: a comparison of methods
MAPF and MAPS: Subroutines for the Number of Prineipal Components
One of the key issues in the use of principal components analysis in exploratory applications is the determination of how many components to retain. The problem is one of finding how many components…
How many principal components? stopping rules for determining the number of non-trivial axes revisited
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 20 REFERENCES
An Empirical Comparison Of The Similarity Of Principal Component, Image, And Factor Patterns.
  • W. Velicer
  • Environmental Science
    Multivariate behavioral research
  • 1977
TLDR
To assess the degree of similarity between the results produced by each of the three methods, the patterns produced by maximum likelihood factor analysis, rescaled image analysis, and principal component analysis are compared for nine data sets.
The Relation Between Factor Score Estimates, Image Scores, and Principal Component Scores
Theoretical problems with the factor analysis model, such as the factor indeterminacy issue, have resulted in increased interest in component analysis as an alternative. Indeed, component analysis…
A Comparison of the Stability of Factor Analysis, Principal Component Analysis, and Rescaled Image Analysis
Theoretical problems with the factor analysis model have resulted in increased interest in component analysis as an alternative. It is therefore of interest to assess empirically some of the asserted…
Factor analysis by minimizing residuals (minres)
TLDR
This paper is addressed to the classical problem of estimating factor loadings under the condition that the sum of squares of off-diagonal residuals be minimized, and a highly efficient method was developed.
Some contributions to maximum likelihood factor analysis
A new computational method for the maximum likelihood solution in factor analysis is presented. This method takes into account the fact that the likelihood function may not have a maximum in a point…
Factor analysis of data matrices
Abstract : This is Part V of a series of reports on rationales and techniques of matrix factoring which play an important role in multivariate analysis techniques. Indeed, it may well be said that…
Using Bartlett's Significance Test to Determine the Number of Factors to Extract
ranted. Successive application of the test of residuals after each factor is extracted provides a basis for determining the number of significant components; the extraction process is continued until…
Some new results on factor indeterminacy
Some relations between maximum likelihood factor analysis and factor indeterminacy are discussed. Bounds are derived for the minimum average correlation between equivalent sets of correlated factors…
An empirical study of the factor analysis stability hypothesis
Note is taken of four related sources of confusion as to the usefulness of Thurstone's factor analysis model and of their resolutions. One resolution uses Tucker's distinction between exploratory and…
The dimensions of temperament
The correlations among the thirteen personality scores yielded by the Guilford schedule for factors STDCR, and the Guilford-Martin schedules for factors GAMIN, and O, Ag, and Co, as reported by…
...
1
2
...