Principal components in linear mixed models with general bulk

@article{Fan2019PrincipalCI,
  title={Principal components in linear mixed models with general bulk},
  author={Zhou Fan and Yi Sun and Zhichao Wang},
  journal={arXiv: Probability},
  year={2019}
}
We study the principal components of covariance estimators in multivariate mixed-effects linear models. We show that, in high dimensions, the principal eigenvalues and eigenvectors may exhibit bias and aliasing effects that are not present in low-dimensional settings. We derive the first-order limits of the principal eigenvalue locations and eigenvector projections in a high-dimensional asymptotic framework, allowing for general population spectral distributions for the random effects and… 

Figures and Tables from this paper

Matrix Means and a Novel High-Dimensional Shrinkage Phenomenon
Many statistical settings call for estimating a population parameter, most typically the population mean, from a sample of matrices. The most natural estimate of the population mean is the arithmetic
Group-regularized ridge regression via empirical Bayes noise level cross-validation.
Features in predictive models are not exchangeable, yet common supervised models treat them as such. Here we study ridge regression when the analyst can partition the features into $K$ groups based
Reproducing Kernels and New Approaches in Compositional Data Analysis
TLDR
The compositional domain is re-interpreted as the quotient topology of a sphere modded out by a group action to understand the function space on compositional domains in terms of that on spheres and to use spherical harmonics theory along with reflection group actions for constructing a compositional Reproducing Kernel Hilbert Space (RKHS).

References

SHOWING 1-10 OF 83 REFERENCES
PRINCIPAL COMPONENTS IN LINEAR MIXED MODELS WITH GENERAL BULK
We study the outlier eigenvalues and eigenvectors in variance components estimates for highdimensional mixed effects linear models using a free probability approach. We quantify the almost-sure
Spiked covariances and principal components analysis in high-dimensional random effects models
We study principal components analyses in multivariate random and mixed effects linear models, assuming a spherical-plus-spikes structure for the covariance matrix of each random effect. We
EIGENVALUE DISTRIBUTIONS OF VARIANCE COMPONENTS ESTIMATORS IN HIGH-DIMENSIONAL RANDOM EFFECTS MODELS.
TLDR
This work studies the spectra of MANOVA estimators for variance component covariance matrices in multivariate random effects models, and establishes a general asymptotic freeness result for families of rectangular orthogonally-invariant random matrices, which is of independent interest.
ASYMPTOTICS OF SAMPLE EIGENSTRUCTURE FOR A LARGE DIMENSIONAL SPIKED COVARIANCE MODEL
This paper deals with a multivariate Gaussian observation model where the eigenvalues of the covariance matrix are all one, except for a finite number which are larger. Of interest is the asymptotic
PCA in High Dimensions: An Orientation
TLDR
The behavior of the bulk of the sample eigenvalues under weak distributional assumptions on the observations has been described and alternative classes of estimation procedures have been developed by exploiting sparsity of the eigenvectors or the covariance matrix.
On Consistency and Sparsity for Principal Components Analysis in High Dimensions
  • I. Johnstone, A. Lu
  • Computer Science, Mathematics
    Journal of the American Statistical Association
  • 2009
TLDR
A simple algorithm for selecting a subset of coordinates with largest sample variances is provided, and it is shown that if PCA is done on the selected subset, then consistency is recovered, even if p(n) ≫ n.
Spectral analysis of sample autocovariance matrices of a class of linear time series in moderately high dimensions
Author(s): Wang, L; Aue, A; Paul, D | Abstract: © 2017 ISI/BS. This article is concerned with the spectral behavior of p-dimensional linear processes in the moderately high-dimensional case when both
Spectral moments of correlated Wishart matrices.
TLDR
The method gives exact analytic relations between the spectral moments and the eigenvalue densities of the covariance matrices and their estimators and can be used in practice to extract the information about genuine correlations from the given experimental realization of random matrices.
Free probability of type B and asymptotics of finite-rank perturbations of random matrices
We show that finite rank perturbations of certain random matrices fit in the framework of infinitesimal (type B) asymptotic freeness. This can be used to explain the appearance of free harmonic
Asymptotic freeness by generalized moments for Gaussian and Wishart matrices. Application to beta random matrices
We present a new approach of asymptotic freeness in mean and almost everywhere for independent Gaussian or Wishart complex matrices together with some independent set {A i | i ∈ N*} of random
...
...