# Noisy Independent Factor Analysis Model for Density Estimation and Classification

@article{Amato2009NoisyIF, title={Noisy Independent Factor Analysis Model for Density Estimation and Classification}, author={Umberto Amato and Anestis Antoniadis and Alexander Samarov and Alexandre B. Tsybakov}, journal={Econometrics: Econometric \& Statistical Methods - General eJournal}, year={2009} }

We consider the problem of multivariate density estimation when the unknown density is assumed to follow a particular form of dimensionality reduction, a noisy independent factor analysis (IFA) model. In this model the data are generated by a number of latent independent components having unknown distributions and are observed in Gaussian noise. We do not assume that either the number of components or the matrix mixing the components are known. We show that the densities of this form can be…

## 4 Citations

### Dimensionality Reduction Models in Density Estimation and Classification

- Computer Science, Mathematics
- 2015

This paper considers the problem of multivariate density estimation assuming that the density allows some form of dimensionality reduction, and gives a bound to the excess risk of nonparametric plug-in classifiers in terms of the MISE of the density estimators of each class.

### Linear Non-Gaussian Component Analysis Via Maximum Likelihood

- Computer ScienceJournal of the American Statistical Association
- 2018

ABSTRACT Independent component analysis (ICA) is popular in many applications, including cognitive neuroscience and signal processing. Due to computational constraints, principal component analysis…

### Structural adaptation in the density model

- MathematicsMathematical Statistics and Learning
- 2021

This paper deals with non-parametric density estimation on $\bR^2$ from i.i.d observations. It is assumed that after unknown rotation of the coordinate system the coordinates of the observations are…

### Nonparametric estimation of a latent variable model

- Mathematics, EconomicsJ. Multivar. Anal.
- 2017

## References

SHOWING 1-10 OF 38 REFERENCES

### Independent Factor Analysis

- Computer ScienceNeural Computation
- 1999

An expectation-maximization (EM) algorithm is presented, which performs unsupervised learning of an associated probabilistic model of the mixing situation and is shown to be superior to ICA since it can learn arbitrary source densities from the data.

### Projection pursuit mixture density estimation

- Computer ScienceIEEE Transactions on Signal Processing
- 2005

This method for fitting the Gaussian mixture model (GMM) based on the projection pursuit strategy is proposed and its ability to model structure in subspaces is enhanced, compared to a direct ML fitting of a GMM in high dimensions.

### Aggregation of density estimators and dimension reduction

- Mathematics, Economics
- 2005

We consider the problem of model-selection-type aggregation of arbitrary density estimators using MISE risk. Given a collection of arbitrary density estimators, we propose a data-based selector of…

### Statistical estimation : asymptotic theory

- Mathematics
- 1981

when certain parameters in the problem tend to limiting values (for example, when the sample size increases indefinitely, the intensity of the noise ap proaches zero, etc.) To address the problem of…

### Adaptive minimax estimation in classes of smooth functions

- Mathematics
- 2001

In this thesis we study adaptive methods of estimation for two particular
types of statistical problems: regression and density estimation. For all
these problems the classes of probabilities are…

### In Search of Non-Gaussian Components of a High-Dimensional Distribution

- Computer Science, MathematicsJ. Mach. Learn. Res.
- 2006

This article proposes a new linear method to identify the "non-Gaussian subspace" within a very general semi-parametric framework based on a linear operator which, to any arbitrary nonlinear (smooth) function, associates a vector belonging to the low dimensional non- Gaussian target subspace, up to an estimation error.

### A new algorithm of non-Gaussian component analysis with radial kernel functions

- Computer Science
- 2007

An alternative algorithm called iterative metric adaptation for radial kernel functions (IMAK) is developed, which is theoretically better justifiable within the NGCA framework and tends to outperform existing methods through numerical examples.

### Statistical Inference in Factor Analysis

- Mathematics
- 1956

This paper discusses some methods of factor analysis and considers some mathematical problems of the model, such as whether certain kinds of observed data determine the model uniquely, and treats the statistical problems of estimation and tests of certain hypotheses.

### Correction of Density Estimators that are not Densities

- Mathematics
- 2003

Abstract. Several old and new density estimators may have good theoretical performance, but are hampered by not being bona fide densities; they may be negative in certain regions or may not integrate…