# Second-Order Approximation of Minimum Discrimination Information in Independent Component Analysis

@article{Li2022SecondOrderAO, title={Second-Order Approximation of Minimum Discrimination Information in Independent Component Analysis}, author={Yunpeng Li}, journal={IEEE Signal Processing Letters}, year={2022}, volume={29}, pages={334-338} }

Independent Component Analysis (ICA) is intended to recover the mutually independent sources from their linear mixtures, and <inline-formula><tex-math notation="LaTeX">$FastICA$</tex-math></inline-formula> is one of the most successful ICA algorithms. Although it seems reasonable to improve the performance of <inline-formula><tex-math notation="LaTeX">$FastICA$</tex-math></inline-formula> by introducing more nonlinear functions to the negentropy estimation, the original fixed-point method…

## References

SHOWING 1-10 OF 36 REFERENCES

Faster Independent Component Analysis by Preconditioning With Hessian Approximations

- Computer ScienceIEEE Transactions on Signal Processing
- 2018

Independent Component Analysis (ICA) is a technique for unsupervised exploration of multichannel data that is widely used in observational sciences. In its classic form, ICA relies on modeling the…

Fast and robust fixed-point algorithms for independent component analysis

- Computer Science, MathematicsIEEE Trans. Neural Networks
- 1999

Using maximum entropy approximations of differential entropy, a family of new contrast (objective) functions for ICA enable both the estimation of the whole decomposition by minimizing mutual information, and estimation of individual independent components as projection pursuit directions.

Overcomplete Independent Component Analysis via SDP

- Computer ScienceAISTATS
- 2019

A novel algorithm for overcomplete independent components analysis (ICA), where the number of latent sources k exceeds the dimension p of observed variables, is presented and it is conjecture that the proposed program recovers a mixing component at the rate k < p^2/4 and proved that amix component can be recovered with high probability when k < (2 - epsilon) p log p.

An Information-Maximization Approach to Blind Separation and Blind Deconvolution

- Computer ScienceNeural Computation
- 1995

It is suggested that information maximization provides a unifying framework for problems in "blind" signal processing and dependencies of information transfer on time delays are derived.

Independent component analysis via nonparametric maximum likelihood estimation

- Mathematics
- 2012

Independent Component Analysis (ICA) models are very popular semiparametric models in which we observe independent copies of a random vector $X = AS$, where $A$ is a non-singular matrix and $S$ has…

Maximum Likelihood and Covariant Algorithms for Independent Component Analysis

- Computer Science
- 1996

It is shown that Bell and Sejnowski’s (1995) algorithm can be viewed as a maximum likelihood algorithm for the optimization of a linear generative model and a covariant version of the algorithm is derived.

ICA Using Spacings Estimates of Entropy

- Computer ScienceJ. Mach. Learn. Res.
- 2003

A new algorithm for the independent components analysis (ICA) problem based on an efficient entropy estimator that is simple, computationally efficient, intuitively appealing, and outperforms other well known algorithms.

Handbook of Blind Source Separation: Independent Component Analysis and Applications

- Computer Science
- 2010

This handbook provides the definitive reference on Blind Source Separation, giving a broad and comprehensive description of all the core principles and methods, numerical algorithms and major applications in the fields of telecommunications, biomedical engineering and audio, acoustic and speech processing.

Independent component analysis, A new concept?

- Computer ScienceSignal Process.
- 1994

Separation of a mixture of independent sources through a maximum likelihood approach

- Physics
- 1992

It is proved that the mixing matrix can be estimated using fourth-ordercross-cumulants, for two mixtures of two non-Gaussian sources, and theoretical solutions for three sources or more seems not easily tractable.