Second-Order Approximation of Minimum Discrimination Information in Independent Component Analysis

  title={Second-Order Approximation of Minimum Discrimination Information in Independent Component Analysis},
  author={Yunpeng Li},
  journal={IEEE Signal Processing Letters},
  • Yunpeng Li
  • Published 30 November 2021
  • Computer Science
  • IEEE Signal Processing Letters
Independent Component Analysis (ICA) is intended to recover the mutually independent sources from their linear mixtures, and <inline-formula><tex-math notation="LaTeX">$FastICA$</tex-math></inline-formula> is one of the most successful ICA algorithms. Although it seems reasonable to improve the performance of <inline-formula><tex-math notation="LaTeX">$FastICA$</tex-math></inline-formula> by introducing more nonlinear functions to the negentropy estimation, the original fixed-point method… 

Figures and Tables from this paper

Boosting Independent Component Analysis
This paper presents a novel boosting-based algorithm for independent component analysis that consists of maximizing likelihood estimation via boosting and seeking unmixing matrix by the fixed-point method.


Faster Independent Component Analysis by Preconditioning With Hessian Approximations
Independent Component Analysis (ICA) is a technique for unsupervised exploration of multichannel data that is widely used in observational sciences. In its classic form, ICA relies on modeling the
Fast and robust fixed-point algorithms for independent component analysis
  • A. Hyvärinen
  • Computer Science, Mathematics
    IEEE Trans. Neural Networks
  • 1999
Using maximum entropy approximations of differential entropy, a family of new contrast (objective) functions for ICA enable both the estimation of the whole decomposition by minimizing mutual information, and estimation of individual independent components as projection pursuit directions.
Overcomplete Independent Component Analysis via SDP
A novel algorithm for overcomplete independent components analysis (ICA), where the number of latent sources k exceeds the dimension p of observed variables, is presented and it is conjecture that the proposed program recovers a mixing component at the rate k < p^2/4 and proved that amix component can be recovered with high probability when k < (2 - epsilon) p log p.
An Information-Maximization Approach to Blind Separation and Blind Deconvolution
It is suggested that information maximization provides a unifying framework for problems in "blind" signal processing and dependencies of information transfer on time delays are derived.
Independent component analysis via nonparametric maximum likelihood estimation
Independent Component Analysis (ICA) models are very popular semiparametric models in which we observe independent copies of a random vector $X = AS$, where $A$ is a non-singular matrix and $S$ has
Maximum Likelihood and Covariant Algorithms for Independent Component Analysis
It is shown that Bell and Sejnowski’s (1995) algorithm can be viewed as a maximum likelihood algorithm for the optimization of a linear generative model and a covariant version of the algorithm is derived.
ICA Using Spacings Estimates of Entropy
A new algorithm for the independent components analysis (ICA) problem based on an efficient entropy estimator that is simple, computationally efficient, intuitively appealing, and outperforms other well known algorithms.
Handbook of Blind Source Separation: Independent Component Analysis and Applications
This handbook provides the definitive reference on Blind Source Separation, giving a broad and comprehensive description of all the core principles and methods, numerical algorithms and major applications in the fields of telecommunications, biomedical engineering and audio, acoustic and speech processing.
Independent component analysis, A new concept?
  • P. Comon
  • Computer Science
    Signal Process.
  • 1994
Separation of a mixture of independent sources through a maximum likelihood approach
It is proved that the mixing matrix can be estimated using fourth-ordercross-cumulants, for two mixtures of two non-Gaussian sources, and theoretical solutions for three sources or more seems not easily tractable.