A Unified Framework for Quadratic Measures of Independence

@article{Seth2011AUF,
  title={A Unified Framework for Quadratic Measures of Independence},
  author={S. Seth and M. Rao and Il Memming Park and J. Pr{\'i}ncipe},
  journal={IEEE Transactions on Signal Processing},
  year={2011},
  volume={59},
  pages={3624-3635}
}
This paper proposes a unified framework for several available measures of independence by generalizing the concept of information theoretic learning (ITL). The key component of ITL is the use of inner product between two density functions as a measure of similarity between two random variables. We show that by generalizing the inner product using a symmetric strictly positive-definite kernel and by choosing appropriate kernels, it is possible to reproduce a number of popular measures of… Expand
23 Citations
Measures of Entropy From Data Using Infinitely Divisible Kernels
  • 36
  • PDF
Reproducing kernel hilbert space methods for information theoretic learning
  • PDF
A novel formulation of Independence Detection based on the Sample Characteristic Function
  • 2
  • PDF
Regularized Estimation of Information via High Dimensional Canonical Correlation Analysis
  • PDF
Information Theoretic Learning with Infinitely Divisible Kernels
  • 14
  • PDF
Universal Dependency Analysis
  • 11
  • PDF
A parameter-free kernel design based on cumulative distribution function for correntropy
  • Jongmin Lee, Pingping Zhu, J. Príncipe
  • Mathematics, Computer Science
  • The 2013 International Joint Conference on Neural Networks (IJCNN)
  • 2013
  • 2
  • PDF
Descent Algorithms on Oblique Manifold for Source-Adaptive ICA Contrast
  • 22
A Near-Linear Time Subspace Search Scheme for Unsupervised Selection of Correlated Features
  • 2
  • PDF
A Derivative-Free Riemannian Powell’s Method, Minimizing Hartley-Entropy-Based ICA Contrast
  • 4
  • Highly Influenced
...
1
2
3
...

References

SHOWING 1-10 OF 29 REFERENCES
Kernel Methods for Measuring Independence
  • 281
  • PDF
A Reproducing Kernel Hilbert Space Framework for Information-Theoretic Learning
  • 55
  • PDF
Nonparametric Tests for Serial Independence Based on Quadratic Forms
  • 20
  • PDF
A test of independence based on a generalized correlation function
  • 32
  • PDF
Kernel Choice and Classifiability for RKHS Embeddings of Probability Distributions
  • 148
  • Highly Influential
  • PDF
Fast and robust fixed-point algorithms for independent component analysis
  • A. Hyvärinen
  • Mathematics, Computer Science
  • IEEE Trans. Neural Networks
  • 1999
  • 5,482
  • PDF
Information Theoretic Learning - Renyi's Entropy and Kernel Perspectives
  • J. Príncipe
  • Computer Science, Mathematics
  • Information Theoretic Learning
  • 2010
  • 631
Independent component analysis, A new concept?
  • P. Comon
  • Mathematics, Computer Science
  • Signal Process.
  • 1994
  • 7,916
  • PDF
ICA Using Spacings Estimates of Entropy
  • 286
  • PDF
Kernel independent component analysis
  • F. Bach, Michael I. Jordan
  • Mathematics, Computer Science
  • 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03).
  • 2003
  • 678
  • PDF
...
1
2
3
...