Recursive Renyi's entropy estimator for adaptive filtering

Abstract

Recently we have proposed a recursive estimator for Renyi's quadratic entropy. This estimator can accurately converge the results for stationary signals or track the changing entropy of nonstationary signals. We demonstrate the application of the recursive entropy estimator to supervised and unsupervised training of linear and nonlinear adaptive systems. The simulations suggest a smooth and fast convergence to the optimal solution with a reduced complexity in the algorithm as compared to the batch training approach using the same entropy-based criteria. The presented approach also allows on-line information theoretic adaptation of model parameters.

Extracted Key Phrases

3 Figures and Tables

Cite this paper

@article{Xu2003RecursiveRE, title={Recursive Renyi's entropy estimator for adaptive filtering}, author={Jian-Wu Xu and Deniz Erdogmus and M. C. Ozturk and J F Principe}, journal={Proceedings of the 3rd IEEE International Symposium on Signal Processing and Information Technology (IEEE Cat. No.03EX795)}, year={2003}, pages={134-137} }