Comparison of Entropy and Mean Square Error Criteria in Adaptive System Training Using Higher Order Statistics

Abstract

The error-entropy-minimization approach in adaptive system training is addressed in this paper. The effect of Parzen windowing on the location of the global minimum of entropy has been investigated. An analytical proof that shows the global minimum of the entropy is a local minimum, possibly the global minimum, of the nonparametrically estimated entropy using Parzen windowing with Gaussian kernels. The performances of error-entropy-minimization and the mean-square-errorminimization criteria are compared in short-term prediction of a chaotic time series. Statistical behavior of the estimation errors and the higher order central moments of the time series data and its predictions are utilized as the comparison criteria.

Extracted Key Phrases

8 Figures and Tables

Statistics

051015'01'03'05'07'09'11'13'15'17
Citations per Year

74 Citations

Semantic Scholar estimates that this publication has 74 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@inproceedings{Erdogmus2000ComparisonOE, title={Comparison of Entropy and Mean Square Error Criteria in Adaptive System Training Using Higher Order Statistics}, author={Deniz Erdogmus and Jos{\'e} C . Pr{\'i}ncipe}, year={2000} }