Nonparametric entropy estimation : an overview ∗

  title={Nonparametric entropy estimation : an overview ∗},
  author={Jan Beirlant and Edward J. Dudewicz and L{\'a}szl{\'o} Gy{\"o}rfi and Edward C. van der Meulen},
We assume that H(f) is well-defined and is finite. The concept of differential entropy was introduced in Shannon’s original paper ([55]). Since then, entropy has been of great theoretical and applied interest. The basic properties ∗This research was supported by the Scientific Exchange Program between the Belgian Academy of Sciences and the Hungarian Academy of Sciences in the field of Mathematical Information Theory, and NATO Research Grant No. CRG 931030. 
Highly Influential
This paper has highly influenced 25 other papers. REVIEW HIGHLY INFLUENTIAL CITATIONS
Highly Cited
This paper has 737 citations. REVIEW CITATIONS
292 Citations
60 References
Similar Papers


Publications citing this paper.

737 Citations

Citations per Year
Semantic Scholar estimates that this publication has 737 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.
Showing 1-10 of 60 references

The entropy of the maximum entropy distribution

  • H. Theil
  • Econom. Letters,
  • 1980
Highly Influential
5 Excerpts

A test for normality based on sample entropy

  • O. Vasicek
  • J. Roy. Statist. Soc. Ser. B
  • 1976
Highly Influential
4 Excerpts

On the logarithms of higher order spacings

  • N. Cressie
  • Biometrika
  • 1976
Highly Influential
7 Excerpts

On powerful distributional tests based on sample spacings

  • P. Hall
  • J. Multivariate Statist
  • 1986
Highly Influential
8 Excerpts

Limit theorems for sums of general functions of m-spacings

  • P. Hall
  • Math. Proc. Camb. Phil. Soc,
  • 1984
Highly Influential
8 Excerpts

On two applications of characterization theorems to goodness-of-fit

  • G. S. Mudholkar, C. T. Lin
  • Colloquia Mathematica Soc. János Bolyai,
  • 1984
Highly Influential
6 Excerpts

On the dimension and entropy of probability distributions

  • A. Rényi
  • Acta Math. Acad. Sci. Hungar.,
  • 1959
Highly Influential
3 Excerpts

The random division of an interval

  • P.A.P. Moran
  • Part I. J. R. Statist. Soc. B,
  • 1951
Highly Influential
3 Excerpts

Ranking of the best random number generators via entropy-uiformity theory

  • L. T. Bernhofen, E. J. Dudewicz, J. Levendovszky, E. C. van der Meulen
  • In MSI-2000: Multivariate Statistical Analysis in…
  • 1996
1 Excerpt

Similar Papers

Loading similar papers…