Entropy and the law of small numbers

  title={Entropy and the law of small numbers},
  author={Ioannis Kontoyiannis and Peter Harremo{\"e}s and Oliver Johnson},
  journal={IEEE Transactions on Information Theory},
Two new information-theoretic methods are introduced for establishing Poisson approximation inequalities. First, using only elementary information-theoretic techniques it is shown that, when S/sub n/=/spl Sigma//sub i=1//sup n/X/sub i/ is the sum of the (possibly dependent) binary random variables X/sub 1/,X/sub 2/,...,X/sub n/, with E(X/sub i/)=p/sub i/ and E(S/sub n/)=/spl lambda/, then D(P(S/sub n/)/spl par/Po(/spl lambda/)) /spl les//spl Sigma//sub i=1//sup n/p/sub i//sup 2/+[/spl Sigma… CONTINUE READING
Highly Cited
This paper has 82 citations. REVIEW CITATIONS

From This Paper

Topics from this paper.
46 Citations
34 References
Similar Papers


Publications citing this paper.

82 Citations

Citations per Year
Semantic Scholar estimates that this publication has 82 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.
Showing 1-10 of 34 references

An approximation theorem for the Poisson binomial distribution,

  • L. Le Cam
  • Pacific J. Math.,
  • 1960
Highly Influential
3 Excerpts

On the convergence of Markov binomial to Poisson distribution,

  • V. Čekanavičius
  • Statist. Probab. Lett., vol. 58,
  • 2002

Letter to the editor: ‘A discrete version of the Stam inequality and a characterization of the Poisson distribution’,

  • A. Kagan
  • J. Statist. Plann. Inference,
  • 2001
3 Excerpts

The information topology

  • P. Harremoës.
  • IEEE Trans . Inform . Theory
  • 2001

MacGibbon . Une mesure d ’ information caractérisant la loi de Poisson

  • B.
  • Stochastic Process . Appl .
  • 2000

Random Summation: Limit Theorems and Applications

  • B. V. Gnedenko, V. Y. Korolev
  • Boca Raton, FL: CRC
  • 1996

Similar Papers

Loading similar papers…