On the entropy of sums of Bernoulli random variables via the Chen-Stein method

@article{Sason2012OnTE,
  title={On the entropy of sums of Bernoulli random variables via the Chen-Stein method},
  author={Igal Sason},
  journal={2012 IEEE Information Theory Workshop},
  year={2012},
  pages={542-546}
}
  • Igal Sason
  • Published in
    IEEE Information Theory…
    2012
  • Computer Science, Mathematics
  • This paper considers the entropy of the sum of (possibly dependent and non-identically distributed) Bernoulli random variables. Upper bounds on the error that follows from an approximation of this entropy by the entropy of a Poisson random variable with the same mean are derived. The derivation of these bounds combines elements of information theory with the Chen-Stein method for Poisson approximation. The resulting bounds are easy to compute, and their applicability is exemplified. This… CONTINUE READING

    Citations

    Publications citing this paper.
    SHOWING 1-6 OF 6 CITATIONS

    Entropy Bounds for Discrete Random Variables via Maximal Coupling

    • Igal Sason
    • Computer Science, Mathematics
    • IEEE Transactions on Information Theory
    • 2013
    VIEW 5 EXCERPTS
    CITES METHODS

    Entropy bounds for discrete random variables via coupling

    • Igal Sason
    • Computer Science, Mathematics
    • 2013 IEEE International Symposium on Information Theory
    • 2013
    VIEW 5 EXCERPTS
    CITES METHODS

    Integration by parts and representation of information functionals

    VIEW 1 EXCERPT
    CITES METHODS

    Local Pinsker Inequalities via Stein's Discrete Density Approach

    References

    Publications referenced by this paper.
    SHOWING 1-10 OF 40 REFERENCES

    Log-conca vity, ultralog concavity, and a maximum entropy property of discrete co mp und Poisson measures

    • O. Johnson, I. Kontoyiannis, M. Madiman
    • to appear in Discrete Applied Mathematics , 2012. See: http://arxiv.org/abs/0912.0581v2.pdf.
    • 2012

    Monotonicity, Thinning, and Discrete Versions of the Entropy Power Inequality

    VIEW 1 EXCERPT

    Sharp Bounds on the Entropy of the Poisson Law and Related Quantities

    Thinni ng, entropy and the law of thin numbers,”IEEE

    • P. Harremoës, O. Johnson, I. Kontoyiannis
    • Trans. on Information Theory ,
    • 2010
    VIEW 1 EXCERPT

    Thinning, Entropy, and the Law of Thin Numbers

    A criterion for the compound poisson distribution to be maximum entropy

    On the Entropy of Compound Distributions on Nonnegative Integers

    • Yaming Yu
    • Computer Science, Mathematics
    • IEEE Transactions on Information Theory
    • 2009
    VIEW 1 EXCERPT