Some inequalities for information divergence and related measures of discrimination

@article{Topse2000SomeIF,
  title={Some inequalities for information divergence and related measures of discrimination},
  author={F. Tops{\o}e},
  journal={IEEE Trans. Inf. Theory},
  year={2000},
  volume={46},
  pages={1602-1609}
}
  • F. Topsøe
  • Published 2000
  • Mathematics, Computer Science
  • IEEE Trans. Inf. Theory
  • Inequalities which connect information divergence with other measures of discrimination or distance between probability distributions are used in information theory and its applications to mathematical statistics, ergodic theory, and other scientific fields. We suggest new inequalities of this type, often based on underlying identities. As a consequence, we obtain certain improvements of the well-known Pinsker inequality. Our study depends on two measures of discrimination, called capacitory… CONTINUE READING
    Capacity of Hexagonal Checkerboard Codes
    Classification of Chromosome Sequences with Entropy Kernel and LKPLS Algorithm
    Weighted Prediction Divergence for Metareasoning
    • 1
    • Open Access
    0 Notes on notation and nomenclature
    Minimax lower bounds via f-divergences
    The Australian Journal of Mathematical Analysis and Applications
    Minimax Lower Bounds Minimax Lower Bounds

    References

    Publications referenced by this paper.
    SHOWING 1-10 OF 51 REFERENCES
    Divergence measures based on the Shannon entropy
    • J. Lin
    • Mathematics, Computer Science
    • 1991
    • 2,893
    • Open Access
    Statistical information and discrimination
    • 38
    A NEW DIRECTED DIVERGENCE MEASURE AND ITS CHARACTERIZATION
    • 52
    On the selection of measures of distance between probability distributions
    • 16
    Information inequalities and concentration of measure
    • 79
    • Open Access
    A Note on Hoeffding's Inequality
    • 13