On convergence of information contained in quantized observations

  title={On convergence of information contained in quantized observations},
  author={Igor Vajda},
  journal={IEEE Trans. Information Theory},
By the well-known information processing theorem, quantizations of observations reduce values of convex information functionals such as the information divergence, Fisher information, or Shannon information. This paper deals with the convergence of the reduced values of these functionals to their original unreduced values for various sequences of partitions of the observation space. There is extensive literature dealing with this convergence when the partitions are nested in the sense +1 for… CONTINUE READING
16 Citations
28 References
Similar Papers


Publications referenced by this paper.
Showing 1-10 of 28 references

Eine Informationstheoretische Ungleichung und ihre Anwendung auf den Beweis der Ergodizität on Markoffschen Ketten

  • I. Csiszár
  • Publ. Math. Inst. Hungar. Acad. Sci. , ser. A…
  • 1963
Highly Influential
14 Excerpts

Discrete approximations to the information integral,”Canadian

  • S. G. Ghurye, B. R. Johnson
  • J. Statist. ,
  • 1981
Highly Influential
5 Excerpts

divergence and generalized Fisher information

  • Trans. 6th Prague Conf. Information Theory…
  • 1973
Highly Influential
4 Excerpts

On thef -divergence and singularity of probability measures

  • I. Vajda
  • Period. Math. Hung. , vol. 2, pp. 223–234, 1972.
  • 1972
Highly Influential
13 Excerpts

Information and sufficient sub-fields

  • S. G. Ghurye
  • Ann. Math. Statist. , vol. 39, pp. 2056–2066…
  • 1968
Highly Influential
8 Excerpts

Information-type measures of difference of probability distributions and indirect observations

  • Studia Sci. Math. Hungar. , vol. 2, pp. 299–318…
  • 1967
Highly Influential
5 Excerpts

On the amount of information contained in a -field

  • G. Kalianpur
  • Contributions to Probability and Statistics…
  • 1960
Highly Influential
5 Excerpts

Dobrushin, “General formulation of Shannon’s main theorem in information theory

  • R L.
  • (in Russian),
  • 1959
Highly Influential
3 Excerpts

On the general definition of the amount of information

  • I. M. Gelfand, A. N. Kolmogorov, A. M. Yaglom
  • Dokl. Akad. Nauk SSSR , vol. 111, pp. 745–748…
  • 1956
Highly Influential
5 Excerpts

Similar Papers

Loading similar papers…