A new outlook of Shannon's information measures

  title={A new outlook of Shannon's information measures},
  author={Raymond W. Yeung},
  journal={IEEE Trans. Information Theory},
Abstact --Let. Xi, i = 1,. . . , n, be discrete random variables, and Xi be a set variable corresponding to Xi. Define the universal set to be U ; = IXi and let S be the U-field generated by (Xi, i = 1,. . . , n}. It is shown that Shannon’s information measures on the random variables Xi, i = 1; .,n, constitute a unique measure p* on F, which is called the I-Measure. In other words, the Shannon information measure (i.e., Shannon’s information measures as a whole) is a measure on S, thus… CONTINUE READING
Highly Cited
This paper has 134 citations. REVIEW CITATIONS


Publications citing this paper.
Showing 1-10 of 78 extracted citations

Machine Learning Based on Attribute Interactions

Aleks Jakulin, Ivan Bratko, Strojno učenje na osnovi, interakcij med atributi, DOKTORSKA DISERTACIJA
View 6 Excerpts
Highly Influenced

A minimal set of shannon-type inequalities for functional dependence structures

2017 IEEE International Symposium on Information Theory (ISIT) • 2017
View 4 Excerpts
Highly Influenced

Physical Intelligence and Thermodynamic Computing

Entropy • 2017
View 3 Excerpts
Highly Influenced

Dual-matching as a problem solved by neurons

Neurocomputing • 2006
View 3 Excerpts
Highly Influenced

Neural statics and dynamics

Neurocomputing • 2005
View 3 Excerpts
Highly Influenced

A Minimal Set of Shannon-type Inequalities for MRF Structures with Functional Dependencies

2018 IEEE International Symposium on Information Theory (ISIT) • 2018
View 2 Excerpts

134 Citations

Citations per Year
Semantic Scholar estimates that this publication has 134 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.
Showing 1-7 of 7 references

Information 7heory: Coding Theorems for Discrete Memoryless Systems. New York Academic Press, and Budapest

I. Csiszar, J. Korner
Akademiai Kiado, • 1981

Information Theory and Reliable Communication

R. G. Gallagher
New York Wiley, • 1968

An Introduction to Information Theory

F. M. Reza
New York McGraw-Hill, • 1961

Similar Papers

Loading similar papers…