Entropy (information theory)

Known as: Shannon's entropy, Weighted entropy, Informational entropy 
In information theory, systems are modeled by a transmitter, channel, and receiver. The transmitter produces messages that are sent through the… (More)
Wikipedia

Papers overview

Semantic Scholar uses AI to extract papers important to this topic.
Highly Cited
2011
Highly Cited
2011
While most useful information theoretic inequalities can be deduced from the basic properties of entropy or mutual information… (More)
  • figure 1
  • figure 2
  • figure 3
Is this relevant?
Highly Cited
2008
Highly Cited
2008
This paper introduces a general framework for defining the entropy of a graph. Our definition is based on a local information… (More)
  • figure 1
  • figure 2
  • figure 3
  • figure 4
Is this relevant?
Highly Cited
2002
Highly Cited
2002
We describe and develop a close relationship between two problems that have customarily been regarded as distinct: that of… (More)
Is this relevant?
Highly Cited
1998
Highly Cited
1998
Given n discrete random variables = fX1; ; Xng, associated with any subset of f1; 2; ; ng, there is a joint entropy H(X ) where X… (More)
Is this relevant?
Highly Cited
1994
Highly Cited
1994
In statistical physics, useful notions of entropy are defined with respect to some coarse graining procedure over a microscopic… (More)
Is this relevant?
Highly Cited
1992
Highly Cited
1992
Adapted waveform analysis uses a library of orthonormal bases and an efficiency functional to match a basis to a given signal or… (More)
  • figure 2
  • figure 3
  • figure 5
  • figure 6
  • figure 7
Is this relevant?
Highly Cited
1991
Highly Cited
1991
A new class of information-theoretic divergence measures based on the Shannon entropy is introduced. Unlike the well-known… (More)
  • figure 1
  • figure 2
Is this relevant?
Highly Cited
1967
Highly Cited
1967
Institute of Mathematics of the Academy of Sciences of the Czech Republic provides access to digitized documents strictly for… (More)
Is this relevant?
Highly Cited
1954
Highly Cited
1954
Information theory has recently been employed to specify more precisely than has hitherto been possible man's capacity in certain… (More)
  • figure 1
  • table 1
  • figure 2
  • table 2
  • figure 3
Is this relevant?
Highly Cited
1953
Highly Cited
1953
probability and information theory with application to radar probability and information theory with application to radar… (More)
Is this relevant?