Entropy (information theory)

Known as: Shannon's entropy, Weighted entropy, Informational entropy 
In information theory, systems are modeled by a transmitter, channel, and receiver. The transmitter produces messages that are sent through the… (More)
Wikipedia

Related topics

Related topics

50 relations
A Mathematical Theory of CommunicationAnti-informationComplex networkCross entropy
(More)

Broader (1)

Information theory

Papers overview

Semantic Scholar uses AI to extract papers important to this topic.
Highly Cited
2011
Highly Cited
2011
Information Theoretic Proofs of Entropy Power Inequalities
While most useful information theoretic inequalities can be deduced from the basic properties of entropy or mutual information… (More)
  • figure 1
  • figure 2
  • figure 3
Is this relevant?
Highly Cited
2008
Highly Cited
2008
Information processing in complex networks: Graph entropy and information functionals
This paper introduces a general framework for defining the entropy of a graph. Our definition is based on a local information… (More)
  • figure 1
  • figure 2
  • figure 3
  • figure 4
Is this relevant?
Highly Cited
2002
Highly Cited
2002
GAME THEORY , MAXIMUM ENTROPY , MINIMUM DISCREPANCY AND ROBUST BAYESIAN DECISION THEORY
We describe and develop a close relationship between two problems that have customarily been regarded as distinct: that of… (More)
Is this relevant?
Highly Cited
2001
Highly Cited
2001
Information-Theoretic Measures for Anomaly Detection
Anomaly detection is an essential component of the protection mechanisms against novel attacks. In this paper, we propose to use… (More)
  • figure 1
  • figure 2
  • table 1
  • figure 3
Is this relevant?
Highly Cited
1998
Highly Cited
1998
On Characterization of Entropy Function via Information Inequalities
Given n discrete random variables = fX1; ; Xng, associated with any subset of f1; 2; ; ng, there is a joint entropy H(X ) where X… (More)
Is this relevant?
Highly Cited
1994
Highly Cited
1994
Geometric and Renormalized Entropy in Conformal Field Theory
In statistical physics, useful notions of entropy are defined with respect to some coarse graining procedure over a microscopic… (More)
Is this relevant?
Highly Cited
1992
Highly Cited
1992
Entropy-based algorithms for best basis selection
Adapted waveform analysis uses a library of orthonormal bases and an efficiency functional to match a basis to a given signal or… (More)
  • figure 2
  • figure 3
  • figure 5
  • figure 6
  • figure 7
Is this relevant?
Highly Cited
1991
Highly Cited
1991
Divergence measures based on the Shannon entropy
A new class of information-theoretic divergence measures based on the Shannon entropy is introduced. Unlike the well-known… (More)
  • figure 1
  • figure 2
Is this relevant?
Highly Cited
1967
Highly Cited
1967
Quantification method of classification processes. Concept of structural a-entropy
Institute of Mathematics of the Academy of Sciences of the Czech Republic provides access to digitized documents strictly for… (More)
Is this relevant?
Highly Cited
1953
Highly Cited
1953
Probability and information theory, with applications to radar
probability and information theory with application to radar probability and information theory with application to radar… (More)
Is this relevant?