Skip to search formSkip to main content
You are currently offline. Some features of the site may not work correctly.

Entropy (information theory)

Known as: Shannon's entropy, Weighted entropy, Informational entropy 
In information theory, systems are modeled by a transmitter, channel, and receiver. The transmitter produces messages that are sent through the… Expand
Wikipedia

Related topics

Related topics

50 relations
A Mathematical Theory of CommunicationAnti-informationComplex networkCross entropy
Expand

Broader (1)

Information theory

Papers overview

Semantic Scholar uses AI to extract papers important to this topic.
Review
2019
Review
2019
Probabilistic linguistic TODIM method for selecting products through online product reviews
Abstract Online product reviews (OPRs) provide abundant information for potential customers to make optimal purchase decisions… Expand
Is this relevant?
Highly Cited
2007
Highly Cited
2007
Multivariate Data Analysis
Chapter 3 deals with probability distributions, discrete and continuous densities, distribution functions, bivariate… Expand
Is this relevant?
Highly Cited
2004
Highly Cited
2004
The Information Entropy, Rough Entropy And Knowledge Granulation In Rough Set Theory
  • J. Liang, Z. Shi
  • Int. J. Uncertain. Fuzziness Knowl. Based Syst.
  • 2004
    • Corpus ID: 44637939
Rough set theory is a relatively new mathematical tool for use in computer applications in circumstances which are characterized… Expand
Is this relevant?
Highly Cited
2002
Highly Cited
2002
Decision Table Reduction based on Conditional Information Entropy
  • W. Guo
  • 2002
    • Corpus ID: 123732606
This paper analyzes the information view of rough set theory and compares it with the algebra view of rough set theory. Some… Expand
Is this relevant?
Highly Cited
1998
Highly Cited
1998
Information Theory and Coding
Course Objectives: The course will study how information is measured in terms of probability and entropy, and the relationships… Expand
  • figure 1
  • figure 2
Is this relevant?
Highly Cited
1994
Highly Cited
1994
Geometric and renormalized entropy in conformal field theory
Abstract In statistical physics, useful notions of entropy are defined with respect to some coarse-graining procedure over a… Expand
Is this relevant?
Highly Cited
1992
Highly Cited
1992
Entropy-based algorithms for best basis selection
Adapted waveform analysis uses a library of orthonormal bases and an efficiency functional to match a basis to a given signal or… Expand
  • figure 2
  • figure 3
  • figure 5
  • figure 6
  • figure 7
Is this relevant?
Highly Cited
1991
Highly Cited
1991
Divergence measures based on the Shannon entropy
  • J. Lin
  • IEEE Trans. Inf. Theory
  • 1991
    • Corpus ID: 12121632
A novel class of information-theoretic divergence measures based on the Shannon entropy is introduced. Unlike the well-known… Expand
  • figure 1
  • figure 2
Is this relevant?
Highly Cited
1988
Highly Cited
1988
Possible generalization of Boltzmann-Gibbs statistics
With the use of a quantity normally scaled in multifractals, a generalized form is postulated for entropy, namelySq ≡k [1 – ∑i=1W… Expand
  • figure 1
  • figure 2
  • figure 3
  • figure 4
  • figure 5
Is this relevant?
Highly Cited
1986
Highly Cited
1986
Fuzzy entropy and conditioning
  • B. Kosko
  • Inf. Sci.
  • 1986
    • Corpus ID: 205003915
Abstract A new nonprobabilistic entropy measure is introduced in the context of fuzzy sets or messages. Fuzzy units, or fits… Expand
Is this relevant?
By clicking accept or continuing to use the site, you agree to the terms outlined in our Privacy Policy, Terms of Service, and Dataset License
ACCEPT & CONTINUE