Skip to search formSkip to main contentSkip to account menu

Entropy (information theory)

Known as: Shannon's entropy, Weighted entropy, Informational entropy 
In information theory, systems are modeled by a transmitter, channel, and receiver. The transmitter produces messages that are sent through the… 
Wikipedia (opens in a new tab)

Related topics

Related topics

50 relations
A Mathematical Theory of CommunicationAnti-informationComplex networkCross entropy

Broader (1)

Information theory

Papers overview

Semantic Scholar uses AI to extract papers important to this topic.
Highly Cited
2017
Highly Cited
2017
Soft-to-Hard Vector Quantization for End-to-End Learning Compressible Representations
We present a new approach to learn compressible representations in deep architectures with an end-to-end training strategy. Our… 
Highly Cited
2009
Highly Cited
2009
Entropy in general physical theories
Information plays an important role in our understanding of the physical world. Hence we propose an entropic measure of… 
Highly Cited
2007
Highly Cited
2007
Information Theoretic Proofs of Entropy Power Inequalities
While most useful information theoretic inequalities can be deduced from the basic properties of entropy or mutual information… 
Highly Cited
2006
Highly Cited
2006
Information theoretic framework of trust modeling and evaluation for ad hoc networks
The performance of ad hoc networks depends on cooperation and trust among distributed nodes. To enhance security in ad hoc… 
Highly Cited
2004
Highly Cited
2004
Optimal sensor placement methodology for parametric identification of structural systems
Review
2001
Review
2001
Fuzzy entropy: a brief survey
This paper presents a survey about different types of fuzzy information measures. A number of schemes have been proposed to… 
Highly Cited
2001
Highly Cited
2001
Energy, Entropy and Exergy Concepts and Their Roles in Thermal Engineering
Energy, entropy and exergy concepts come from thermodynamics and are applicable to all fields of science and engineering… 
Highly Cited
1995
Highly Cited
1995
K*: An Instance-based Learner Using and Entropic Distance Measure
Review
1989
Review
1989
Object-background segmentation using new definitions of entropy
The definition of Shannon's entropy in the context of information theory is critically examined and some of its applications to… 
Highly Cited
1986
Highly Cited
1986
Fuzzy entropy and conditioning
By clicking accept or continuing to use the site, you agree to the terms outlined in our Privacy Policy (opens in a new tab), Terms of Service (opens in a new tab), and Dataset License (opens in a new tab)