A mathematical theory of communication

@article{Shannon1948AMT,
  title={A mathematical theory of communication},
  author={Claude E. Shannon},
  journal={Bell Syst. Tech. J.},
  year={1948},
  volume={27},
  pages={379-423}
}
  • C. Shannon
  • Published 1 July 1948
  • Computer Science, Mathematics
  • Bell Syst. Tech. J.
In this final installment of the paper we consider the case where the signals or the messages or both are continuously variable, in contrast with the discrete nature assumed until now. To a considerable extent the continuous case can be obtained through a limiting process from the discrete case by dividing the continuum of messages and signals into a large but finite number of small regions and calculating the various parameters involved on a discrete basis. As the size of the regions is… Expand
View via Publisher
cs.ucf.edu
34,800 Citations
Highly Influential Citations
485
Background Citations
2,891
Methods Citations
1,898
Results Citations
38

Supplemental Content

1:10:09
Video
PWLSF - 6/2016 - Kiran Bhattaram on A Mathematical Theory of Communication
PapersWeLove
6 July 2017
Presentation Slides
A mathematical theory of communication

34,800 Citations

Citation Type

Citation Type

On a quantitative definition of information and its impact on the field of communications
Shannon (1948) gave a quantitative definition of information. Using this definition one can give bounds on the number of messages of a certain kind that can be stored and/or transmitted. The authors… Expand
Bounds on communication
Six parameters of importance in many communication systems are: (a) the rate at which digital information is transmitted; (b) the bandwidth of the system; (c) the signal power of the transmitted… Expand
Communication in the presence of noise
A method is developed for representing any communication system geometrically. Messages and the corresponding signals are points in two "function spaces," and the modulation process is a mapping of… Expand
Theoretical Aspects of Asynchronous Multiplexing
Various forms of multiplexing, in which information from several sources is systematically combined and transmitted over a single channel, have been described in the literature. Recent advances in… Expand
Taxonomy and Information
In the context of communication theory the concept of a quantity of information is defined as a function over the elements of a set S of messages. In coding these messages in some alphabet for… Expand
Theoretical Limitations on the Rate of Transmission of Information
A review of early work on the theory of the transmission of information is followed by a critical survey of this work and a refutation of the point that, in the absence of noise, there is a finite… Expand
Basic Principles of Communication Engineering
TLDR
The reception of a binary signal in the presence of noise is given special emphasis, and it is examined how constraints linking the symbols, thus introducing redundancy, can endow a sequence with resilience to the errors which may individually affect its symbols. Expand
Information theory and inverse probability in telecommunication
The foundations of information theory are presented as an extension of the theory of inverse probability. By postulating that information is additive and taking suitable averages, all the essential… Expand
On the role of dynamic programming in statistical communication theory
TLDR
It is shown by Kelly that under certain conditions, the rate of transmission, as defined by Shannon, can be obtained from a certain multistage decision process with an economic criterion. Expand
Fundamental energetic limits of radio communication systems
TLDR
It is shown that, contrary to the published results, the energetic limits always differ from zero if the physical constraints are correctly expressed. Expand
...
1
2
3
4
5
...

References

SHOWING 1-3 OF 3 REFERENCES
Transmission of information
A quantitative measure of “information” is developed which is based on physical as contrasted with psychological considerations. How the rate of transmission of this information over a system is… Expand
Certain factors affecting telegraph speed
In considering methods for increasing the speed of telegraph circuits, the engineer is confronted by the problem of transmitting over a circuit the maximum amount of intelligence using a given… Expand
In order to obtain the maximum power transfer from a generator to a load, a transformer must in general be introduced so that the generator as seen from the load has the load resistance
  • The situation here is roughly analogous. The transducer which does the encoding should match the source to the channel in a statistical sense. The source as seen from the channel through the transducer should have the same statistical structure 9Technical Report No. 65, The Research Laboratory of El
  • 1949