The Mathematical Theory of Communication

  title={The Mathematical Theory of Communication},
  author={C. Shannon and W. Weaver and N. Wiener},
  journal={Physics Today},
HE recent development of various methods of modulation such as PCM and PPM which exchange bandwidth for signal-to-noise ratio has intensified the interest in a general theory of communication. A basis for such a theory is contained in the important papers of Nyquist1 and Hartley2 on this subject. In the present paper we will extend the theory to include a number of new factors, in particular the effect of noise in the channel, and the savings possible due to the statistical structure of the… Expand
*Information theory is concerned with the analysis of Communication System, the purpose of which is the transmission of information from one point to another. The various parts of the communicationExpand
In Section I an interpretation of the capacity theorem is given by introduing the cost consideration into the information system and a close connection between them will be shown by presenting a general theorem which includes the two theorems as the two special cases. Expand
Shannon theory. Myths and reality
The significance of the famous Shannon’s publication “A mathematical theory of communication” is discussed. The author states that this theory was a breakthrough for the times it was created. TheExpand
A measure of efficiency for a class of decision feedback communication systems
The proposed measure R, which can be interpreted as a transmission rate, is a non-negative number that never exceeds the transmission rate Ro that can be achieved with the source and forward channel without the aid of feedback. Expand
On the application of algorithmic information theory to decision problems
  • G. Tartara
  • Mathematics, Computer Science
  • Inf. Sci.
  • 1973
A criterion for testing hypotheses is proposed which is based on the algorithmic notion of mutual information as given by Kolmogorov, and it is shown that the decision can be based asymptotically for very long messages on the algorithm complexity of the error sequences. Expand
Some Useful Coding Techniques for Binary Communication Systems
Abstract : An introduction to coding theory and a discussion of specific coding techniques are given as applied to digital communication systems. The place of coding in a communication system isExpand
A channel hopping technique I: theoretical studies on band efficiency and capacity
The theoretical analysis shows that the capacity gain of the channel hopping technique is the same as that of transmit diversity over the "flat" channel, however, for a DS-CDMA system under the assumption that the multiuser interference obeys a Gaussian distribution, the proposed system has larger system capacity. Expand
An information theory of image gathering
A close examination of the expression for minimum mean-square-error, or Wiener-matrix, restoration from parallel image-gathering channels reveals a method for unscrambling the within-passband and aliased signal components to restore spatial frequencies beyond the sampling passband out to the spatial-frequency response cutoff of the optical aperture. Expand
The influence of delay upon an idealized channel's bandwidth
An optimization problem in calculating the bandwidth of a covert timing channel is discussed. In particular, the question of how dependent the bandwidth is on the magnitude of the modulation isExpand
Channel State Quantization in MIMO Broadcast Systems: Architectures and Codes
New design principles for channel feedback design in multi-user multipleantenna broadcast system design are developed and shown that the system designer is afforded extra degrees of freedom in the choice of the channel quantizer due to the multi- user diversity of the system. Expand