Corpus ID: 18481876

Symmetry in Shannon's Noiseless Coding Theorem

@article{Johnson2010SymmetryIS,
  title={Symmetry in Shannon's Noiseless Coding Theorem},
  author={L. F. Johnson},
  journal={ArXiv},
  year={2010},
  volume={abs/1010.6247}
}
Statements of Shannon's Noiseless Coding Theorem by various authors, including the original, are reviewed and clarified. Traditional statements of the theorem are often unclear as to when it applies. A new notation is introduced and the domain of application is clarified. An examination of the bounds of the Theorem leads to a new symmetric restatement. It is shown that the extended upper bound is an acheivable upper bound, giving symmetry to the theorem.The relation of information entropy to… Expand

References

SHOWING 1-10 OF 13 REFERENCES
Information theoretic inequalities
  • 586
  • PDF
Information Theory and Coding
  • 415
  • PDF
Elements of Information Theory
  • 40,745
  • PDF
Theory of Information and Coding
  • 701
  • PDF
A History of Mathematical Notations
  • 84
Coding and information theory (2. ed.)
  • 100
A and V
  • 38,098
  • Highly Influential
  • PDF
Information Theoretic Inequalities”, IEEE Trans
  • Information Theory, vol. 37 no. 6, pp. 1501-1518, Nov.
  • 1991
Information Theory and Reliable Communication
  • 2,442
...
1
2
...