Corpus ID: 18481876

Symmetry in Shannon's Noiseless Coding Theorem

@article{Johnson2010SymmetryIS,
  title={Symmetry in Shannon's Noiseless Coding Theorem},
  author={L. F. Johnson},
  journal={ArXiv},
  year={2010},
  volume={abs/1010.6247}
}
Statements of Shannon's Noiseless Coding Theorem by various authors, including the original, are reviewed and clarified. Traditional statements of the theorem are often unclear as to when it applies. A new notation is introduced and the domain of application is clarified. An examination of the bounds of the Theorem leads to a new symmetric restatement. It is shown that the extended upper bound is an acheivable upper bound, giving symmetry to the theorem.The relation of information entropy to… Expand

References

SHOWING 1-10 OF 13 REFERENCES
Information theoretic inequalities
Information Theory and Coding
Elements of Information Theory
Theory of Information and Coding
A History of Mathematical Notations
Coding and information theory (2. ed.)
A and V
Information Theoretic Inequalities”, IEEE Trans
  • Information Theory, vol. 37 no. 6, pp. 1501-1518, Nov.
  • 1991
...
1
2
...