# Symmetry in Shannon's Noiseless Coding Theorem

@article{Johnson2010SymmetryIS, title={Symmetry in Shannon's Noiseless Coding Theorem}, author={L. F. Johnson}, journal={ArXiv}, year={2010}, volume={abs/1010.6247} }

Statements of Shannon's Noiseless Coding Theorem by various authors, including the original, are reviewed and clarified. Traditional statements of the theorem are often unclear as to when it applies. A new notation is introduced and the domain of application is clarified. An examination of the bounds of the Theorem leads to a new symmetric restatement. It is shown that the extended upper bound is an acheivable upper bound, giving symmetry to the theorem.The relation of information entropy to… Expand

#### Topics from this paper

#### References

SHOWING 1-10 OF 13 REFERENCES

Information Theoretic Inequalities”, IEEE Trans

- Information Theory, vol. 37 no. 6, pp. 1501-1518, Nov.
- 1991