Benefiting from Disorder: Source Coding for Unordered Data

  title={Benefiting from Disorder: Source Coding for Unordered Data},
  author={Lav R. Varshney and Vivek K. Goyal},
The order of letters is not always relevant in a communicatio n ask. This paper discusses the implications of order irrelevance on source coding, presen ting results in several major branches of source coding theory: lossless coding, universal lossless coding, rate-distortion, high-rate quantization, and universal lossy coding. The main conclusions demonstra te th t there is a significant rate savings when order is irrelevant. In particular, lossless coding of n letters from a finite alphabet… CONTINUE READING


Publications referenced by this paper.
Showing 1-10 of 62 references

Entropy Computations via Analytic Depoissonization

IEEE Trans. Information Theory • 1999
View 4 Excerpts
Highly Influenced

The Method of Types

IEEE Trans. Information Theory • 1998
View 5 Excerpts
Highly Influenced

Some characterizations of almost sure bou nds for weighted multidimensional empirical distribution s and a Glivenko-Cantelli theorem for sample quantiles

D. M. Mason
Z. Wahrscheinlichkeitstheor. verw. Geb. , vol. 59, no. 4, pp. 505–513, May 1982. • 1982
View 4 Excerpts
Highly Influenced

Information rates of non-Gaussian processes

IEEE Trans. Information Theory • 1964
View 15 Excerpts
Highly Influenced

ε-entropy of a discrete random variable

V. Erokhin
Theory Probab. Appl. , vol. 3, no. 1, pp. 97–100, 1958. • 1958
View 3 Excerpts
Highly Influenced

On Universal Coding of Unordered Data

2007 Information Theory and Applications Workshop • 2007
View 1 Excerpt

Similar Papers

Loading similar papers…