Universal lossless coding for sources with repeating statistics

@article{Shamir2004UniversalLC,
  title={Universal lossless coding for sources with repeating statistics},
  author={Gil I. Shamir and Daniel J. Costello},
  journal={IEEE Transactions on Information Theory},
  year={2004},
  volume={50},
  pages={1620-1635}
}
A lower bound is derived on the achievable redundancy for universal lossless coding of parametric sources with piecewise stationary, abruptly changing, occasionally repeating statistics. In particular, it is shown that if the number of repeating statistical parameter vectors (or states) is not too large, for any uniquely decipherable code, for almost every set of states that govern all the different segments in the data sequence, for almost every arrangement of these states in the different… CONTINUE READING