Universal coding, information, prediction, and estimation

  title={Universal coding, information, prediction, and estimation},
  author={Jorma Rissanen},
  journal={IEEE Trans. Information Theory},
A connection between universal codes and the problems of prediction and statistical estimation is established. A‘known lower bound for the mean length of universal codes is sharpened and generalized, and optimum universal codes constructed. The bound is defined to give the information in strings relative to the considered class of processes. The earlier derived minimum description length criterion for estimation of parameters, including their number, is given a fundamental information… CONTINUE READING
Highly Influential
This paper has highly influenced 72 other papers. REVIEW HIGHLY INFLUENTIAL CITATIONS
Highly Cited
This paper has 854 citations. REVIEW CITATIONS
495 Citations
6 References
Similar Papers


Publications citing this paper.
Showing 1-10 of 495 extracted citations

855 Citations

Citations per Year
Semantic Scholar estimates that this publication has 855 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.
Showing 1-6 of 6 references

C&es, “Asymptotic normality of prediction error estimators

  • P. 1978. L. Ljung
  • IEEE Trans. Inform. Theory, vol. IT-24,
  • 1978

A new look at the statistical model identification,

  • H. Akaike
  • IEEE Trans. Automat. Co&r.,
  • 1974

The estimation of the order of an ARMA process

  • Leung-Yan-Cheong, T. Cover
  • IEEE Trans . Inform . Theory

Similar Papers

Loading similar papers…