Convergence of Discrete MDL for Sequential Prediction

@inproceedings{Poland2004ConvergenceOD,
  title={Convergence of Discrete MDL for Sequential Prediction},
  author={J. Poland and Marcus Hutter},
  booktitle={COLT},
  year={2004}
}
  • J. Poland, Marcus Hutter
  • Published in COLT 2004
  • Computer Science, Mathematics
  • We study the properties of the Minimum Description Length principle for sequence prediction, considering a two-part MDL estimator which is chosen from a countable class of models. This applies in particular to the important case of universal sequence prediction, where the model class corresponds to all algorithms for some fixed universal Turing machine (this correspondence is by enumerable semimeasures, hence the resulting models are stochastic). We prove convergence theorems similar to… CONTINUE READING
    18 Citations
    On the Convergence Speed of MDL Predictions for Bernoulli Sequences
    • 18
    • PDF
    MDL convergence speed for Bernoulli sequences
    • 16
    • PDF
    Asymptotics of discrete MDL for online prediction
    • 33
    • PDF
    Sequential Predictions based on Algorithmic Complexity
    • Marcus Hutter
    • Computer Science, Mathematics
    • J. Comput. Syst. Sci.
    • 2006
    • 10
    • PDF
    Strong Asymptotic Assertions for Discrete MDL in Regression and Classification
    • 7
    • PDF
    Complexity Monotone in Conditions and Future Prediction Errors
    • PDF
    Algorithmic complexity bounds on future prediction errors
    • 11
    • PDF
    Monotone Conditional Complexity Bounds on Future Prediction Errors
    • 4
    • PDF

    References

    SHOWING 1-10 OF 44 REFERENCES
    On the Convergence Speed of MDL Predictions for Bernoulli Sequences
    • 18
    • PDF
    Convergence and Error Bounds for Universal Prediction of Nonbinary Sequences
    • 23
    • PDF
    Optimality of Universal Bayesian Sequence Prediction for General Loss and Alphabet
    • Marcus Hutter
    • Mathematics, Computer Science
    • J. Mach. Learn. Res.
    • 2003
    • 35
    • PDF
    Sequence Prediction Based on Monotone Complexity
    • 18
    • PDF
    New Error Bounds for Solomonoff Prediction
    • Marcus Hutter
    • Computer Science, Mathematics
    • J. Comput. Syst. Sci.
    • 2001
    • 38
    • PDF
    Complexity-based induction systems: Comparisons and convergence theorems
    • R. Solomonoff
    • Mathematics, Computer Science
    • IEEE Trans. Inf. Theory
    • 1978
    • 391
    • Highly Influential
    • PDF
    A Formal Theory of Inductive Inference. Part II
    • 1,588
    • PDF
    An Introduction to Kolmogorov Complexity and Its Applications
    • Ming Li, P. Vitányi
    • Computer Science, Psychology
    • Texts and Monographs in Computer Science
    • 1993
    • 3,575
    • PDF
    On the Relation between Descriptional Complexity and Algorithmic Probability
    • P. Gács
    • Computer Science
    • Theor. Comput. Sci.
    • 1983
    • 54
    • PDF