An Introduction to Kolmogorov Complexity and Its Applications

@inproceedings{Li1993AnIT,
  title={An Introduction to Kolmogorov Complexity and Its Applications},
  author={Ming Li and Paul M. B. Vit{\'a}nyi},
  booktitle={Texts and Monographs in Computer Science},
  year={1993}
}
  • Ming Li, P. Vitányi
  • Published in
    Texts and Monographs in…
    1993
  • Computer Science, Psychology
The book is outstanding and admirable in many respects. ... is necessary reading for all kinds of readers from undergraduate students to top authorities in the field. Journal of Symbolic Logic Written by two experts in the field, this is the only comprehensive and unified treatment of the central ideas and their applications of Kolmogorov complexity. The book presents a thorough treatment of the subject with a wide range of illustrative applications. Such applications include the randomness of… 
The Mathematical Foundations of Randomness
TLDR
A nontechnical account of the mathematical theory of randomness, which connects computability and complexity theory with mathematical logic, proof theory, probability and measure theory, analysis, computer science, and philosophy, and has surprising applications in a variety of fields.
Kolmogorov Complexity: Recent Research in Moscow
TLDR
The goal of this talk is to state some of the questions and the results obtained in Moscow during the last years of Kolmogorov complexity theory.
Descriptive Complexity
  • N. Immerman
  • Computer Science
    Graduate Texts in Computer Science
  • 1999
TLDR
The core of the book is contained in Chapters 1 through 7, although even here some sections can be omitted according to the taste and interests of the instructor, and the remaining chapters are more independent of each other.
Calculating Kolmogorov Complexity from the Output Frequency Distributions of Small Turing Machines
TLDR
A novel numerical approach, motivated by the notion of algorithmic probability, to the problem of approximating the Kolmogorov-Chaitin complexity of short strings, which promises to deliver a range of applications, and to provide insight into the question of complexity calculation of finite (and short) strings.
Around Kolmogorov complexity: basic notions and results
  • A. Shen
  • Computer Science, Mathematics
    ArXiv
  • 2015
TLDR
This chapter attempts to fill the gap in the basic notions of algorithmic information theory and covers the basic properties of Kolmogorov complexity, Solomonoff universal a priori probability, notions of randomness, and effective Hausdorff dimension.
Dynamics, measure and dimension in the theory of computing
This thesis establishes some results in algorithmic information theory. Martin-Lof in 1966 formalized the notion of what it means for a given sequence to be random, using the theory of computation.
Turing and randomness
  • R. Downey
  • Computer Science, Mathematics
    The Turing Guide
  • 2017
TLDR
In an unpublished manuscript, Turing anticipated the basic ideas behind the theory of algorithmic randomness by nearly 30 years and used a computationally constrained version of “measure theory” to answer a question of Borel in number theory, to try to explain what these mysterious terms mean.
Logical operations and Kolmogorov complexity. II
  • A. Muchnik, N. Vereshchagin
  • Computer Science, Mathematics
    Proceedings 16th Annual IEEE Conference on Computational Complexity
  • 2001
TLDR
There are two strings, whose mutual information is large but which have no common information in a strong sense, thus solving the problem posed by Muchnik et al. (1999) and an interpretation of both results in terms of Shannon entropy.
Kolmogorov Complexity: Sources, Theory and Applications
TLDR
This special issue contains both material on non-computable aspects of Kolmogorov complexity and material on many fascinating applications based on different ways of approximating Kolmogsorovcomplexity.
Correspondence and Independence of Numerical Evaluations of Algorithmic Information Measures
TLDR
K_m proves to be a finer-grained measure and a potential alternative approach to lossless compression algorithms for small entities, where compression fails, and a first Beta version of an Online Algorithmic Complexity Calculator (OACC) is announced, based on a combination of theoretical concepts and numerical calculations.
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 373 REFERENCES
Applications of Kolmogorov Complexity in the Theory of Computation
This exposition gives a brief introduction to the main ideas of Kolmogorov complexity that have been useful in the area of computational complexity theory. We demonstrate how these ideas can actually
An Introduction to Formal Language Theory
TLDR
This volume intended to serve as a text for upper undergraduate and graduate level students and special emphasis is given to the role of algebraic techniques in formal language theory through a chapter devoted to the fixed point approach to the analysis of context-free languages.
Kolmogorov information and vlsi lower bounds
By using a source encoding result, lower bounds for the VLSI complexity of approximately computing certain uniform sets of finite functions f are related directly to the Kolmogorov information
THE COMPLEXITY OF FINITE OBJECTS AND THE DEVELOPMENT OF THE CONCEPTS OF INFORMATION AND RANDOMNESS BY MEANS OF THE THEORY OF ALGORITHMS
In 1964 Kolmogorov introduced the concept of the complexity of a finite object (for instance, the words in a certain alphabet). He defined complexity as the minimum number of binary signs containing
The Logic in computer science Column
  • Y. Gurevich
  • Computer Science, Mathematics
    Bull. EATCS
  • 1988
TLDR
It is shown that, if the authors restrict thesauri by requiring their probability distributions to be uniform, then they and parametric conditions are equivalent, and the thesaurus point of view suggests some possible extensions of the theory.
The Universal Turing Machine: A Half-Century Survey
TLDR
This book discusses Alan Turing's analysis of Computability, and major applications of It, and Turing Naturalized: Von Neumann's Unfinished Project.
Mathematical theory of thermodynamics of computation
TLDR
The fundamental theorem connects physics to mathematics, providing the key that makes such a theory possible, and establishes optimal upper and lower bounds on the ultimate thermodynamic cost of computation.
On the Notion of Randomness
Publisher Summary This chapter focusses on the notion of randomness. The sequences satisfying the definition of randomness form a set of probability one with respect to the measure that makes all
Kolmogorov's Early Work on Convergence Theory and Foundation
1. Probability before Kolmogorov. When Kolmogorov was starting his mathematical career, nonmathematical probability was, as it still is, the study of various not very precisely defined real contexts.
Godel Numberings of Partial Recursive Functions
  • H. Rogers
  • Mathematics, Computer Science
    J. Symb. Log.
  • 1958
TLDR
It will be observed that only concepts that are invariant with respect to general recursive functions are considered; more limited notions of Godel numbering, taking into account, say, primitive recursive structure, are beyond the scope of the present paper.
...
1
2
3
4
5
...