# An Introduction to Kolmogorov Complexity and Its Applications

@inproceedings{Li1993AnIT, title={An Introduction to Kolmogorov Complexity and Its Applications}, author={Ming Li and Paul M. B. Vit{\'a}nyi}, booktitle={Texts and Monographs in Computer Science}, year={1993} }

The book is outstanding and admirable in many respects. ... is necessary reading for all kinds of readers from undergraduate students to top authorities in the field. Journal of Symbolic Logic Written by two experts in the field, this is the only comprehensive and unified treatment of the central ideas and their applications of Kolmogorov complexity. The book presents a thorough treatment of the subject with a wide range of illustrative applications. Such applications include the randomness of…

## Topics from this paper

## 3,916 Citations

The Mathematical Foundations of Randomness

- Computer Science
- 2016

A nontechnical account of the mathematical theory of randomness, which connects computability and complexity theory with mathematical logic, proof theory, probability and measure theory, analysis, computer science, and philosophy, and has surprising applications in a variety of fields.

Kolmogorov Complexity: Recent Research in Moscow

- Mathematics, Computer ScienceMFCS
- 1996

The goal of this talk is to state some of the questions and the results obtained in Moscow during the last years of Kolmogorov complexity theory.

Descriptive Complexity

- Computer ScienceGraduate Texts in Computer Science
- 1999

The core of the book is contained in Chapters 1 through 7, although even here some sections can be omitted according to the taste and interests of the instructor, and the remaining chapters are more independent of each other.

Calculating Kolmogorov Complexity from the Output Frequency Distributions of Small Turing Machines

- Mathematics, Computer SciencePloS one
- 2014

A novel numerical approach, motivated by the notion of algorithmic probability, to the problem of approximating the Kolmogorov-Chaitin complexity of short strings, which promises to deliver a range of applications, and to provide insight into the question of complexity calculation of finite (and short) strings.

Around Kolmogorov complexity: basic notions and results

- Computer Science, MathematicsArXiv
- 2015

This chapter attempts to fill the gap in the basic notions of algorithmic information theory and covers the basic properties of Kolmogorov complexity, Solomonoff universal a priori probability, notions of randomness, and effective Hausdorff dimension.

Dynamics, measure and dimension in the theory of computing

- Mathematics
- 2009

This thesis establishes some results in algorithmic information theory. Martin-Lof in 1966 formalized the notion of what it means for a given sequence to be random, using the theory of computation.…

Turing and randomness

- Computer Science, MathematicsThe Turing Guide
- 2017

In an unpublished manuscript, Turing anticipated the basic ideas behind the theory of algorithmic randomness by nearly 30 years and used a computationally constrained version of “measure theory” to answer a question of Borel in number theory, to try to explain what these mysterious terms mean.

Logical operations and Kolmogorov complexity. II

- Computer Science, MathematicsProceedings 16th Annual IEEE Conference on Computational Complexity
- 2001

There are two strings, whose mutual information is large but which have no common information in a strong sense, thus solving the problem posed by Muchnik et al. (1999) and an interpretation of both results in terms of Shannon entropy.

Kolmogorov Complexity: Sources, Theory and Applications

- Computer ScienceComput. J.
- 1999

This special issue contains both material on non-computable aspects of Kolmogorov complexity and material on many fascinating applications based on different ways of approximating Kolmogsorovcomplexity.

Correspondence and Independence of Numerical Evaluations of Algorithmic Information Measures

- Mathematics, Computer ScienceComput.
- 2013

K_m proves to be a finer-grained measure and a potential alternative approach to lossless compression algorithms for small entities, where compression fails, and a first Beta version of an Online Algorithmic Complexity Calculator (OACC) is announced, based on a combination of theoretical concepts and numerical calculations.

## References

SHOWING 1-10 OF 373 REFERENCES

Applications of Kolmogorov Complexity in the Theory of Computation

- Mathematics
- 1990

This exposition gives a brief introduction to the main ideas of Kolmogorov complexity that have been useful in the area of computational complexity theory. We demonstrate how these ideas can actually…

An Introduction to Formal Language Theory

- Computer ScienceTexts and Monographs in Computer Science
- 1988

This volume intended to serve as a text for upper undergraduate and graduate level students and special emphasis is given to the role of algebraic techniques in formal language theory through a chapter devoted to the fixed point approach to the analysis of context-free languages.

Kolmogorov information and vlsi lower bounds

- Mathematics
- 1984

By using a source encoding result, lower bounds for the VLSI complexity of approximately computing certain uniform sets of finite functions f are related directly to the Kolmogorov information…

THE COMPLEXITY OF FINITE OBJECTS AND THE DEVELOPMENT OF THE CONCEPTS OF INFORMATION AND RANDOMNESS BY MEANS OF THE THEORY OF ALGORITHMS

- Mathematics
- 1970

In 1964 Kolmogorov introduced the concept of the complexity of a finite object (for instance, the words in a certain alphabet). He defined complexity as the minimum number of binary signs containing…

The Logic in computer science Column

- Computer Science, MathematicsBull. EATCS
- 1988

It is shown that, if the authors restrict thesauri by requiring their probability distributions to be uniform, then they and parametric conditions are equivalent, and the thesaurus point of view suggests some possible extensions of the theory.

The Universal Turing Machine: A Half-Century Survey

- Computer Science
- 1992

This book discusses Alan Turing's analysis of Computability, and major applications of It, and Turing Naturalized: Von Neumann's Unfinished Project.

Mathematical theory of thermodynamics of computation

- Computer Science
- 1992

The fundamental theorem connects physics to mathematics, providing the key that makes such a theory possible, and establishes optimal upper and lower bounds on the ultimate thermodynamic cost of computation.

On the Notion of Randomness

- Mathematics
- 1970

Publisher Summary This chapter focusses on the notion of randomness. The sequences satisfying the definition of randomness form a set of probability one with respect to the measure that makes all…

Kolmogorov's Early Work on Convergence Theory and Foundation

- Mathematics
- 1989

1. Probability before Kolmogorov. When Kolmogorov was starting his mathematical career, nonmathematical probability was, as it still is, the study of various not very precisely defined real contexts.…

Godel Numberings of Partial Recursive Functions

- Mathematics, Computer ScienceJ. Symb. Log.
- 1958

It will be observed that only concepts that are invariant with respect to general recursive functions are considered; more limited notions of Godel numbering, taking into account, say, primitive recursive structure, are beyond the scope of the present paper.