Toward a quantitative theory of self-generated complexity

  title={Toward a quantitative theory of self-generated complexity},
  author={Peter Grassberger},
  journal={International Journal of Theoretical Physics},
  • P. Grassberger
  • Published 1986
  • Mathematics
  • International Journal of Theoretical Physics
Quantities are defined operationally which qualify as measures of complexity of patterns arising in physical situations. Their main features, distinguishing them from previously used quantities, are the following: (1) they are measuretheoretic concepts, more closely related to Shannon entropy than to computational complexity; and (2) they are observables related to ensembles of patterns, not to individual patterns. Indeed, they are essentially Shannon information needed to specify not… Expand
Inferring the Dynamic, Quantifying Physical Complexity
Two approaches to the inverse problem of chaotic data analysis, estimating symbolic equations of motion and reconstructing minimal automata from chaotic data series, are reviewed. Expand
Complex systems, complexity measures, grammars and model-inferring
Abstract Quantifying complex behavior has been the subject of intense research during the last few years. In spite of these efforts there neither exists a universal measure characterizing theExpand
Complexity through nonextensivity
The problem of defining and studying complexity of a time series has interested people for years. In the context of dynamical systems, Grassberger has suggested that a slow approach of the entropy toExpand
The organization of intrinsic computation: complexity-entropy diagrams and the diversity of natural information processing.
This work uses complexity-entropy diagrams to analyze intrinsic computation in a broad array of deterministic nonlinear and linear stochastic processes, including maps of the interval, cellular automata, and Ising spin systems in one and two dimensions, Markov chains, and probabilistic minimal finite-state machines. Expand
General Remarks on Complexity
In the 1960s and 1970s it was found that nonlinear systems with only a few degrees of freedom are capable of creating a rich variety of behavior from regular to rather irregular features, laterExpand
Statistical Complexity. Applications in Electronic Systems
A statistical measure of complexity based on the interplay between the Shannon information and the separation of the set of accessible states to a system from the equiprobability distribution, i.e. the disequilibrium is introduced. Expand
Complexity of Dynamics as Variability of Predictability
We construct a complexity measure from first principles, as an average over the “obstruction against prediction” of some observable that can be chosen by the observer. Our measure evaluates theExpand
Complexity and forecasting in dynamical systems
We discuss ways of defining complexity in physics, and in particular for symbol sequences typically arising in autonomous dynamical systems. We stress that complexity should be distinct fromExpand
On complexity measures
Abstract We have shown in this paper that we inevitably come to a rather general concept of complexity also in the so‐called exact sciences, such as physics or chemistry. Basing on the dualities ofExpand
Quantitative characterization of complexity and predictability
Abstract The asymptotic behaviour of a generic nonlinear dynamical system F is estimated by constructing a sequence of Markov models F ( l ) 0 which approach the original system increasingly betterExpand


Computation theory of cellular automata
Self-organizing behaviour in cellular automata is discussed as a computational process. Formal language theory is used to extend dynamical systems theory descriptions of cellular automata. The setsExpand
In discussions of the nature of life, the terms “complexity,” “organism,” and “information content,” are sometimes used in ways remarkably analogous to the approach of algorithmic information theory,Expand
Algebraic properties of cellular automata
Cellular automata are discrete dynamical systems, of simple construction but complex and varied behaviour. Algebraic techniques are used to give an extensive analysis of the global properties of aExpand
Statistical mechanics of cellular automata
Cellular automata are used as simple mathematical models to investigate self-organization in statistical mechanics. A detailed analysis is given of ''elementary'' cellular automata consisting of aExpand
Ergodic theory of chaos and strange attractors
Physical and numerical experiments show that deterministic noise, or chaos, is ubiquitous. While a good understanding of the onset of chaos has been achieved, using as a mathematical tool theExpand
Iterated maps on the interval as dynamical systems
Motivation and Interpretation.- One-Parameter Families of Maps.- Typical Behavior for One Map.- Parameter Dependence.- Systematics of the Stable Periods.- On the Relative Frequency of Periodic andExpand
Introduction to Automata Theory, Languages and Computation
This book is a rigorous exposition of formal languages and models of computation, with an introduction to computational complexity, appropriate for upper-level computer science undergraduates who are comfortable with mathematical arguments. Expand
Quantitative universality for a class of nonlinear transformations
AbstractA large class of recursion relationsxn + 1 = λf(xn) exhibiting infinite bifurcation is shown to possess a rich quantitative structure essentially independent of the recursion function. TheExpand
The universal metric properties of nonlinear transformations
AbstractThe role of functional equations to describe the exact local structure of highly bifurcated attractors ofxn+1 =λf(xn) independent of a specificf is formally developed. A hierarchy ofExpand
To a mathematical definition of 'life'
A possible point of departure for a mathematical definition of 'life' is suggested, based on the computer, that is closely related to recent analyses of 'inductive inference' and 'randomness'. Expand