The local information dynamics of distributed computation in complex systems

@inproceedings{Lizier2012TheLI,
  title={The local information dynamics of distributed computation in complex systems},
  author={Joseph T. Lizier},
  year={2012}
}
  • J. Lizier
  • Published 6 November 2012
  • Computer Science
The nature of distributed computation in complex systems has often been described in terms of memory, communication and processing. This thesis presents a complete information-theoretic framework to quantify these operations on information (i.e. information storage, transfer and modification), and in particular their dynamics in space and time. The framework is applied to cellular automata, and delivers important insights into the fundamental nature of distributed computation and the dynamics… 
View via Publisher
beck-shop.de
109 Citations
Highly Influential Citations
16
Background Citations
65
Methods Citations
21
Results Citations
1

109 Citations

Coherent information structure in complex computation
TLDR
It is conjecture that coherent information structure is a defining feature of complex computation, particularly in biological systems or artificially evolved computation that solves human-understandable tasks.
Information storage and transfer in the synchronization process in locally-connected networks
TLDR
Information-theoretical techniques are used to view the synchronization process as a distributed computation, and to measure the information storage and transfer at each node in the system at each time step, producing novel insights, including that the computation of the synchronized state appears to be completed much more quickly than application-specific measures would indicate.
Measuring the Dynamics of Information Processing on a Local Scale in Time and Space
TLDR
This chapter reviews the mathematics of how to measure local entropy and mutual information values at specific observations of time-series processes, and describes how these measures can reveal much more intricate details about the dynamics of complex systems than their more well-known “average” measures do.
Information modification and particle collisions in distributed computation.
TLDR
The separable information is introduced, a measure which locally identifies information modification events where separate inspection of the sources to a computation is misleading about its outcome.
On active information storage in input-driven systems
TLDR
Using the proposed input-corrected information storage, the aim is to better quantify system behaviour, which will be important for heavily input-driven systems like artificial neural networks to abstract from specific benchmarks, or for brain networks, where intervention is difficult, individual components cannot be tested in isolation or with arbitrary input data.
Local measures of information storage in complex distributed computation
Spatiotemporal dynamics driven by the maximization of local information transfer
TLDR
It is found that, within a certain condition of limited memory, even if each cell is driven to maximize the LTE, the entire system cannot reach toward its theoretical maximum value at all due to its intrinsic property, in which the system is dynamically bounding its limit on its own.
JIDT: An Information-Theoretic Toolkit for Studying the Dynamics of Complex Systems
  • J. Lizier
  • Computer Science
    Front. Robot. AI
  • 2014
TLDR
The Java Information Dynamics Toolkit (JIDT) is introduced, a Google code project which provides a standalone, (GNU GPL v3 licensed) open-source code implementation for empirical estimation of information-theoretic measures from time-series data.
Symbolic local information transfer
TLDR
This paper proposes measures called symbolic local transfer entropies, and applies them to two test models, the coupled map lattice system and the Bak-Sneppen model, to show their relevance to spatiotemporal systems that have continuous states, and demonstrates that these measures can provide novel insight to the model.
Information Dynamics in Small-World Boolean Networks
TLDR
An ensemble investigation of the computational capabilities of small-world networks as compared to ordered and random topologies finds that the ordered phase of the dynamics and topologies with low randomness are dominated by information storage, while the chaotic phase is dominated byInformation storage and information transfer.
...
...