The local information dynamics of distributed computation in complex systems
@inproceedings{Lizier2012TheLI,
title={The local information dynamics of distributed computation in complex systems},
author={Joseph T. Lizier},
year={2012}
}The nature of distributed computation in complex systems has often been described in terms of memory, communication and processing. This thesis presents a complete information-theoretic framework to quantify these operations on information (i.e. information storage, transfer and modification), and in particular their dynamics in space and time. The framework is applied to cellular automata, and delivers important insights into the fundamental nature of distributed computation and the dynamics…
109 Citations
Coherent information structure in complex computation
- Computer ScienceTheory in Biosciences
- 2011
It is conjecture that coherent information structure is a defining feature of complex computation, particularly in biological systems or artificially evolved computation that solves human-understandable tasks.
Information storage and transfer in the synchronization process in locally-connected networks
- Computer Science2011 IEEE Symposium on Artificial Life (ALIFE)
- 2011
Information-theoretical techniques are used to view the synchronization process as a distributed computation, and to measure the information storage and transfer at each node in the system at each time step, producing novel insights, including that the computation of the synchronized state appears to be completed much more quickly than application-specific measures would indicate.
Measuring the Dynamics of Information Processing on a Local Scale in Time and Space
- Computer Science
- 2014
This chapter reviews the mathematics of how to measure local entropy and mutual information values at specific observations of time-series processes, and describes how these measures can reveal much more intricate details about the dynamics of complex systems than their more well-known “average” measures do.
Information modification and particle collisions in distributed computation.
- Computer ScienceChaos
- 2010
The separable information is introduced, a measure which locally identifies information modification events where separate inspection of the sources to a computation is misleading about its outcome.
On active information storage in input-driven systems
- Computer ScienceArXiv
- 2013
Using the proposed input-corrected information storage, the aim is to better quantify system behaviour, which will be important for heavily input-driven systems like artificial neural networks to abstract from specific benchmarks, or for brain networks, where intervention is difficult, individual components cannot be tested in isolation or with arbitrary input data.
Local measures of information storage in complex distributed computation
- Computer ScienceInf. Sci.
- 2012
Spatiotemporal dynamics driven by the maximization of local information transfer
- Computer ScienceNew Journal of Physics
- 2019
It is found that, within a certain condition of limited memory, even if each cell is driven to maximize the LTE, the entire system cannot reach toward its theoretical maximum value at all due to its intrinsic property, in which the system is dynamically bounding its limit on its own.
JIDT: An Information-Theoretic Toolkit for Studying the Dynamics of Complex Systems
- Computer ScienceFront. Robot. AI
- 2014
The Java Information Dynamics Toolkit (JIDT) is introduced, a Google code project which provides a standalone, (GNU GPL v3 licensed) open-source code implementation for empirical estimation of information-theoretic measures from time-series data.
Symbolic local information transfer
- Computer ScienceArXiv
- 2014
This paper proposes measures called symbolic local transfer entropies, and applies them to two test models, the coupled map lattice system and the Bak-Sneppen model, to show their relevance to spatiotemporal systems that have continuous states, and demonstrates that these measures can provide novel insight to the model.
Information Dynamics in Small-World Boolean Networks
- Computer ScienceArtificial Life
- 2011
An ensemble investigation of the computational capabilities of small-world networks as compared to ordered and random topologies finds that the ordered phase of the dynamics and topologies with low randomness are dominated by information storage, while the chaotic phase is dominated byInformation storage and information transfer.