• Corpus ID: 13895289

On active information storage in input-driven systems

  title={On active information storage in input-driven systems},
  author={Oliver Obst and Joschka Boedecker and Benedikt Schmidt and Minoru Asada},
Information theory and the framework of information dynamics have been used to provide tools to characterise complex systems. In particular, we are interested in quantifying information storage, information modification and information transfer as characteristic elements of computation. Although these quantities are defined for autonomous dynamical systems, information dynamics can also help to get a "wholistic" understanding of input-driven systems such as neural networks. In this case, we do… 

Figures from this paper

Guided Self-Organization of Input-Driven Recurrent Neural Networks
M Mathematical techniques from graph and information theory, control theory, dynamical and complex systems, as well as machine learning and computer vision, have provided new insights into brain structure and possible function, and continue to generate new hypotheses for future research.
Measuring inter- and intra-individual differences in visual scan patterns in a driving simulator experiment using active information storage
The active information storage is evaluated as a novel information-theoretic approach to quantifying scan path predictability in a dynamic task and it is concluded that accounting for longer time horizons in scan paths in a personalized fashion is beneficial for interpreting gaze pattern in dynamic tasks.
Local active information storage as a tool to understand distributed neural information processing
It is suggested that LAIS will be a useful quantity to test theories of cortical function, such as predictive coding, when measured on a local scale in time and space in voltage sensitive dye imaging data from area 18 of the cat.
Information theoretic evidence for layer- and frequency-specific changes in cortical information processing under anesthesia
It is found that the modulation ofactive information storage by isoflurane is specific to frequency, layers and area, and that the analysis of frequency-specific active information storage provides insights not captured by more traditional descriptions of neural activity.
JIDT: An Information-Theoretic Toolkit for Studying the Dynamics of Complex Systems
  • J. Lizier
  • Computer Science
    Front. Robot. AI
  • 2014
The Java Information Dynamics Toolkit (JIDT) is introduced, a Google code project which provides a standalone, (GNU GPL v3 licensed) open-source code implementation for empirical estimation of information-theoretic measures from time-series data.


The local information dynamics of distributed computation in complex systems
A complete information-theoretic framework to quantify these operations on information, and in particular their dynamics in space and time, is applied to cellular automata, and delivers important insights into the fundamental nature of distributed computation and the dynamics of complex systems.
Nonnegative Decomposition of Multivariate Information
This work reconsider from first principles the general structure of the information that a set of sources provides about a given variable and proposes a definition of partial information atoms that exhaustively decompose the Shannon information in a multivariate system in terms of the redundancy between synergies of subsets of the sources.
It is shown that the full set of hydromagnetic equations admit five more integrals, besides the energy integral, if dissipative processes are absent, which made it possible to formulate a variational principle for the force-free magnetic fields.
The information sciences
Through a human centered design project focused on an information science problem, students will gain experience and a better understanding of the process to develop an innovative solution addressing a societal need.
Proceedings of the National Academy of Sciences, USA
Information Sciences 208
  • 39
  • 2012
Proceedings of the European Symposium on Artificial Neural Networks
Editorial: The pre-history of Chaos-An Interdisciplinary Journal of Nonlinear Science.
Artificial Intelligence
The history, the major landmarks, and some of the controversies in each of these twelve topics are discussed, as well as some predictions about the course of future research.