Optimal Input Representation in Neural Systems at the Edge of Chaos

  title={Optimal Input Representation in Neural Systems at the Edge of Chaos},
  author={Guillermo B. Morales and Miguel Angel Mu{\~n}oz},
Simple Summary Here we show that a simple neural network within the paradigm of reservoir computing is able to reproduce an important feature of internal representations of neural inputs, in agreement with what theoretically predicted and empirically measured in the mouse visual cortex, only when it is set to operate at the edge of chaos. Abstract Shedding light on how biological systems represent, process and store information in noisy environments is a key and challenging goal. A stimulating… Expand

Figures from this paper


Optimal dynamical range of excitable networks at criticality
It is proposed that the main functional role of electrical coupling is to provide an enhancement of dynamic range, therefore allowing the coding of information spanning several orders of magnitude, which could provide a microscopic neural basis for psychophysical laws. Expand
Information processing in echo state networks at the edge of chaos
Evidence is presented that both information transfer and storage in the recurrent layer are maximized close to this phase transition, providing an explanation for why guiding the recurrent layers toward the edge of chaos is computationally useful. Expand
Optimal Information Representation and Criticality in an Adaptive Sensory Recurrent Neuronal Network
Several mechanisms by which the pattern of interactions can be driven into this supercritical regime are discussed and relate them to various neurological and neuropsychiatric phenomena. Expand
Connectivity, Dynamics, and Memory in Reservoir Computing with Binary and Analog Neurons
Investigating the influence of the network connectivity (parameterized by the neuron in-degree) on a family of network models that interpolates between analog and binary networks reveals that the phase transition between ordered and chaotic network behavior of binary circuits qualitatively differs from the one in analog circuits, leading to decreased computational performance observed in binary circuits that are densely connected. Expand
Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations
A new computational model for real-time computing on time-varying input that provides an alternative to paradigms based on Turing machines or attractor neural networks, based on principles of high-dimensional dynamical systems in combination with statistical learning theory and can be implemented on generic evolved or found recurrent circuitry. Expand
Echo State Property Linked to an Input: Exploring a Fundamental Characteristic of Recurrent Neural Networks
A new definition of the echo state property is presented that directly connects it to temporal or statistical properties of the driving input and derives a fundamental 0-1 law: if the input comes from an ergodic source, the network response has the echoState property with probability one or zero, independent of the given network. Expand
Second type of criticality in the brain uncovers rich multiple-neuron dynamics
The large dispersion of correlations across neurons is the signature of a second critical regime, which exhibits a rich dynamical repertoire hidden from macroscopic brain signals but essential for high performance in such concepts as reservoir computing. Expand
Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks
It is shown that only near the critical boundary can recurrent networks of threshold gates perform complex computations on time series, which strongly supports conjectures that dynamical systems that are capable of doing complex computational tasks should operate near the edge of chaos. Expand
High-dimensional geometry of population responses in visual cortex
Analysis of the encoding of natural images by very large populations of neurons in the visual cortex of awake mice characterizes the high dimensional geometry of the neural responses, suggesting that coding smoothness may represent a fundamental constraint that determines correlations in neural population codes. Expand
Edge of chaos and prediction of computational performance for neural circuit models
This article finds that the edge of chaos predicts quite well those values of circuit parameters that yield maximal computational performance, but obviously it makes no prediction of their computational performance for other parameter values, and proposes a new method for predicting the computational performance of neural microcircuit models. Expand