Complete Mean-Field Theory for Dynamics of Binary Recurrent Networks.

@article{Farkhooi2017CompleteMT,
  title={Complete Mean-Field Theory for Dynamics of Binary Recurrent Networks.},
  author={Farzad Farkhooi and Wilhelm Stannat},
  journal={Physical review letters},
  year={2017},
  volume={119 20},
  pages={
          208301
        }
}
We develop a unified theory that encompasses the macroscopic dynamics of recurrent interactions of binary units within arbitrary network architectures. Using the martingale theory, our mathematical analysis provides a complete description of nonequilibrium fluctuations in networks with a finite size and finite degree of interactions. Our approach allows the investigation of systems for which a deterministic mean-field theory breaks down. To demonstrate this, we uncover a novel dynamic state in… 

Figures from this paper

Ubiquity of collective irregular dynamics in balanced networks of spiking neurons
TLDR
A detailed investigation of the thermodynamic limit for fixed density of connections (massive coupling) shows that, when inhibition prevails, the asymptotic regime is not asynchronous but rather characterized by a self-sustained irregular, macroscopic (collective) dynamics.
Ubiquity of collective irregular dynamics in balanced networks of spiking neurons.
TLDR
A detailed investigation of the thermodynamic limit for fixed density of connections (massive coupling) shows that, when inhibition prevails, the asymptotic regime is not asynchronous but rather characterized by a self-sustained irregular, macroscopic (collective) dynamics.
Mean-field Approximation for Stochastic Population Processes in Networks under Imperfect Information
TLDR
General conditions on the network and policy dynamics for which a suitable mean-field approximation exists are provided and it is shown that as long as the network is well-connected, the macroscopic behavior of the population concentrates around the same mean- field system as the complete-graph case.
Mean Field Limits for Interacting Diffusions in a Two-Scale Potential
TLDR
It is shown that, although the mean field and homogenization limits commute for finite times, they do not, in general, commute in the long time limit.
Dynamics of the Desai-Zwanzig model in multiwell and random energy landscapes.
TLDR
The structure and nature of bifurcations and phase transitions for this system of weakly interacting diffusions moving in a multiwell potential energy landscape, coupled via a Curie-Weiss type (quadratic) interaction potential are characterized.
A CHARACTERIZATION OF THE EDGE OF CRITICALITY IN BINARY ECHO STATE NETWORKS
TLDR
Binary ESNs are proposed, which are architecturally equivalent to standard ESNs but consider binary activation functions and binary recurrent weights, and a theoretical explanation for the fact that the variance of the input plays a major role in characterizing the EoC.
Spatial and temporal correlations in neural networks with structured connectivity
Correlated fluctuations in the activity of neural populations reflect the network’s dynamics and connectivity. The temporal and spatial dimensions of neural correlations are interdependent. How-ever,
Chaotic neural circuit dynamics
TLDR
Novel numerical and analytical techniques from dynamical systems, stochastic processes and information theory are developed to characterize the evoked and spontaneous dynamics and phase space organization of large neural circuit models to determine how biophysical properties of neurons and network parameters influence information transmission.
Unfolding recurrence by Green's functions for optimized reservoir computing
TLDR
The purpose of this work is to present a solvable recurrent network model that links to feed forward networks and transforms the time-continuous, recurrent dynamics into an effective feed-forward structure of linear and non-linear temporal kernels.
Mean Field Limits for Interacting Diffusions with Colored Noise: Phase Transitions and Spectral Numerical Methods
TLDR
The spectral method that is developed in this paper can be used for solving linear and nonlinear, local and nonlocal (mean-field) Fokker-Planck equations, without requiring that they have a gradient structure.
...
...

References

SHOWING 1-10 OF 32 REFERENCES
The Correlation Structure of Local Neuronal Networks Intrinsically Results from Recurrent Dynamics
TLDR
It is demonstrated how the accuracy of mean-field predictions can be improved by self-consistently including correlations, and the cancellation of correlations between the summed inputs to pairs of neurons does not originate from the fast tracking of external input, but from the suppression of fluctuations on the population level by the local network.
Chaotic Balanced State in a Model of Cortical Circuits
TLDR
The chaotic nature of the balanced state of this network model is revealed by showing that the evolution of the microscopic state of the network is extremely sensitive to small deviations in its initial conditions.
On Embedding Synfire Chains in a Balanced Network
TLDR
The formation of synfire waves in a balanced network of integrate-and-fire neurons is investigated, finding the conditions under which a synfire wave could be propagated on top of an otherwise asynchronous state of the network.
Time‐Dependent Statistics of the Ising Model
The individual spins of the Ising model are assumed to interact with an external agency (e.g., a heat reservoir) which causes them to change their states randomly with time. Coupling between the
An Introduction to Markov Processes
Preface.- Random Walks, a Good Place to Begin.- Doeblin's Theory for Markov Chains.- Stationary Probabilities.- More about the Ergodic Theory of Markov Chains.- Markov Processes in Continuous Time.-
The Asynchronous State in Cortical Circuits
TLDR
It is shown theoretically that recurrent neural networks can generate an asynchronous state characterized by arbitrarily low mean spiking correlations despite substantial amounts of shared input, which generates negative correlations in synaptic currents which cancel the effect of sharedinput.
Polychronization: Computation with Spikes
We present a minimal spiking network that can polychronize, that is, exhibit reproducible time-locked but not synchronous firing patterns with millisecond precision, as in synfire braids. The network
Sequential structure of neocortical spontaneous activity in vivo
TLDR
It is suggested that stereotyped patterns of spontaneous activity in the neocortex arise from the interplay of intrinsic cellular conductances and local circuit properties, and local networks as the substrate of sequential firing patterns.
Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits
TLDR
The local cortical network structure can be viewed as a skeleton of stronger connections in a sea of weaker ones, likely to play an important role in network dynamics and should be investigated further.
...
...