# Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons

@article{Buesing2011NeuralDA, title={Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons}, author={Lars Buesing and Johannes Bill and Bernhard Nessler and W. Maass}, journal={PLoS Computational Biology}, year={2011}, volume={7} }

The organization of computations in networks of spiking neurons in the brain is still largely unknown, in particular in view of the inherently stochastic features of their firing activity and the experimentally observed trial-to-trial variability of neural systems in the brain. In principle there exists a powerful computational framework for stochastic computations, probabilistic inference by sampling, which can explain a large number of macroscopic experimental data in neuroscience and… Expand

#### Figures, Tables, and Topics from this paper

#### Paper Mentions

#### 323 Citations

Probabilistic Inference in General Graphical Models through Sampling in Stochastic Networks of Spiking Neurons

- Computer Science, Medicine
- PLoS Comput. Biol.
- 2011

Ubiquitous stochastic features of networks of spiking neurons, such as trial-to-trial variability and spontaneous activity, are necessary ingredients of the underlying computational organization and can be scaled up to neural emulations of probabilistic inference in fairly large graphical models. Expand

Ensembles of Spiking Neurons with Noise Support Optimal Probabilistic Inference in a Dynamically Changing Environment

- Computer Science, Medicine
- PLoS Comput. Biol.
- 2014

The viability of this new approach towards neural coding and computation, which makes use of the inherent parallelism of generic neural circuits, is demonstrated by showing that this model can explain experimentally observed firing activity of cortical neurons for a variety of tasks that require rapid temporal integration of sensory information. Expand

Oscillatory background activity implements a backbone for sampling-based computations in spiking neural networks

- Computer Science, Biology
- ArXiv
- 2020

This work shows that both in current-based and conductance-based neuron models, the level of background activity effectively defines the sampling temperature of the network, and demonstrates that background oscillations can structure stochastic computations into discrete sampling episodes. Expand

Computing with noise in spiking neural networks

- Computer Science
- 2017

This work provides a novel analytical description of the neural response function with an unprecedented range of validity and implements interconnected sampling networks which exploit their activity as noise resource to maintain a stochastic firing regime. Expand

Distributed Bayesian Computation and Self-Organized Learning in Sheets of Spiking Neurons with Local Lateral Inhibition

- Computer Science, Medicine
- PloS one
- 2015

This study shows how the spiking dynamics of a recurrent network with lateral excitation and local inhibition in response to distributed spiking input, can be understood as sampling from a variational posterior distribution of a well-defined implicit probabilistic model, which permits a rigorous analytical treatment of experience-dependent plasticity on the network level. Expand

Causal Inference and Explaining Away in a Spiking Network

- Medicine, Computer Science
- Scientific reports
- 2015

It is demonstrated that a family of high-dimensional quadratic optimization problems with non-negativity constraints can be solved exactly and efficiently by a network of spiking neurons. Expand

Stochasticity from function - why the Bayesian brain may need no noise

- Computer Science, Biology
- Neural Networks
- 2019

It is suggested that spiking neural networks may have no need for noise to perform sampling-based Bayesian inference, thereby reducing the architectural constraints imposed on physical neural substrates required to perform probabilistic computing, be they biological or artificial. Expand

Neurons as Monte Carlo Samplers: Bayesian Inference and Learning in Spiking Networks

- Computer Science, Mathematics
- NIPS
- 2014

The proposed spiking network model provides a functional explanation for the Poisson-like noise commonly observed in cortical responses and shows how such a neuronal network with synaptic plasticity can implement a form of Bayesian inference similar to Monte Carlo methods such as particle filtering. Expand

A theoretical basis for efficient computations with noisy spiking neurons

- Computer Science, Biology
- ArXiv
- 2014

A new theoretical framework for organizing computations of networks of spiking neurons is presented and it is shown that a suitable design enables them to solve hard constraint satisfaction problems from the domains of planning - optimization and verification - logical inference. Expand

Stochastic neural computation without noise

- Computer Science, Biology
- 2017

It is shown that the resulting shared-noise correlations can significantly impair the performance of stochastic network models, and the problem can be overcome by using deterministic recurrent neural networks as sources of Stochasticity, exploiting the decorrelating effect of inhibitory feedback. Expand

#### References

SHOWING 1-10 OF 82 REFERENCES

Belief Propagation in Networks of Spiking Neurons

- Mathematics, Computer Science
- Neural Computation
- 2009

This work shows in detailed simulations how the belief propagation algorithm on a factor graph can be embedded in a network of spiking neurons, and demonstrates good agreement between the performance of the networks and the direct numerical evaluation of belief propagation. Expand

Probabilistic Computation in Spiking Populations

- Computer Science
- NIPS
- 2004

This work suggests a model based on standard neural architecture and activations for spiking neurons, and applies it to a sensorimotor integration task that provides a particularly compelling example of dynamic probabilistic computation. Expand

Bayesian Spiking Neurons I: Inference

- Computer Science, Medicine
- Neural Computation
- 2008

The dynamics of spiking neurons can be interpreted as a form of Bayesian inference in time, and firing statistics are close to Poisson, albeit providing a deterministic representation of probabilities. Expand

Spatio-temporal correlations and visual signalling in a complete neuronal population

- Biology, Medicine
- Nature
- 2008

The functional significance of correlated firing in a complete population of macaque parasol retinal ganglion cells is analysed using a model of multi-neuron spike responses, and a model-based approach reveals the role of correlated activity in the retinal coding of visual stimuli, and provides a general framework for understanding the importance of correlation activity in populations of neurons. Expand

Cortical Circuitry Implementing Graphical Models

- Mathematics, Computer Science
- Neural Computation
- 2009

Following previous work, which proposed relations between graphical models and the large-scale cortical anatomy, this work focuses on the cortical microcircuitry and proposes how anatomical and physiological aspects of the local circuitry may map onto elements of the graphical model implementation. Expand

Characterizing neuronal activity by describing the membrane potential as a stochastic process

- Physics, Medicine
- Journal of Physiology-Paris
- 2009

A recently proposed method, the "VmT method", is analogous to the VmD method and estimates the mean excitatory and inhibitory conductances and their variances, and does so by using a maximum-likelihood estimation, and can be applied to single V(m) traces. Expand

Stochastic Ion Channel Gating in Dendritic Neurons: Morphology Dependence and Probabilistic Synaptic Activation of Dendritic Spikes

- Physics, Medicine
- PLoS Comput. Biol.
- 2010

The simulations suggest that a direct consequence of stochastic gating of intrinsic ion channels is that spike output may instead be a probabilistic function of patterns of synaptic input to dendrites. Expand

The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs

- Physics, Medicine
- The Journal of neuroscience : the official journal of the Society for Neuroscience
- 1993

It is argued that neurons that act as temporal integrators over many synaptic inputs must fire very regularly and only in the presence of either fast and strong dendritic nonlinearities or strong synchronization among individual synaptic events will the degree of predicted variability approach that of real cortical neurons. Expand

Interpreting Neural Response Variability as Monte Carlo Sampling of the Posterior

- Computer Science, Mathematics
- NIPS
- 2002

This paper proposes an alternative view in which the variability of cortical sensory neurons is related to the uncertainty, about world parameters, which is inherent in the sensory stimulus, and provides simulations suggesting how some aspects of response variability might be understood in this framework. Expand

Bayesian brain : probabilistic approaches to neural coding

- Psychology
- 2006

A Bayesian approach can contribute to an understanding of the brain on multiple levels, by giving normative predictions about how an ideal sensory system should combine prior knowledge and… Expand