• Corpus ID: 8490872

A theoretical basis for efficient computations with noisy spiking neurons

@article{Jonke2014ATB,
  title={A theoretical basis for efficient computations with noisy spiking neurons},
  author={Zeno Jonke and Stefan Habenschuss and Wolfgang Maass},
  journal={ArXiv},
  year={2014},
  volume={abs/1412.5862}
}
Network of neurons in the brain apply - unlike processors in our current generation of computer hardware - an event-based processing strategy, where short pulses (spikes) are emitted sparsely by neurons to signal the occurrence of an event at a particular point in time. Such spike-based computations promise to be substantially more power-efficient than traditional clocked processing schemes. However it turned out to be surprisingly difficult to design networks of spiking neurons that are able… 

Figures from this paper

On the Algorithmic Power of Spiking Neural Networks
TLDR
A dual view of the SNN dynamics is seen, under which SNN can be viewed as a new natural primal-dual algorithm for the l1 minimization problem, which is of independent interest and may potentially find interesting interpretation in neuroscience.
To Spike or Not to Spike: That Is the Question
  • W. Maass
  • Computer Science, Biology
    Proc. IEEE
  • 2015
TLDR
Recent progress in understanding how complex computations can be carried out with such stochastically spiking neurons is discussed, and the viability of such a merger is examined.
Brain-Inspired Models and Systems for Distributed Computation
TLDR
The purpose of this thesis is to investigate key characteristics of biological nervous systems and suggest ways of incorporating these principles in artificial systems and demonstrate how a non-trivial network topology, featuring predominantly local connectivity, can be achieved by taking into account these principles.
Positive Neural Networks in Discrete Time Implement Monotone-Regular Behaviors
TLDR
It is shown that in discrete time and in the absence of noise, the class of positive neural networks captures the so-called monotone-regular behaviors, which are based on regular languages.
Spiking analog VLSI neuron assemblies as constraint satisfaction problem solvers
TLDR
This work shows how stochasticity can be achieved by implementing deterministic models of integrate and fire neurons using subthreshold analog circuits that are affected by thermal noise and presents an efficient implementation of spike-based CSP solvers using a reconfigurable neural network VLSI device, and the device's intrinsic noise as a source of randomness.
Integrating Temporal Information to Spatial Information in a Neural Circuit
TLDR
This paper designs three networks that solve three problems -- "first consecutive spikes counting", "total spikes counting" and "$k-spikes temporal to spatial encoding" -- to model how brains extract temporal information into spatial information from different neural codings.

References

SHOWING 1-10 OF 40 REFERENCES
Probabilistic Inference in General Graphical Models through Sampling in Stochastic Networks of Spiking Neurons
TLDR
Ubiquitous stochastic features of networks of spiking neurons, such as trial-to-trial variability and spontaneous activity, are necessary ingredients of the underlying computational organization and can be scaled up to neural emulations of probabilistic inference in fairly large graphical models.
Networks of Spiking Neurons: The Third Generation of Neural Network Models
  • W. Maass
  • Computer Science
    Electron. Colloquium Comput. Complex.
  • 1996
Solving nonlinear optimization problems using networks of spiking neurons
  • R. Malaka, Sebastian Buck
  • Computer Science
    Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium
  • 2000
TLDR
The goal of this paper is to prove that neural networks like the SRM (Spike Response Model) are able to solve nonlinear optimization problems and to demonstrate this for the traveling salesman problem.
Stochastic Computations in Cortical Microcircuit Models
TLDR
It is shown that the inherent stochastic dynamics of generic cortical microcircuits enables them to quickly generate approximate solutions to difficult constraint satisfaction problems, where stored knowledge and current inputs jointly constrain possible solutions.
Predicting spike timing of neocortical pyramidal neurons by simple threshold models
Neurons generate spikes reliably with millisecond precision if driven by a fluctuating current—is it then possible to predict the spike timing knowing the input? We determined parameters of an
Decorrelation of Neural-Network Activity by Inhibitory Feedback
TLDR
It is shown that inhibitory feedback efficiently suppresses pairwise correlations and, hence, population-rate fluctuations, thereby assigning inhibitory neurons the new role of active decorrelation.
Six Networks on a Universal Neuromorphic Computing Substrate
TLDR
This study presents a highly configurable neuromorphic computing substrate and uses it for emulating several types of neural networks, including a mixed-signal chip, which has been explicitly designed as a universal neural network emulator.
Theta-paced flickering between place-cell maps in the hippocampus
TLDR
It is shown in rats that instantaneous transformation of the spatial context does not change the hippocampal representation all at once but is followed by temporary bistability in the discharge activity of CA3 ensembles, indicating a short period of competitive flickering between preformed representations of the past and present environment before settling on the latter.
Stochastic Electronics: A Neuro-Inspired Design Paradigm for Integrated Circuits
TLDR
The role of noise in both biological and engineered systems is reviewed and how “stochastic facilitation” can be used to perform useful and precise computation is discussed and the concept of stochastic electronics (SE) is introduced; a new way to design circuits and increase performance in highly noisy and mismatched fabrication environments.
Weak pairwise correlations imply strongly correlated network states in a neural population
TLDR
It is shown, in the vertebrate retina, that weak correlations between pairs of neurons coexist with strongly collective behaviour in the responses of ten or more neurons, and it is found that this collective behaviour is described quantitatively by models that capture the observed pairwise correlations but assume no higher-order interactions.
...
...