# A theoretical basis for efficient computations with noisy spiking neurons

@article{Jonke2014ATB, title={A theoretical basis for efficient computations with noisy spiking neurons}, author={Zeno Jonke and Stefan Habenschuss and Wolfgang Maass}, journal={ArXiv}, year={2014}, volume={abs/1412.5862} }

Network of neurons in the brain apply - unlike processors in our current generation of computer hardware - an event-based processing strategy, where short pulses (spikes) are emitted sparsely by neurons to signal the occurrence of an event at a particular point in time. Such spike-based computations promise to be substantially more power-efficient than traditional clocked processing schemes. However it turned out to be surprisingly difficult to design networks of spiking neurons that are able…

## 7 Citations

On the Algorithmic Power of Spiking Neural Networks

- Computer ScienceITCS
- 2019

A dual view of the SNN dynamics is seen, under which SNN can be viewed as a new natural primal-dual algorithm for the l1 minimization problem, which is of independent interest and may potentially find interesting interpretation in neuroscience.

To Spike or Not to Spike: That Is the Question

- Computer Science, BiologyProc. IEEE
- 2015

Recent progress in understanding how complex computations can be carried out with such stochastically spiking neurons is discussed, and the viability of such a merger is examined.

Brain-Inspired Models and Systems for Distributed Computation

- Computer Science
- 2017

The purpose of this thesis is to investigate key characteristics of biological nervous systems and suggest ways of incorporating these principles in artificial systems and demonstrate how a non-trivial network topology, featuring predominantly local connectivity, can be achieved by taking into account these principles.

Positive Neural Networks in Discrete Time Implement Monotone-Regular Behaviors

- Mathematics, Computer ScienceNeural Computation
- 2015

It is shown that in discrete time and in the absence of noise, the class of positive neural networks captures the so-called monotone-regular behaviors, which are based on regular languages.

Spiking analog VLSI neuron assemblies as constraint satisfaction problem solvers

- Computer Science2016 IEEE International Symposium on Circuits and Systems (ISCAS)
- 2016

This work shows how stochasticity can be achieved by implementing deterministic models of integrate and fire neurons using subthreshold analog circuits that are affected by thermal noise and presents an efficient implementation of spike-based CSP solvers using a reconfigurable neural network VLSI device, and the device's intrinsic noise as a source of randomness.

Integrating Temporal Information to Spatial Information in a Neural Circuit

- Computer ScienceDISC
- 2019

This paper designs three networks that solve three problems -- "first consecutive spikes counting", "total spikes counting" and "$k-spikes temporal to spatial encoding" -- to model how brains extract temporal information into spatial information from different neural codings.

## References

SHOWING 1-10 OF 40 REFERENCES

Probabilistic Inference in General Graphical Models through Sampling in Stochastic Networks of Spiking Neurons

- Computer Science, BiologyPLoS Comput. Biol.
- 2011

Ubiquitous stochastic features of networks of spiking neurons, such as trial-to-trial variability and spontaneous activity, are necessary ingredients of the underlying computational organization and can be scaled up to neural emulations of probabilistic inference in fairly large graphical models.

Networks of Spiking Neurons: The Third Generation of Neural Network Models

- Computer ScienceElectron. Colloquium Comput. Complex.
- 1996

Solving nonlinear optimization problems using networks of spiking neurons

- Computer ScienceProceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium
- 2000

The goal of this paper is to prove that neural networks like the SRM (Spike Response Model) are able to solve nonlinear optimization problems and to demonstrate this for the traveling salesman problem.

Stochastic Computations in Cortical Microcircuit Models

- Computer SciencePLoS Comput. Biol.
- 2013

It is shown that the inherent stochastic dynamics of generic cortical microcircuits enables them to quickly generate approximate solutions to difficult constraint satisfaction problems, where stored knowledge and current inputs jointly constrain possible solutions.

Predicting spike timing of neocortical pyramidal neurons by simple threshold models

- BiologyJournal of Computational Neuroscience
- 2006

Neurons generate spikes reliably with millisecond precision if driven by a fluctuating current—is it then possible to predict the spike timing knowing the input? We determined parameters of an…

Decorrelation of Neural-Network Activity by Inhibitory Feedback

- BiologyPLoS Comput. Biol.
- 2012

It is shown that inhibitory feedback efficiently suppresses pairwise correlations and, hence, population-rate fluctuations, thereby assigning inhibitory neurons the new role of active decorrelation.

Six Networks on a Universal Neuromorphic Computing Substrate

- Computer ScienceFront. Neurosci.
- 2013

This study presents a highly configurable neuromorphic computing substrate and uses it for emulating several types of neural networks, including a mixed-signal chip, which has been explicitly designed as a universal neural network emulator.

Theta-paced flickering between place-cell maps in the hippocampus

- BiologyNature
- 2011

It is shown in rats that instantaneous transformation of the spatial context does not change the hippocampal representation all at once but is followed by temporary bistability in the discharge activity of CA3 ensembles, indicating a short period of competitive flickering between preformed representations of the past and present environment before settling on the latter.

Stochastic Electronics: A Neuro-Inspired Design Paradigm for Integrated Circuits

- Computer ScienceProceedings of the IEEE
- 2014

The role of noise in both biological and engineered systems is reviewed and how “stochastic facilitation” can be used to perform useful and precise computation is discussed and the concept of stochastic electronics (SE) is introduced; a new way to design circuits and increase performance in highly noisy and mismatched fabrication environments.

Weak pairwise correlations imply strongly correlated network states in a neural population

- BiologyNature
- 2006

It is shown, in the vertebrate retina, that weak correlations between pairs of neurons coexist with strongly collective behaviour in the responses of ten or more neurons, and it is found that this collective behaviour is described quantitatively by models that capture the observed pairwise correlations but assume no higher-order interactions.