Corpus ID: 10545728

# Noisy Spiking Neurons with Temporal Coding have more Computational Power than Sigmoidal Neurons

@inproceedings{Maass1996NoisySN,
title={Noisy Spiking Neurons with Temporal Coding have more Computational Power than Sigmoidal Neurons},
author={W. Maass},
booktitle={NIPS},
year={1996}
}
• W. Maass
• Published in NIPS 1996
• Computer Science
We exhibit a novel way of simulating sigmoidal neural nets by networks of noisy spiking neurons in temporal coding. Furthermore it is shown that networks of noisy spiking neurons with temporal coding have a strictly larger computational power than sigmoidal neural nets with the same number of units.
157 Citations

#### Figures and Topics from this paper

Spiking neural network for control chart pattern recognition
• Computer Science
• 2007 European Control Conference (ECC)
• 2007
Temporal coding spiking neural networks are receiving wider attention due to their computational power. The coincidence detection property of a spiking neuron, which has no counterpart in a sigmoidalExpand
Backpropagation for Population-Temporal Coded Spiking Neural Networks
• Computer Science
• The 2006 IEEE International Joint Conference on Neural Network Proceedings
• 2006
A new learning rule for spiking neurons that uses the general population-temporal coding model, inspired by learning rules for locally recurrent analog neural networks, that is able to operate on a wide class of decoding schemes. Expand
Digital spiking neuron cells for real-time reconfigurable learning networks
• Computer Science
• 2017 30th IEEE International System-on-Chip Conference (SOCC)
• 2017
Experimental results indicate that the proposed real-time data-flow learning network architecture allows the capacity of over 2800 (depending on the model complexity) biophysically accurate neurons in a single FPGA device. Expand
Temporal pattern recognition using spiking neural networks for cortical neuronal spike train decoding
• Computer Science
• 2008
Spiking neural networks (SNN) which consist of spiking neurons propagate information by the timing of spikes to analyze the cortical neural spike trains directly without temporal information lost demonstrate that temporal coding is a viable code for fast neural information processing. Expand
Error-backpropagation in temporally encoded networks of spiking neurons
• Computer Science, Mathematics
• Neurocomputing
• 2002
It is demonstrated that temporal coding requires significantly less neurons than instantaneous rate-coding, and a supervised learning rule, \emph{SpikeProp}, akin to traditional error-backpropagation, is derived. Expand
Investigating the computational power of spiking neurons with non-standard behaviors
• S. Kampakis
• Computer Science, Medicine
• Neural Networks
• 2013
The computational power of neurons with different behaviors based on the previous analyses conducted by Maass and Schmitt are studied; the studied behaviors are rebound spiking, resonance and bursting. Expand
Improving SpikeProp: Enhancements to An Error-Backpropagation Rule for Spiking Neural Networks
• Computer Science
• 2004
These enhancements to the SpikeProp learning algorithm provide additional learning rules for the synaptic delays and time constants and for the neurons’ thresholds, which results in smaller network topologies. Expand
An extended model for a spiking neuron class
• Computer Science, Medicine
• Biological Cybernetics
• 2007
This paper proposes an extension to the model of a spiking neuron for information processing in artificial neural networks, developing a new approach for the dynamic threshold of theExpand
An STDP Training Algorithm for a Spiking Neural Network with Dynamic Threshold Neurons
• Computer Science, Medicine
• Int. J. Neural Syst.
• 2010
A supervised training algorithm is proposed which modifies the Spike Timing Dependent Plasticity (STDP)learning rule to support both local and network level training with multiple synaptic connections and axonal delays for Spiking Neural Networks. Expand
A gradient descent rule for spiking neurons emitting multiple spikes
• Computer Science
• Inf. Process. Lett.
• 2005
A supervised learning rule for Spiking Neural Networks (SNNs) is presented that can cope with neurons that spike multiple times and is successfully tested on a classification task of Poisson spike trains. Expand

#### References

SHOWING 1-10 OF 12 REFERENCES
Reliability and information transmission in spiking neurons
• Medicine, Computer Science
• Trends in Neurosciences
• 1992
The results of these studies show that neural coding and computation in several systems approach fundamental physical and informational theoretic limits to performance. Expand
Fast Sigmoidal Networks via Spiking Neurons
• W. Maass
• Computer Science, Medicine
• Neural Computation
• 1997
It is shown that networks of relatively realistic mathematical models for biological neurons in principle can simulate arbitrary feedforward sigmoidal neural nets in a way that has previously not been considered and are universal approximators in the sense that they can approximate with regard to temporal coding any given continuous function of several variables. Expand
Networks of spiking neurons: the third generation of neural network models
It is shown that networks of spiking neurons are, with regard to the number of neurons that are needed, computationally more powerful than other neural network models based on McCulloch Pitts neurons and sigmoidal gates. Expand
On the Computational Power of Noisy Spiking Neurons
• W. Maass
• Mathematics, Computer Science
• NIPS
• 1995
These constructions provide a possible explanation for the fact that biological neural systems can carry out quite complex computations within 100 msec and it turns out that the assumption that these constructions require about the shape of the EPSP's and the behaviour of the noise are surprisingly weak. Expand
Networks of Spiking Neurons: The Third Generation of Neural Network Models
• W. Maass
• Computer Science
• Electron. Colloquium Comput. Complex.
• 1996
It is shown that networks of spiking neurons are, with regard to the number of neurons that are needed, computationally more powerful than these other neural network models based on McCulloch Pitts neurons, respectively, sigmoidal gates. Expand
Temporal Precision of Spike Trains in Extrastriate Cortex of the Behaving Macaque Monkey
• Psychology, Computer Science
• Neural Computation
• 1996
Single neurons recorded in a previous study from cortical area MT in the behaving monkey respond to dynamic and unpredictable motion stimuli with a markedly reproducible temporal modulation that is precise to a few milliseconds. Expand
Pattern recognition computation using action potential timing for stimulus representation
A computational model is described in which the sizes of variables are represented by the explicit times at which action potentials occur, rather than by the more usual 'firing rate' of neurons. TheExpand
Multilayer Feedforward Networks with a Non-Polynomial Activation Function Can Approximate Any Function
• Mathematics, Computer Science
• Neural Networks
• 1993
It is shown that a standard multilayer feedforward network can approximate any continuous function to any degree of accuracy if and only if the network's activation functions are not polynomial. Expand
VC dimension in circuit complexity
• P. Koiran
• Computer Science, Mathematics
• Proceedings of Computational Complexity (Formerly Structure in Complexity Theory)
• 1996
This is the first lower bound for the computation model of sigmoidal circuits with unbounded weights, and upper and lower bounds for the same function in a few other computation models: circuits of AND/OR gates, threshold circuits, and circuits of piecewise-rational gates. Expand
Real-time performance of a movement-sensitive neuron in the blowfly visual system
• Computer Science
• 1986
A depth-measuring instrument of the membrane type has a metallic disc membrane deformations of which those of which are recorded by a pointer on a scale are recorded. Expand