• Corpus ID: 17227573

Scalability and Optimization Strategies for GPU Enhanced Neural Networks (GeNN)

@article{Balaji2014ScalabilityAO,
  title={Scalability and Optimization Strategies for GPU Enhanced Neural Networks (GeNN)},
  author={N. Balaji and Esin Yavuz and Thomas Nowotny},
  journal={ArXiv},
  year={2014},
  volume={abs/1412.0595}
}
Simulation of spiking neural networks has been traditionally done on high-performance supercomputers or large-scale clusters. Utilizing the parallel nature of neural network computation algorithms, GeNN (GPU Enhanced Neural Network) provides a simulation environment that performs on General Purpose NVIDIA GPUs with a code generation based approach. GeNN allows the users to design and simulate neural networks by specifying the populations of neurons at different stages, their synapse connection… 

Figures and Tables from this paper

References

SHOWING 1-10 OF 16 REFERENCES
Simulating spiking neural networks on massively parallel graphical processing units using a code generation approach with GeNN
TLDR
GeNN (GPU enhance neuronal networks), which builds on NVIDIA's common unified device architecture (CUDA) to enable a more flexible framework, and shows that as the network size increases, GPU simulations never fail to outperform CPU simulations.
Flexible neuronal network simulation framework using code generation for NVidia® CUDA™
TLDR
An embryonic beta version of such a framework has been built and optimized for simulating neuronal networks with an anatomical structure (separate neuron populations that are densely connected), building on earlier work on neuronal network models of insects.
A comparative study of GPU programming models and architectures using neural networks
TLDR
A comprehensive study establishes connections between programming models, architectures and applications using a two-level character recognition network and an architectural performance comparison of the SNN application running on Nvidia's Fermi and AMD/ATi's Radeon is done.
Simple model of spiking neurons
A model is presented that reproduces spiking and bursting behavior of known types of cortical neurons. The model combines the biologically plausibility of Hodgkin-Huxley-type dynamics and the
Understanding the impact of CUDA tuning techniques for Fermi
TLDR
This paper discusses important relations between the size and shapes of threadblocks, occupancy, global memory access patterns, and other Fermi architecture features, such as the configuration of the new transparent cache, and an insight based approach to tuning techniques.
Self-organization in the olfactory system: one shot odor recognition in insects
We show in a model of spiking neurons that synaptic plasticity in the mushroom bodies in combination with the general fan-in, fan-out properties of the early processing layers of the olfactory system
Scaling, power, and the future of CMOS
This paper briefly reviews the forces that caused the power problem, the solutions that were applied, and what the solutions tell us about the problem. As systems became more power constrained,
Why CPU Frequency Stalled
  • P. Ross
  • Computer Science
    IEEE Spectrum
  • 2008
TLDR
In this paper, the cycle rate of the PC's central processing unit has been described and it is shown that the clock keeps a processor's parts working in unison.
Smith . " A comparative study of GPU programming models and architectures using neural networks
  • The Journal of Supercomputing
  • 2012
Smith . " A comparative study of GPU programming models and architectures using neural networks
  • The Journal of Supercomputing
  • 2012
...
...