The cat is out of the bag: cortical simulations with 109 neurons, 1013 synapses

@article{Ananthanarayanan2009TheCI,
  title={The cat is out of the bag: cortical simulations with 109 neurons, 1013 synapses},
  author={R. Ananthanarayanan and Steven K. Esser and H. Simon and D. Modha},
  journal={Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis},
  year={2009},
  pages={1-12}
}
In the quest for cognitive computing, we have built a massively parallel cortical simulator, C2, that incorporates a number of innovations in computation, memory, and communication. Using C2 on LLNL's Dawn Blue Gene/P supercomputer with 147, 456 CPUs and 144 TB of main memory, we report two cortical simulations -- at unprecedented scale -- that effectively saturate the entire memory capacity and refresh it at least every simulated second. The first simulation consists of 1.6 billion neurons and… Expand
Compass: A scalable simulator for an architecture for cognitive computing
  • Robert Preissl, T. Wong, +6 authors D. Modha
  • Computer Science
  • 2012 International Conference for High Performance Computing, Networking, Storage and Analysis
  • 2012
Inspired by the function, power, and volume of the organic brain, we are developing TrueNorth, a novel modular, non-von Neumann, ultra-low power, compact architecture. TrueNorth consists of aExpand
Real-time million-synapse simulation of rat barrel cortex
TLDR
It is demonstrated that thousand-processor SpiNNaker prototypes can simulate models of the rodent barrel system comprising 50,000 neurons and 50 million synapses, and the models reproduce known thalamocortical response transformations, exhibit known, balanced dynamics of excitation and inhibition, and show a spatiotemporal spread of activity though the superficial cortical layers. Expand
Spiking network simulation code for petascale computers
TLDR
It is shown that the novel architecture presented here scales to the largest petascale supercomputers available today, and quantitatively discusses the performance on two supercomputing systems. Expand
Large-Scale Simulation of a Layered Cortical Sheet of Spiking Network Model Using a Tile Partitioning Method
TLDR
The result showed that the tile partitioning method drastically reduced communication data amount by replacing network communication with DRAM access and sharing the communication data with neighboring neurons, suggesting that the Tile partitions method will have advantage for a human-scale whole-brain simulation on exascale computers. Expand
Real-Time Million-Synapse Simulation of Cortical Tissue
TLDR
This dissertation demonstrates the success of prototype hardware with detailed models of the rodent somatosensory cortex on SpiNNaker, an effective architecture for the correct and efficient simulation of neural tissue. Expand
Limits to high-speed simulations of spiking neural networks using general-purpose computers
TLDR
To study plasticity in medium-sized spiking neural networks, adequate simulation tools are readily available which run efficiently on small clusters, however, to run simulations substantially faster than real-time, special hardware is a prerequisite. Expand
Meeting the Memory Challenges of Brain-Scale Network Simulation
TLDR
A simple linear model is developed to analyze the memory consumption of the constituent components of neuronal simulators as a function of network size and the number of cores used, which enables identification of key contributing components to memory saturation and prediction of the effects of potential improvements to code before any implementation takes place. Expand
GPGPU implementation of a synaptically optimized, anatomically accurate spiking network simulator
  • Ruggero Scorcioni
  • Computer Science
  • 2010 Biomedical Sciences and Engineering Conference
  • 2010
TLDR
A novel neuronal simulator is implemented on a CUDA-based General Purpose Graphic Processing Unit (GPGPU) that is fast, synaptically optimized and anatomically accurate and an efficient platform to simulate large spiking networks. Expand
GPGPU implementation of a synaptically optimized, anatomically accurate spiking network simulator
TLDR
A novel neuronal simulator is implemented on a CUDA-based General Purpose Graphic Processing Unit (GPGPU) that is fast, synaptically optimized and anatomically accurate and an efficient platform to simulate large spiking networks. Expand
Accelerated simulation of spiking neural networks using GPUs
TLDR
This work makes use of the Izhikevich neuron model which provides a range of realistic spiking dynamics while being computationally efficient and learning is facilitated through spike-timing dependent synaptic plasticity. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 40 REFERENCES
Anatomy of a cortical simulator
TLDR
A cortical simulator is built, C2, incorporating several algorithmic enhancements to optimize the simulation scale and time, through computationally efficient simulation of neurons in a clock-driven and synapses in an event-driven fashion; memory efficient representation of simulation state; and communication efficient message exchanges. Expand
Brain-scale simulation of the neocortex on the IBM Blue Gene/L supercomputer
TLDR
An overview of a neuronal network model of layers II/III of the neocortex built with biophysical model neurons, which is one of the largest simulations of this type ever performed on an IBM Blue Gene/L supercomputer. Expand
Scaling, stability and synchronization in mouse-sized (and larger) cortical simulations
TLDR
It is observed that finding a range of maximum synaptic efficacies corresponding to stable models is harder to achieve for higher number of synapses per neuron if the stimulus probability is kept low, and there appears to be a threshold stimulus probability below which models make a sharp transition from damped to avalanche mode. Expand
SpikeNET: an event-driven simulation package for modelling large networks of spiking neurons
TLDR
The underlying computation and implementation of such a mechanism in SpikeNET, the authors' neural network simulation package, is described and the type of model one can build is not only biologically compliant, it is also computationally efficient. Expand
Event-Driven Simulation Scheme for Spiking Neural Networks Using Lookup Tables to Characterize Neuronal Dynamics
TLDR
This work implements and evaluates critically an event-driven algorithm (ED-LUT) that uses precalculated look-up tables to characterize synaptic and neuronal dynamics, and introduces an improved two-stage event-queue algorithm, which allows the simulations to scale efficiently to highly connected networks with arbitrary propagation delays. Expand
Efficient Event-Driven Simulation of Large Networks of Spiking Neurons and Dynamical Synapses
TLDR
The main impact of the new approach is a drastic reduction of the computational load incurred upon introduction of dynamic synaptic efficacies, which vary organically as a function of the activities of the pre- and postsynaptic neurons. Expand
Large-scale model of mammalian thalamocortical systems
TLDR
The model exhibits behavioral regimes of normal brain activity that were not explicitly built-in but emerged spontaneously as the result of interactions among anatomical and dynamic processes, including spontaneous activity, sensitivity to changes in individual neurons, emergence of waves and rhythms, and functional connectivity on different scales. Expand
Advancing the Boundaries of High-Connectivity Network Simulation with Distributed Computing
TLDR
This work presents a collection of new techniques combined to a coherent simulation tool removing the fundamental obstacle in the computational study of biological neural networks: the enormous number of synaptic contacts per neuron. Expand
A Quantitative Map of the Circuit of Cat Primary Visual Cortex
TLDR
A quantitative description of the circuits formed in cat area 17 is developed by estimating the “weight” of the projections between different neuronal types by applying the simplification that synapses between different cell types are made in proportion to the boutons and dendrites that those cell types contribute to the neuropil in a given layer. Expand
Biophysics of Computation: Information Processing in Single Neurons (Computational Neuroscience Series)
TLDR
This work presents simplified models of individual neurons, and unconventional coupling, of action-potential generation and phase space analysis of neuronal excitability in response to the Hodgkin-Huxley model. Expand
...
1
2
3
4
...