A Neuromorphic Cortical-Layer Microchip for Spike-Based Event Processing Vision Systems
@article{SerranoGotarredona2006ANC, title={A Neuromorphic Cortical-Layer Microchip for Spike-Based Event Processing Vision Systems}, author={Rafael Serrano-Gotarredona and Teresa Serrano-Gotarredona and Antonio Acosta-Jim{\'e}nez and Bernab{\'e} Linares-Barranco}, journal={IEEE Transactions on Circuits and Systems I: Regular Papers}, year={2006}, volume={53}, pages={2548-2566} }
We present a neuromorphic cortical-layer processing microchip for address event representation (AER) spike-based processing systems. The microchip computes 2-D convolutions of video information represented in AER format in real time. AER, as opposed to conventional frame-based video representation, describes visual information as a sequence of events or spikes in a way similar to biological brains. This format allows for fast information identification and processing, without waiting to process…
Figures and Tables from this paper
105 Citations
On Real-Time AER 2-D Convolutions Hardware for Neuromorphic Spike-Based Cortical Processing
- Computer ScienceIEEE Transactions on Neural Networks
- 2008
A chip that performs real-time image convolutions with programmable kernels of arbitrary shape is presented, and discussions and results on scaling up the approach for larger pixel arrays and multilayer cortical AER systems are provided.
Fully digital AER convolution chip for vision processing
- Computer Science2008 IEEE International Symposium on Circuits and Systems
- 2008
A neuromorphic fully digital convolution microchip for address event representation (AER) spike-based processing systems that computes 2-D convolutions with a programmable kernel in real time.
Performance study of spike visual processing on a Supercomputer: AER-based spike convolution processing on a 320-core cluster
- Computer Science2011 International Symposium on Performance Evaluation of Computer & Telecommunication Systems
- 2011
A performance study of the CRS supercomputer of the University of Cadiz (UCA) for AER-based convolution processing is presented.
Neocortical frame-free vision sensing and processing through scalable Spiking ConvNet hardware
- Computer ScienceThe 2010 International Joint Conference on Neural Networks (IJCNN)
- 2010
This paper summarizes how Convolutional Neural Networks (ConvNets) can be implemented in hardware using Spiking neural network Address-Event-Representation (AER) technology, for sophisticated pattern…
FPGA Implementations Comparison of Neuro-cortical Inspired Convolution Processors for Spiking Systems
- Computer ScienceIWANN
- 2009
This paper presents two FPGA implementations of AER-based convolution processors that are able to work with 64x64 images and programmable kernels of up to 11x11 elements and the main difference is the use of RAM for integrators in one solution and the absence of Integrators in the second solution that is based on mapping operations.
On scalable spiking convnet hardware for cortex-like visual sensory processing systems
- Computer ScienceProceedings of 2010 IEEE International Symposium on Circuits and Systems
- 2010
This paper summarizes how Convolutional Neural Networks (ConvNets) can be implemented in hardware using Spiking neural network Address-Event-Representation (AER) technology, for sophisticated pattern…
An AER Spike-Processing Filter Simulator and Automatic VHDL Generator Based on Cellular Automata
- Computer ScienceIWANN
- 2011
A software simulator able to gather several spike-based elements into the same workspace in order to test a CA architecture based on AER before a hardware implementation, and produces VHDL for testing the AER-CA into the FPGA of the USBAER A ER-tool.
Advanced Vision Processing Systems: Spike-Based Simulation and Processing
- Computer ScienceACIVS
- 2009
This paper presents a simulation AER tool that is developed entirely in Visual C++ 6.0 and can predict the eventual performance of AER-based systems, before the technology becomes mature enough to allow such large systems.
AER Spiking Neuron Computation on GPUs: The Frame-to-AER Generation
- Computer ScienceICONIP
- 2011
The first results of a CUDA-based tool focused on the functional processing of AER spikes is presented, with the aim of helping in the design and testing of filters and buses management of these systems.
Fast Pipeline 128×128 pixel spiking convolution core for event-driven vision processing in FPGAs
- Computer Science2015 International Conference on Event-based Control, Communication, and Signal Processing (EBCCSP)
- 2015
A digital implementation of a parallel and pipelined spiking convolutional neural network (S-ConvNet) core for processing spikes in an event-driven system and results in updating the state of a 128 neuron row in just 12ns.
References
SHOWING 1-10 OF 94 REFERENCES
On Real-Time AER 2-D Convolutions Hardware for Neuromorphic Spike-Based Cortical Processing
- Computer ScienceIEEE Transactions on Neural Networks
- 2008
A chip that performs real-time image convolutions with programmable kernels of arbitrary shape is presented, and discussions and results on scaling up the approach for larger pixel arrays and multilayer cortical AER systems are provided.
A real-time spike-domain sensory information processing system [image processing applications]
- Computer Science2005 IEEE International Symposium on Circuits and Systems
- 2005
This work represents the first step in constructing an autonomous, continuous-time, biologically-plausible hierarchical model of visual information processing using large-scale arrays of identical silicon neurons.
AER Building Blocks for Multi-Layer Multi-Chip Neuromorphic Vision Systems
- Computer ScienceNIPS
- 2005
A 5-layer neuromorphic vision processor whose components communicate spike events asychronously using the address-event-representation (AER) is demonstrated. The system includes a retina chip, two…
An ON-OFF orientation selective address event representation image transceiver chip
- Computer ScienceIEEE Transactions on Circuits and Systems I: Regular Papers
- 2004
In comparison with a two-layer network implementing the same filters, this network results in a more symmetric circuit design with lower quiescent power dissipation, albeit at the expense of twice as many transistors.
A Spatial Contrast Retina With On-Chip Calibration for Neuromorphic Spike-Based AER Vision Systems
- EngineeringIEEE Transactions on Circuits and Systems I: Regular Papers
- 2007
A 32 times 32 pixels contrast retina microchip that provides its output as an address event representation (AER) stream is presented that shows a reduction in mismatch standard deviation from 57% to 6.6% (indoor light).
Adaptive WTA With an Analog VLSI Neuromorphic Learning Chip
- Computer ScienceIEEE Transactions on Neural Networks
- 2007
It is demonstrated how a particular spike-based learning rule can be tuned to express rate-based classical Hebbian learning behavior, where the average input and output spike rates are sufficient to describe the synaptic changes.
Reconfigurable biologically inspired visual motion systems using modular neuromorphic VLSI chips
- Computer ScienceIEEE Transactions on Circuits and Systems I: Regular Papers
- 2005
Modular mixed-signal very large-scale integration (VLSI) implementations of the three most prominent biological models of visual motion detection are presented, showing how such modular VLSI building blocks make it possible to build highly powerful and flexible vision systems.
Saliency-driven image acuity modulation on a reconfigurable silicon array of spiking neurons
- Computer ScienceNIPS 2004
- 2004
The utility and versatility of the system is demonstrated by configuring it as a three-stage network that accepts input from an address-event imager, detects salient regions of the image, and performs spatial acuity modulation around a high-resolution fovea that is centered on the location of highest salience.
An integrated cortical layer for orientation enhancement
- Engineering
- 1997
This paper presents a set of two analog chips performing the following chain of operations: phototransduction of an image projected on the first chip, edge enhancement by high-pass filtering,…