Bio-inspired smart vision sensor: toward a reconfigurable hardware modeling of the hierarchical processing in the brain

  title={Bio-inspired smart vision sensor: toward a reconfigurable hardware modeling of the hierarchical processing in the brain},
  author={Pankaj Bhowmik and Md Jubaer Hossain Pantho and Christophe Bobda},
  journal={Journal of Real-Time Image Processing},
Biological vision systems inspire processing methods in computer vision applications. This paper employs the insights of vision systems in hardware and presents a pixel-parallel, reconfigurable, and layer-based hierarchical architecture for smart image sensors. The architecture aims to bring computation close to the sensor to achieve high acceleration for different machine vision applications while consuming low power. We logically divide the image into multiple regions and perform pixel-level… Expand
HARP: Hierarchical Attention Oriented Region-Based Processing for High-Performance Computation in Vision Sensor
A hardware architecture for smart cameras that understands the salient regions from an image frame and then performs high-level inference computation for sensor-level information creation instead of transporting raw pixels is presented. Expand
Curved neuromorphic image sensor array using a MoS2-organic heterostructure inspired by the human visual recognition system
The curved neuromorphic image sensor array integrated with a plano-convex lens derives a pre-processed image from a set of noisy optical inputs without redundant data storage, processing, and communications as well as without complex optics. Expand
Towards an Efficient CNN Inference Architecture Enabling In-Sensor Processing †
An attention-based pixel processing architecture to facilitate the CNN inference near the image sensor that significantly reduces dynamic power consumption and achieves high-speed up surpassing existing embedded processors’ computational capabilities. Expand
A survey of the development of biomimetic intelligence and robotics
This survey introduces the development of biomimetic intelligence and biomicetic robotics, and surveys different biomimetically robots, biomimetics sensors and sensing technologies, and popular biomimic intelligence algorithms. Expand
Attention-Based Secure Feature Extraction in Near Sensor Processing: Work-in-Progress
This paper presents a secure hardware architecture of an image sensor to accelerate feature extraction using region-level parallelism and reduces power consumption and data volume by utilizing the concepts of predictive coding. Expand
Data-Driven Channel Pruning towards Local Binary Convolution Inverse Bottleneck Network Based on Squeeze-and-Excitation Optimization Weights
This paper proposed a model pruning method based on local binary convolution (LBC) and squeeze-and-excitation (SE) optimization weights. We first proposed an efficient deep separation convolutionExpand


Design of a Reconfigurable 3D Pixel-Parallel Neuromorphic Architecture for Smart Image Sensor
The goal of this work is to prototype the focal plane image sensor which emulates the brain features and the results show that the prototype achieves remarkable power saving and speed-up at different stages. Expand
Pixel-Parallel Architecture for Neuromorphic Smart Image Sensor with Visual Attention
A pixel-parallel 3D-architecture of a neuromorphic image sensor that uses different sampling frequencies in different regions of an image to reduce redundancy and enable high-performance computing at low power. Expand
Visual Cortex Inspired Pixel-Level Re-configurable Processors for Smart Image Sensors
A reconfigurable hardware architecture of smart image sensors to speed up low-level image processing applications at the pixel level and shows the design saves up to 84.01% dynamic power and achieves 9x speedup at 800 MHz by accurate prediction. Expand
A Programmable Vision Chip Based on Multiple Levels of Parallel Processors
A novel programmable vision chip based on multiple levels of parallel processors that can satisfy flexibly the needs of different vision applications such as image pre-processing, complicated feature extraction and over 1000 fps high-speed image capture is proposed. Expand
On Real-Time AER 2-D Convolutions Hardware for Neuromorphic Spike-Based Cortical Processing
A chip that performs real-time image convolutions with programmable kernels of arbitrary shape is presented, and discussions and results on scaling up the approach for larger pixel arrays and multilayer cortical AER systems are provided. Expand
A Real-Time Motion-Feature-Extraction VLSI Employing Digital-Pixel-Sensor-Based Parallel Architecture
  • H. Zhu, T. Shibata
  • Computer Science
  • IEEE Transactions on Circuits and Systems for Video Technology
  • 2014
A fully pixel-parallel architecture has been explored in adaptive binarization of filtered images for essential feature extraction as well as in their temporal integration and derivative operations and, as a result, self-speed-adaptive motion feature extraction has been established. Expand
An insect vision-based motion detection chip
The architectural and circuit design aspects of a mixed analog/digital very large scale integration (VLSI) motion detection chip based on models of the insect visual system are described, implementing a reconfigurable architecture which facilitates the evaluation of several newly designed analog circuits. Expand
A biomorphic digital image sensor
An arbitrated address-event imager has been designed and fabricated in a 0.6-/spl mu/m CMOS process. The imager is composed of 80 /spl times/ 60 pixels of 32 /spl times/ 30 /spl mu/m. The value ofExpand
Advances on CMOS image sensors
Purpose The purpose of this paper is to offer an introduction to the technological advances of the complementary metal–oxide–semiconductor (CMOS) image sensors along the past decades. TheExpand
Bio-inspired computer vision: Towards a synergistic approach of artificial and biological vision
New insights are provided and a starting point for investigators interested in the design of biology-based computer vision algorithms and pave a way for much needed interaction between the two communities leading to the development of synergistic models of artificial and biological vision. Expand