Synthetic Neural Vision System Design for Motion Pattern Recognition in Dynamic Robot Scenes
@article{Fu2019SyntheticNV, title={Synthetic Neural Vision System Design for Motion Pattern Recognition in Dynamic Robot Scenes}, author={Qinbing Fu and Cheng Hu and Pengcheng Liu and Shigang Yue}, journal={ArXiv}, year={2019}, volume={abs/1904.07180} }
Insects have tiny brains but complicated visual systems for motion perception. A handful of insect visual neurons have been computationally modeled and successfully applied for robotics. How different neurons collaborate on motion perception, is an open question to date. In this paper, we propose a novel embedded vision system in autonomous micro-robots, to recognize motion patterns in dynamic robot scenes. Here, the basic motion patterns are categorized into movements of looming (proximity…
Figures and Tables from this paper
References
SHOWING 1-10 OF 24 REFERENCES
Bio-inspired Collision Detector with Enhanced Selectivity for Ground Robotic Vision System
- Computer ScienceBMVC
- 2016
A novel collision selective visual neural network inspired by LGMD2 neurons in the juvenile locusts is proposed, enhancing the collision selectivity in a bio-inspired way, via constructing a computing ef ficient visual sensor, and realizing the revealed specific characteristic sofLGMD2.
Visual motion pattern extraction and fusion for collision detection in complex dynamic scenes
- Computer ScienceComput. Vis. Image Underst.
- 2006
Mimicking fly motion tracking and fixation behaviors with a hybrid visual neural network
- Biology2017 IEEE International Conference on Robotics and Biomimetics (ROBIO)
- 2017
A novel hybrid visual neural network is conducted, combining the functionality of two bio-plausible, namely the motion and the position pathways, for mimicking motion tracking and fixation behaviors in the fly.
Collision selective LGMDs neuron models research benefits from a vision-based autonomous micro robot
- Computer Science2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
- 2017
This research conducts binocular neuronal models, for the first time combining the functionalities of LGMD1 and LGMD2 neurons, in the visual modality of a ground mobile robot to study and compare two collision selective neuron models via a vision-based autonomous micro robot.
Modeling direction selective visual neural network with ON and OFF pathways for extracting motion cues from cluttered background
- Computer Science2017 International Joint Conference on Neural Networks (IJCNN)
- 2017
A novel way to model DSNs for recognizing movements on four cardinal directions is proposed, based on an architecture of ON and OFF visual pathways underlies a theory of splitting motion signals into parallel channels, encoding brightness increments and decrements separately.
Bio-Inspired Embedded Vision System for Autonomous Micro-Robots: The LGMD Case
- Computer ScienceIEEE Transactions on Cognitive and Developmental Systems
- 2017
The implementation of the selected neuron model by a low-cost ARM processor as part of a composite vision module is presented, which is the first embedded LGMD vision module fits to a micro-robot and performs all image acquisition and processing independently.
Optic flow-based collision-free strategies: From insects to robots.
- BiologyArthropod structure & development
- 2017
Reactive direction control for a mobile robot: a locust-like control of escape direction emerges when a bilateral pair of model locust visual neurons are integrated
- Computer ScienceAuton. Robots
- 2010
Khepera robots equipped with normal and panoramic cameras and using ‘randomised winner-take-all’ or ‘steering wheel’ algorithms for LGMD model integration could escape an approaching threat in real time and with a similar distribution of escape directions as real locusts.
LGMD and DSNs neural networks integration for collision predication
- Computer Science2016 International Joint Conference on Neural Networks (IJCNN)
- 2016
An integrated collision predication system is proposed based on neural subsystems inspired from Lobula giant movement detector and directional selective neurons which focus on different part of the visual field separately which can detect hazardous situations that had been difficult for single subsystem only.