Complementary Visual Neuronal Systems Model for Collision Sensing

  title={Complementary Visual Neuronal Systems Model for Collision Sensing},
  author={Qinbing Fu and Shigang Yue},
  journal={2020 5th International Conference on Advanced Robotics and Mechatronics (ICARM)},
  • Qinbing FuShigang Yue
  • Published 11 June 2020
  • Computer Science
  • 2020 5th International Conference on Advanced Robotics and Mechatronics (ICARM)
Inspired by insects' visual brains, this paper presents original modelling of a complementary visual neuronal systems model for real-time and robust collision sensing. Two categories of wide-field motion sensitive neurons, i.e., the lobula giant movement detectors (LGMDs) in locusts and the lobula plate tangential cells (LPTCs) in flies, have been studied, intensively. The LGMDs have specific selectivity to approaching objects in depth that threaten collision; whilst the LPTCs are only… 

Figures and Tables from this paper

A Comparative Study of Artificial Neural Network Approach for Autonomous Robot’s TTC Prediction

—In this study, the focus is on close proximity Time-to-Collision (TTC) prediction from an Autonomous Robot (AR)’s perception system, which is built with an X-band Doppler radar for relative speed



A Robust Collision Perception Visual Neural Network With Specific Selectivity to Darker Objects

An LGMD2 visual neural network is built which possesses the similar collision selectivity of anLGMD2 neuron in locust via the modeling of biased-ON and -OFF pathways splitting visual signals into parallel ON/OFF channels and responds selectively to darker looming objects.

Collision selective LGMDs neuron models research benefits from a vision-based autonomous micro robot

This research conducts binocular neuronal models, for the first time combining the functionalities of LGMD1 and LGMD2 neurons, in the visual modality of a ground mobile robot to study and compare two collision selective neuron models via a vision-based autonomous micro robot.

Bio-inspired Collision Detector with Enhanced Selectivity for Ground Robotic Vision System

A novel collision selective visual neural network inspired by LGMD2 neurons in the juvenile locusts is proposed, enhancing the collision selectivity in a bio-inspired way, via constructing a computing ef ficient visual sensor, and realizing the revealed specific characteristic sofLGMD2.

Modelling LGMD2 visual neuron system

  • Qinbing FuShigang Yue
  • Computer Science
    2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP)
  • 2015
A novel way to model LGMD2 is proposed, in order to emulate its predicted bio-functions, moreover, to solve some defects of previous LGMD1 computational models.

A neural model of the locust visual system for detection of object approaches with real-world scenes

A computational architecture for signalling impending collisions, based on known anatomical data of the locust LGMD neuron, is presented, which shows robust performance even in adverse situations, such as with approaching low-contrast objects, or with highly textured and moving backgrounds.

Towards Computational Models and Applications of Insect Visual Systems for Motion Perception: A Review

This article reviews the computational motion perception models originating from biological research on insects' visual systems in the literature, and summarizes the methodologies that generate different direction and size selectivity in motion perception.

A Visual Neural Network for Robust Collision Perception in Vehicle Driving Scenarios

The proposed novel inhibition mechanism works effectively to mediate the local inhibition strength and tune the temporal latency of local excitation reaching the LGMD neuron, and is effective to extract colliding cues from complex dynamic visual scenes.

Performance of a Visual Fixation Model in an Autonomous Micro Robot Inspired by Drosophila Physiology

A novel modelling of dynamic vision system inspired by Drosophila physiology for mimicking fast motion tracking and a closed-loop behavioural response to fixation was realised on the embedded system in an autonomous micro robot which has limited computational resources.

Small Brains, Smart Machines: From Fly Vision to Robot Vision and Back Again

Bio-inspired robotics not only help neurobiologists and neuroethologists to identify and investigate worthwhile problems in animals' sensory-motor systems, but they also provide engineers with ideas for developing novel devices and machines with promising future applications, in the field of smart autonomous vehicles and microvehicles, for example.

Modeling direction selective visual neural network with ON and OFF pathways for extracting motion cues from cluttered background

  • Shigang YueQinbing Fu
  • Computer Science
    2017 International Joint Conference on Neural Networks (IJCNN)
  • 2017
A novel way to model DSNs for recognizing movements on four cardinal directions is proposed, based on an architecture of ON and OFF visual pathways underlies a theory of splitting motion signals into parallel channels, encoding brightness increments and decrements separately.