Moving Object Detection for Event-based Vision using Graph Spectral Clustering

  title={Moving Object Detection for Event-based Vision using Graph Spectral Clustering},
  author={Anindya Mondal and R Shashant and Jhony H. Giraldo and Thierry Bouwmans and Ananda S. Chowdhury},
  journal={2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)},
Moving object detection has been a central topic of discussion in computer vision for its wide range of applications like in self-driving cars, video surveillance, security, and enforcement. Neuromorphic Vision Sensors (NVS) are bio-inspired sensors that mimic the working of the human eye. Unlike conventional frame-based cameras, these sensors capture a stream of asynchronous ‘events’ that pose multiple advantages over the former, like high dynamic range, low latency, low power consumption, and… 

Figures and Tables from this paper

Unconventional Visual Sensors for Autonomous Vehicles
The principles of four novel image sensors: infrared cameras, range-gated cameras, polarization cameras, and event cameras are reviewed in a systematic manner and are expected to assist practitioners in the autonomous driving society with new perspectives and insights.
Recovery of Missing Sensor Data by Reconstructing Time-varying Graph Signals
Inspired by the emerging field of graph signal processing, a new study of a Sobolev reconstruction algorithm in wireless sensor networks is performed that surpasses multiple state-of-the-art techniques by a maximum margin of 54%.


Event-Based Moving Object Detection and Tracking
This paper presents a novel event stream representation which enables us to utilize information about the dynamic (temporal)component of the event stream, and demonstrates the framework on the task of independent motion detection and tracking, where it is used to locate differently moving objects in challenging situations of very fast motion.
Event-based Vision: A Survey
This paper provides a comprehensive overview of the emerging field of event-based vision, with a focus on the applications and the algorithms developed to unlock the outstanding properties of event cameras.
Event-Based Motion Segmentation by Motion Compensation
This work presents the first per-event segmentation method for splitting a scene into independently moving objects, and shows the first quantitative evaluation of a segmentation algorithm for event cameras, yielding around 90% accuracy at 4 pixels relative displacement.
Online Multi-object Tracking-by-Clustering for Intelligent Transportation System with Neuromorphic Vision Sensor
This contribution proposes an online multi-target tracking system utilizing for neuromorphic vision sensors, which is the first neuromorph vision system in intelligent transportation systems, and integrates an online tracking-by-clustering system running at a high frame rate, which far exceeds the real-time capabilities of traditional frame based industry cameras.
Moving object detection: Review of recent research trends
A brief classification of the classical approaches for moving object detection is provided and recent research trends to detect moving object for single stationary camera is reviewed with discussion of key points and limitations of each approach.
High Speed and High Dynamic Range Video with an Event Camera
This work proposes a novel recurrent network to reconstruct videos from a stream of events, and trains it on a large amount of simulated event data, and shows that off-the-shelf computer vision algorithms can be applied to the reconstructions and that this strategy consistently outperforms algorithms that were specifically designed for event data.
Graph Moving Object Segmentation
This work proposes a new algorithm that is composed of segmentation, background initialization, graph construction, unseen sampling, and a semi-supervised learning method inspired by the theory of recovery of graph signals, which has the advantage of requiring less labeled data than deep learning methods while having competitive results on both static and moving camera videos.
Moving Object Detection With Deep CNNs
To solve the problem of noise-induced object fracture during the coarse-grained detection process, a low-complexity connected region detection algorithm is presented to extract moving regions and Deep Convolution Neural Networks are used to detect more precise coordinates and identify the category of objects.
FAST-Dynamic-Vision: Detection and Tracking Dynamic Objects with Event and Depth Sensing
  • Baotao He, Haojia Li, Fei Gao
  • Computer Science
    2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
  • 2021
This paper presents a complete perception system including ego-motion compensation, object detection, and trajectory prediction for fast-moving dynamic objects with low latency and high precision for unmanned aerial vehicles (UAVs).
Review of optical flow technique for moving object detection
This paper presents one of such method which is termed as Optical Flow technique, found to be more robust and efficient for moving object detection and the same has been shown by an experiment in the paper.