Spatiotemporal multiple persons tracking using Dynamic Vision Sensor

@article{Piatkowska2012SpatiotemporalMP,
  title={Spatiotemporal multiple persons tracking using Dynamic Vision Sensor},
  author={Ewa Piatkowska and Ahmed Nabil Belbachir and Stephan Schraml and Margrit Gelautz},
  journal={2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops},
  year={2012},
  pages={35-40}
}
Although motion analysis has been extensively investigated in the literature and a wide variety of tracking algorithms have been proposed, the problem of tracking objects using the Dynamic Vision Sensor requires a slightly different approach. Dynamic Vision Sensors are biologically inspired vision systems that asynchronously generate events upon relative light intensity changes. Unlike conventional vision systems, the output of such sensor is not an image (frame) but an address events stream… 

Figures and Tables from this paper

Event-Based Moving Object Detection and Tracking
TLDR
This paper presents a novel event stream representation which enables us to utilize information about the dynamic (temporal)component of the event stream, and demonstrates the framework on the task of independent motion detection and tracking, where it is used to locate differently moving objects in challenging situations of very fast motion.
Pedestrian Detection and Tracking Using a Dynamic Vision Sensor
TLDR
An algorithm inspired in K-means clustering is presented and the analysis of the human kinematics based on DVS is described in order to detect and track pedestrians in a controlled environment.
Feature detection and tracking with the dynamic and active-pixel vision sensor (DAVIS)
TLDR
This work presents the first algorithm to detect and track visual features using both the frames and the event data provided by the DAVIS, a novel vision sensor which combines a standard camera and an asynchronous event-based sensor in the same pixel array.
Single/Cross-Camera Multiple-Person Traffic Tracking by Graph Matching
TLDR
A new online learning tracking system to generate the complete trajectory for each tracking object by using a new Part-based matching method to get the correlation between different tracklets and apply linear programming and greedy algorithm to handle the data association problem.
Dynamic Vision Sensor Tracking Method Based on Event Correlation Index
TLDR
Experiments show that this method can obtain the position information of the moving object and its continuous motion trajectory and analyze the influence of the parameters on the tracking effect and has broad application prospects in security, transportation, etc.
Asynchronous Tracking-by-Detection on Adaptive Time Surfaces for Event-based Object Tracking
TLDR
An Adaptive Time-Surface with Linear Time Decay (ATSLTD) event-to-frame conversion algorithm, which asynchronously and effectively warps the spatio-temporal information of asynchronous retinal events to a sequence of ATSLTD frames with clear object contours to perform accurate and efficient object tracking.
Moving Object Detection for Event-based Vision using Graph Spectral Clustering
TLDR
An unsupervised Graph Spectral Clustering technique for Moving Object Detection in Event-based data (GSCEventMOD) is presented and it is shown how the optimum number of moving objects can be automatically determined.
FAST-Dynamic-Vision: Detection and Tracking Dynamic Objects with Event and Depth Sensing
  • Baotao He, Haojia Li, Fei Gao
  • Computer Science
    2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
  • 2021
TLDR
This paper presents a complete perception system including ego-motion compensation, object detection, and trajectory prediction for fast-moving dynamic objects with low latency and high precision for unmanned aerial vehicles (UAVs).
A Saccade Based Framework for Real-Time Motion Segmentation Using Event Based Vision Sensors
TLDR
This paper develops a technique for generalized motion segmentation based on spatial statistics across time frames and introduces the concept of spike-groups as a methodology to partition spatio-temporal event groups, which facilitates computation of scene statistics and characterize objects in it.
Event-based tracking of human hands
TLDR
The proposed ROI-finding method reduces noise from intensity images, achieving up to 89% of data reduction in relation to the original, while preserving the features of the region of interest (ROI).
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 18 REFERENCES
Dynamic stereo vision system for real-time tracking
TLDR
This paper contributes with presenting and demonstrating a tracking algorithm using the 3D sensing technology based on the stereo dynamic vision sensor capable of detecting and tracking persons within a 4m range at an effective refresh rate of the depth map of up to 200 per second.
Visual tracking and recognition using appearance-adaptive models in particle filters
TLDR
This work proposes an approach that incorporates appearance-adaptive models in a particle filter to realize robust visual tracking and recognition algorithms and demonstrates the effectiveness and robustness of the tracking algorithm.
Embedded Vision System for Real-Time Object Tracking using an Asynchronous Transient Vision Sensor
  • M. Litzenberger, C. Posch, H. Garn
  • Computer Science
    2006 IEEE 12th Digital Signal Processing Workshop & 4th IEEE Signal Processing Education Workshop
  • 2006
TLDR
An algorithm for object tracking with 1 millisecond timestamp resolution of the AER data stream is presented and the potential of the proposed algorithm for people tracking is shown.
A spatio-temporal clustering method using real-time motion analysis on event-based 3D vision
  • S. Schraml, A. Belbachir
  • Computer Science
    2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops
  • 2010
TLDR
The method makes use of density and distance metrics for clustering asynchronous events generated by scene dynamics (changes in the scene) and has been evaluated on clustering the events of moving persons across the sensor field of view.
Kernel-Based Object Tracking
TLDR
A new approach toward target representation and localization, the central component in visual tracking of nonrigid objects, is proposed, which employs a metric derived from the Bhattacharyya coefficient as similarity measure, and uses the mean shift procedure to perform the optimization.
Good features to track
  • Jianbo Shi, Carlo Tomasi
  • Computer Science
    1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
  • 1994
TLDR
A feature selection criterion that is optimal by construction because it is based on how the tracker works, and a feature monitoring method that can detect occlusions, disocclusions, and features that do not correspond to points in the world are proposed.
Color-based tracking of heads and other mobile objects at video frame rates
TLDR
A simple and very fast method for object tracking based exclusively on color information in digitized video images that demonstrates the efficacy of the technique in the challenging task of tracking people, especially tracking human heads and hands.
JPDAF based HMM for real-time contour tracking
TLDR
A novel HMM framework targeted at contour-based object tracking, using a joint probability data association filter (JPDAF) to compute the HMM's transition probabilities, taking into account the intercorrelated neighboring measurements.
Evaluating Multi-Object Tracking
TLDR
The tracking characteristics important to measure in a real-life application are explored, focusing on configuration and identification, and a set of measures and a protocol to objectively evaluate these characteristics are defined.
Estimation of Object Motion Parameters from Noisy Images
TLDR
An approach is presented for the estimation of object motion parameters based on a sequence of noisy images that may be of use in situations where it is difficult to resolve large numbers of object match points, but relatively long sequences of images are available.
...
1
2
...