Efficient Second Order Multi-Target Tracking with Exclusion Constraints


Current state of the art multi-target tracking (MTT) exists in an “either/or” situation. Either a greedy approach can be used, that can make use of second-order information which captures object dynamics, such as “objects tend to move in the same direction over adjacent frames”, or one can use global approaches that make use of the information contained in the entire sequence to resolve ambiguous sub-sequences, but are unable to use such second order information. However, the accurate resolution of ambiguous sequences requires both a good model of object dynamics, and global inference. In this work we present a novel approach to MTT that combines the best of both worlds. By formulating the problem of tracking as one of global MAP estimation over a directed acyclic hyper-graph, we are able to both capture long range interactions, and informative second order priors. In practice, our algorithm is extremely effective, with a run time linear in the number of objects to be tracked, possible locations of an object, and the number of frames. We demonstrate the effectiveness of our approach, both on standard MTT data-sets that contain few objects to be tracked, and on point tracking for non-rigid structure from motion, which, with hundreds of points to be tracked simultaneously, strongly benefits from the efficiency of our approach. The cost function that we optimise in tracking is substantially more informative than those used in existing efficient frameworks. Alongside the more usual cues that objects tend to appear in similar locations in adjacent frames, exclusion constraints, and the previously mentioned velocity cues, it also captures the persistent and temporary appearance of objects. This cost function takes the form:

DOI: 10.5244/C.25.13

Extracted Key Phrases

3 Figures and Tables

Cite this paper

@inproceedings{Russell2011EfficientSO, title={Efficient Second Order Multi-Target Tracking with Exclusion Constraints}, author={Chris Russell and Lourdes Agapito and Francesco Setti}, booktitle={BMVC}, year={2011} }