Multiple person and speaker activity tracking with a particle filter

  title={Multiple person and speaker activity tracking with a particle filter},
  author={Neal Checka and Kevin W. Wilson and Michael Siracusa and Trevor Darrell},
  journal={2004 IEEE International Conference on Acoustics, Speech, and Signal Processing},
In this paper, we present a system that combines sound and vision to track multiple people. In a cluttered or noisy scene, multi-person tracking estimates have a distinctly non-Gaussian distribution. We apply a particle filter with audio and video state components, and derive observation likelihood methods based on both audio and video measurements. Our state includes the number of people present, their positions, and whether each person is talking. We show experiments in an environment with… CONTINUE READING

3 Figures & Tables



Citations per Year

97 Citations

Semantic Scholar estimates that this publication has 97 citations based on the available data.

See our FAQ for additional information.