Investigating the use of visual focus of attention for audio-visual speaker diarisation

@inproceedings{Garau2009InvestigatingTU,
  title={Investigating the use of visual focus of attention for audio-visual speaker diarisation},
  author={Giulia Garau and Sileye O. Ba and Herv{\'e} Bourlard and Jean-Marc Odobez},
  booktitle={ACM Multimedia},
  year={2009}
}
Audio-visual speaker diarisation is the task of estimating ``who spoke when'' using audio and visual cues. In this paper we propose the combination of an audio diarisation system with psychology inspired visual features, reporting experiments on multiparty meetings, a challenging domain characterised by unconstrained interaction and participant movements. More precisely the role of gaze in coordinating speaker turns was exploited by the use of Visual Focus of Attention features. Experiments… CONTINUE READING