Cross-Modal Supervision for Learning Active Speaker Detection in Video


In this paper, we show how to use audio to supervise the learning of active speaker detection in video. Voice Activity Detection (VAD) guides the learning of the vision-based classifier in a weakly supervised manner. The classifier uses spatio-temporal features to encode upper body motion facial expressions and gesticulations associated with speaking. We… (More)
DOI: 10.1007/978-3-319-46454-1_18


6 Figures and Tables


Citations per Year

Citation Velocity: 6

Averaging 6 citations per year over the last 2 years.

Learn more about how we calculate this metric in our FAQ.

Slides referencing similar topics