Cross-Modal Supervision for Learning Active Speaker Detection in Video

Abstract

In this paper, we show how to use audio to supervise the learning of active speaker detection in video. Voice Activity Detection (VAD) guides the learning of the vision-based classifier in a weakly supervised manner. The classifier uses spatio-temporal features to encode upper body motion facial expressions and gesticulations associated with speaking. We… (More)
DOI: 10.1007/978-3-319-46454-1_18

Topics

6 Figures and Tables

Statistics

0204020162017
Citations per Year

Citation Velocity: 6

Averaging 6 citations per year over the last 2 years.

Learn more about how we calculate this metric in our FAQ.

Slides referencing similar topics