Visual localization of non-stationary sound sources

  title={Visual localization of non-stationary sound sources},
  author={Yuyu Liu and Yoichi Sato},
  booktitle={ACM Multimedia},
Sound source can be visually localized by analyzing the correlation between audio and visual data. To correctly analyze this correlation, the sound source is required to be stationary in a scene to date. We introduce a technique that localizes the non-stationary sound sources to overcome this limitation. The problem is formulated as finding the optimal visual trajectories that best represent the movement of the sound source over the pixels in a spatio-temporal volume. Using a beam search, we… CONTINUE READING