Latent Dirichlet Decomposition for Single Channel Speaker Separation

Abstract

We present an algorithm for the separation of multiple speakers from mixed single-channel recordings by latent variable decomposition of the speech spectrogram. We model each magnitude spectral vector in the short-time Fourier transform of a speech signal as the outcome of a discrete random process that generates frequency bin indices. The distribution of the process is modeled as a mixture of multinomial distributions, such that the mixture weights of the component multinomials vary from analysis window to analysis window. The component multinomials are assumed to be speaker specific and are learned from training signals for each speaker. We model the prior distribution of the mixture weights for each speaker as a Dirichlet distribution. The distributions representing magnitude spectral vectors for the mixed signal are decomposed into mixtures of the multinomials for all component speakers. The frequency distribution, i.e the spectrum for each speaker, is reconstructed from this decomposition

DOI: 10.1109/ICASSP.2006.1661402

Extracted Key Phrases

4 Figures and Tables

Showing 1-8 of 8 references

A comparison of auditory and blind separation techniques for speech segregation

  • J W Van Der Kouwe, D Wang, G J Brown
  • 2001
1 Excerpt
Showing 1-10 of 18 extracted citations