Latent variable decomposition of spectrograms for single channel speaker separation


In this paper we present an algorithm for the separation of multiple speakers from mixed single-channel recordings by latent variable decomposition of the speech spectrogram. We model each magnitude spectral vector in the short-time Fourier transform of a speech signal as the outcome of a discrete random process that generates frequency bin indices. The distribution of the process is modelled a mixture of multinomial distributions, such that the mixture weights of the component multinomials vary from analysis window to analysis window. The component multinomials are assumed to be speaker specific and are learnt from training signals for each speaker. The distributions representing magnitude spectral vectors for the mixed signal are decomposed into mixtures of the multinomials for all component speakers. The frequency distribution, i.e. the spectrum for each speaker is reconstructed from this decomposition. Experimental results show that the proposed method is very effective at separating mixed signals.

Extracted Key Phrases

5 Figures and Tables


Citations per Year

66 Citations

Semantic Scholar estimates that this publication has 66 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@article{Raj2005LatentVD, title={Latent variable decomposition of spectrograms for single channel speaker separation}, author={B. Raj and P. Smaragdis}, journal={IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2005.}, year={2005}, pages={17-20} }