• DOI:10.21437/Interspeech.2018-1688
• Corpus ID: 52191474

Deeply Fused Speaker Embeddings for Text-Independent Speaker Verification

@inproceedings{Bhattacharya2018DeeplyFS,
  title={Deeply Fused Speaker Embeddings for Text-Independent Speaker Verification},
  author={Gautam Bhattacharya and Md. Jahangir Alam and Vishwa Gupta and Patrick Kenny},
  booktitle={INTERSPEECH},
  year={2018}
}

• Gautam Bhattacharya, Md. Jahangir Alam, +1 author P. Kenny
• Published in INTERSPEECH 2 September 2018
• Computer Science

Recently there has been a surge of interest is learning speaker embeddings using deep neural networks. These models ingest time-frequency representations of speech and can be trained to discriminate between a known set speakers. While embeddings learned in this way perform well, they typically require a large number of training data points for learning. In this work we propose deeply fused speaker embeddings speaker representations that combine neural speaker embeddings with i-vectors. We show that by combining the two speaker representations we are able to learn robust speaker embeddings in a computationally efficient manner. We compare several different fusion strategies and find that the resulting speaker embeddings show significantly different verification performance. To this end we propose a novel fusion approach that uses an attention model to combine i-vectors with neural speaker embeddings. Our best performing embedding achieves an error rate of 3.17% using a simple cosine distance classifier. Combining our embeddings with a powerful Joint Bayesian classifier, we are able to further improve the performance of our speaker embeddings to 2.22%, which gave a 7.8% relative improvement over the baseline i-vector system.