• DOI:10.1109/DICTA47822.2019.8945863
Corpus ID: 202676837

Deep Latent Space Learning for Cross-Modal Mapping of Audio and Visual Signals

@article{Nawaz2019DeepLS,
  title={Deep Latent Space Learning for Cross-Modal Mapping of Audio and Visual Signals},
  author={Shah Nawaz and Muhammad Kamran Janjua and I. Gallo and A. Mahmood and Alessandro Calefati},
  journal={2019 Digital Image Computing: Techniques and Applications (DICTA)},
  year={2019},
  pages={1-7}
}

Shah Nawaz, Muhammad Kamran Janjua, +2 authors Alessandro Calefati

Published 2019

Computer Science, Engineering

2019 Digital Image Computing: Techniques and Applications (DICTA)

We propose a novel deep training algorithm for joint representation of audio and visual information which consists of a single stream network (SSNet) coupled with a novel loss function to learn a shared deep latent space representation of multimodal information. The proposed framework characterizes the shared latent space by leveraging the class centers which helps to eliminate the need of pairwise or triplet supervision. We quantitatively and qualitatively evaluate the proposed approach on… CONTINUE READING

View on IEEE

arxiv.org

Save to Library

Create Alert

Cite

Launch Research Feed