• Computer Science, Engineering
• Published in
  Digital Image Computing…
  2019
• DOI:10.1109/DICTA47822.2019.8945863

Deep Latent Space Learning for Cross-Modal Mapping of Audio and Visual Signals

@article{Nawaz2019DeepLS,
  title={Deep Latent Space Learning for Cross-Modal Mapping of Audio and Visual Signals},
  author={Shah Nawaz and Muhammad Kamran Janjua and Ignazio Gallo and Arif Mahmood and Alessandro Calefati},
  journal={2019 Digital Image Computing: Techniques and Applications (DICTA)},
  year={2019},
  pages={1-7}
}

• Shah Nawaz, Muhammad Kamran Janjua, +2 authors Alessandro Calefati

We propose a novel deep training algorithm for joint representation of audio and visual information which consists of a single stream network (SSNet) coupled with a novel loss function to learn a shared deep latent space representation of multimodal information. The proposed framework characterizes the shared latent space by leveraging the class centers which helps to eliminate the need of pairwise or triplet supervision. We quantitatively and qualitatively evaluate the proposed approach on… CONTINUE READING

View on IEEE

Save to Library

Create Alert

Cite