Gated Multimodal Units for Information Fusion

  title={Gated Multimodal Units for Information Fusion},
  author={John Edison Arevalo Ovalle and Thamar Solorio and Manuel Montes-y-G{\'o}mez and Fabio A. Gonz{\'a}lez},
This paper presents a novel model for multimodal learning based on gated neu-ral networks. The Gated Multimodal Unit (GMU) model is intended to be used as an internal unit in a neural network architecture whose purpose is to find an intermediate representation based on a combination of data from different modalities. The GMU learns to decide how modalities influence the activation of the unit using multiplicative gates. It was evaluated on a multilabel scenario for genre classification of… CONTINUE READING
Highly Cited
This paper has 17 citations. REVIEW CITATIONS
Recent Discussions
This paper has been referenced on Twitter 14 times over the past 90 days. VIEW TWEETS

12 Figures & Tables



Citations per Year

Citation Velocity: 11

Averaging 11 citations per year over the last 2 years.

Learn more about how we calculate this metric in our FAQ.