Corpus ID: 225039938

AttendAffectNet: Self-Attention based Networks for Predicting Affective Responses from Movies

@article{Thao2020AttendAffectNetSB,
  title={AttendAffectNet: Self-Attention based Networks for Predicting Affective Responses from Movies},
  author={Ha Thi Phuong Thao and Balamurali B.T. and Dorien Herremans and Gemma Roig},
  journal={ArXiv},
  year={2020},
  volume={abs/2010.11188}
}

Ha Thi Phuong Thao, Balamurali B.T., +1 author Gemma Roig

Published 2020

Computer Science, Engineering

ArXiv

In this work, we propose different variants of the self-attention based network for emotion prediction from movies, which we call AttendAffectNet. We take both audio and video into account and incorporate the relation among multiple modalities by applying self-attention mechanism in a novel manner into the extracted features for emotion prediction. We compare it to the typically temporal integration of the self-attention based model, which in our case, allows to capture the relation of temporal… CONTINUE READING

View PDF on arXiv

Save to Library

Create Alert

Cite

Launch Research Feed