Procedural Reasoning Networks for Understanding Multimodal Procedures

  title={Procedural Reasoning Networks for Understanding Multimodal Procedures},
  author={Mustafa Sercan Amac and Semih Yagcioglu and Aykut Erdem and Erkut Erdem},
This paper addresses the problem of comprehending procedural commonsense knowledge. This is a challenging task as it requires identifying key entities, keeping track of their state changes, and understanding temporal and causal relations. Contrary to most of the previous work, in this study, we do not rely on strong inductive bias and explore the question of how multimodality can be exploited to provide a complementary semantic signal. Towards this end, we introduce a new entity-aware neural… CONTINUE READING

Figures, Tables, and Topics from this paper.