Bidirectional Attention Flow for Machine Comprehension

Abstract

Machine comprehension (MC), answering a query about a given context paragraph, requires modeling complex interactions between the context and the query. Recently, attention mechanisms have been successfully extended to MC. Typically these methods use attention to focus on a small portion of the context and summarize it with a fixed-size vector, couple attentions temporally, and/or often form a uni-directional attention. In this paper we introduce the Bi-Directional Attention Flow (BIDAF) network, a multi-stage hierarchical process that represents the context at different levels of granularity and uses bidirectional attention flow mechanism to obtain a query-aware context representation without early summarization. Our experimental evaluations show that our model achieves the state-of-the-art results in Stanford Question Answering Dataset (SQuAD) and CNN/DailyMail cloze test.

8 Figures and Tables

05010015020162017
Citations per Year

143 Citations

Semantic Scholar estimates that this publication has 143 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@article{Seo2016BidirectionalAF, title={Bidirectional Attention Flow for Machine Comprehension}, author={Min Joon Seo and Aniruddha Kembhavi and Ali Farhadi and Hannaneh Hajishirzi}, journal={CoRR}, year={2016}, volume={abs/1611.01603} }