Corpus ID: 221749191

Is Multihop QA in DiRe Condition? Measuring and Reducing Disconnected Reasoning

@inproceedings{Trivedi2020IsMQ,
  title={Is Multihop QA in DiRe Condition? Measuring and Reducing Disconnected Reasoning},
  author={H. Trivedi and Niranjan Balasubramanian and Tushar Khot and A. Sabharwal},
  year={2020}
}
  • H. Trivedi, Niranjan Balasubramanian, +1 author A. Sabharwal
  • Published 2020
  • Computer Science
  • Has there been real progress in multi-hop question-answering? Models often exploit dataset artifacts to produce correct answers, without connecting information across multiple supporting facts. This limits our ability to measure true progress and defeats the purpose of building multihop QA datasets. We make three contributions towards addressing this. First, we formalize such undesirable behavior as disconnected reasoning across subsets of supporting facts. This allows developing a model… CONTINUE READING