A Diagram is Worth a Dozen Images

@inproceedings{Kembhavi2016ADI,
  title={A Diagram is Worth a Dozen Images},
  author={Aniruddha Kembhavi and Michael Salvato and Eric Kolve and Minjoon Seo and Hannaneh Hajishirzi and Ali Farhadi},
  booktitle={ECCV},
  year={2016}
}
Diagrams are common tools for representing complex concepts, relationships and events, often when it would be difficult to portray the same information with natural images. Understanding natural images has been extensively studied in computer vision, while diagram understanding has received little attention. In this paper, we study the problem of diagram interpretation, the challenging task of identifying the structure of a diagram and the semantics of its constituents and their relationships… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 43 CITATIONS

AI2D-RST: A multimodal corpus of 1000 primary school science diagrams

VIEW 5 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

It's Not About the Journey; It's About the Destination: Following Soft Paths Under Question-Guidance for Visual Reasoning

VIEW 13 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Arrows are the Verbs of Diagrams

VIEW 9 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Enhancing the AI2 Diagrams Dataset Using Rhetorical Structure Theory

VIEW 7 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Dynamic Graph Generation Network: Generating Relational Knowledge from Diagrams

VIEW 16 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Introducing the diagrammatic mode

VIEW 3 EXCERPTS
CITES METHODS
HIGHLY INFLUENCED

References

Publications referenced by this paper.
SHOWING 1-10 OF 46 REFERENCES

End-to-end memory networks

  • S. Sukhbaatar, J. Weston, R Fergus
  • Advances in Neural Information Processing Systems.
  • 2015
VIEW 2 EXCERPTS

Image Question Answering Using Convolutional Neural Network with Dynamic Parameter Prediction

VIEW 1 EXCERPT

Keras

  • F. Chollet
  • https://github.com/fchollet/keras
  • 2015
VIEW 1 EXCERPT

Learning Common Sense through Visual Abstraction

VIEW 1 EXCERPT