• Mathematics, Computer Science
  • Published in NeurIPS 2018

Mapping Images to Scene Graphs with Permutation-Invariant Structured Prediction

@inproceedings{Herzig2018MappingIT,
  title={Mapping Images to Scene Graphs with Permutation-Invariant Structured Prediction},
  author={Roei Herzig and Moshiko Raboh and Gal Chechik and Jonathan Berant and Amir Globerson},
  booktitle={NeurIPS},
  year={2018}
}
Highlight Information
Structured prediction is concerned with predicting multiple inter-dependent labels simultaneously. [...] Key Method We take an axiomatic perspective to derive the desired properties and invariances of a such network to certain input permutations, presenting a structural characterization that is provably both necessary and sufficient. We then discuss graph-permutation invariant (GPI) architectures that satisfy this characterization and explain how they can be used for deep structured prediction. We evaluate our…Expand Abstract

Citations

Publications citing this paper.
SHOWING 1-10 OF 31 CITATIONS

Attentive Relational Networks for Mapping Images to Scene Graphs

VIEW 10 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

On the Limitations of Representing Functions on Sets

VIEW 4 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Differentiable Scene Graphs

VIEW 5 EXCERPTS
CITES BACKGROUND & METHODS

Visual Semantic Information Pursuit: A Survey

VIEW 4 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

An End-To-End Network for Generating Social Relationship Graphs

VIEW 1 EXCERPT

Finding Images by Dialoguing with Image

VIEW 1 EXCERPT
CITES METHODS

References

Publications referenced by this paper.
SHOWING 1-10 OF 30 REFERENCES

Scene Graph Generation by Iterative Message Passing

VIEW 12 EXCERPTS
HIGHLY INFLUENTIAL

End-to-end learning for structured prediction energy networks

  • Belanger, David, +3 authors Andrew
  • Proceedings of the 34th International Conference on Machine Learning,
  • 2017
VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations

VIEW 3 EXCERPTS
HIGHLY INFLUENTIAL

Learning Deep Structured Models

VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

Image Generation from Scene Graphs

VIEW 1 EXCERPT

Deep Sets