Situation Recognition: Visual Semantic Role Labeling for Image Understanding

@article{Yatskar2016SituationRV,
  title={Situation Recognition: Visual Semantic Role Labeling for Image Understanding},
  author={Mark Yatskar and Luke S. Zettlemoyer and Ali Farhadi},
  journal={2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
  year={2016},
  pages={5534-5542}
}
This paper introduces situation recognition, the problem of producing a concise summary of the situation an image depicts including: (1) the main activity (e.g., clipping), (2) the participating actors, objects, substances, and locations (e.g., man, shears, sheep, wool, and field) and most importantly (3) the roles these participants play in the activity (e.g., the man is clipping, the shears are his tool, the wool is being clipped from the sheep, and the clipping is in a field). We use… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 75 CITATIONS

Grounding Semantic Roles in Images

VIEW 8 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

An Analysis of Action Recognition Datasets for Language and Vision Tasks

VIEW 8 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Natural Language as a Scaffold for Visual Recognition

VIEW 9 EXCERPTS
CITES METHODS & BACKGROUND

Recurrent Models for Situation Recognition

  • 2017 IEEE International Conference on Computer Vision (ICCV)
  • 2017
VIEW 19 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Situation Recognition with Graph Neural Networks

  • 2017 IEEE International Conference on Computer Vision (ICCV)
  • 2017
VIEW 10 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Commonly Uncommon: Semantic Sparsity in Situation Recognition

  • 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2016
VIEW 10 EXCERPTS
CITES BACKGROUND, METHODS & RESULTS

FILTER CITATIONS BY YEAR

2016
2019

CITATION STATISTICS

  • 10 Highly Influenced Citations

  • Averaged 22 Citations per year from 2017 through 2019

References

Publications referenced by this paper.