Situation Recognition: Visual Semantic Role Labeling for Image Understanding

@article{Yatskar2016SituationRV,
  title={Situation Recognition: Visual Semantic Role Labeling for Image Understanding},
  author={Mark Yatskar and Luke Zettlemoyer and Ali Farhadi},
  journal={2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
  year={2016},
  pages={5534-5542}
}
This paper introduces situation recognition, the problem of producing a concise summary of the situation an image depicts including: (1) the main activity (e.g., clipping), (2) the participating actors, objects, substances, and locations (e.g., man, shears, sheep, wool, and field) and most importantly (3) the roles these participants play in the activity (e.g., the man is clipping, the shears are his tool, the wool is being clipped from the sheep, and the clipping is in a field). We use… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 88 CITATIONS

Graph neural network for situation recognition

  • 2019
VIEW 8 EXCERPTS
CITES BACKGROUND, RESULTS & METHODS
HIGHLY INFLUENCED

Mixture-Kernel Graph Attention Network for Situation Recognition

VIEW 8 EXCERPTS
CITES BACKGROUND, RESULTS & METHODS
HIGHLY INFLUENCED

Predictive Biases in Natural Language Processing Models: A Conceptual Framework and Overview

VIEW 4 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Testing Deep Neural Network based Image Classifiers

VIEW 4 EXCERPTS
CITES BACKGROUND
HIGHLY INFLUENCED

Visual context for verb sense disambiguation and multilingual representation learning

VIEW 12 EXCERPTS
CITES BACKGROUND
HIGHLY INFLUENCED

Grounding Semantic Roles in Images

VIEW 8 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

An Analysis of Action Recognition Datasets for Language and Vision Tasks

VIEW 8 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Natural Language as a Scaffold for Visual Recognition

VIEW 9 EXCERPTS
CITES METHODS & BACKGROUND

FILTER CITATIONS BY YEAR

2016
2020

CITATION STATISTICS

  • 15 Highly Influenced Citations

  • Averaged 27 Citations per year from 2017 through 2019

  • 12% Increase in citations per year in 2019 over 2018

References

Publications referenced by this paper.
SHOWING 1-10 OF 53 REFERENCES

ImageNet Large Scale Visual Recognition Challenge

VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

Background to Framenet

VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

WordNet

  • C. Fellbaum
  • Wiley Online Library
  • 1998
VIEW 5 EXCERPTS
HIGHLY INFLUENTIAL

VQA: Visual Question Answering

VIEW 1 EXCERPT