Situation Recognition: Visual Semantic Role Labeling for Image Understanding

@article{Yatskar2016SituationRV,
  title={Situation Recognition: Visual Semantic Role Labeling for Image Understanding},
  author={Mark Yatskar and Luke S. Zettlemoyer and Ali Farhadi},
  journal={2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
  year={2016},
  pages={5534-5542}
}
This paper introduces situation recognition, the problem of producing a concise summary of the situation an image depicts including: (1) the main activity (e.g., clipping), (2) the participating actors, objects, substances, and locations (e.g., man, shears, sheep, wool, and field) and most importantly (3) the roles these participants play in the activity (e.g., the man is clipping, the shears are his tool, the wool is being clipped from the sheep, and the clipping is in a field). We use… CONTINUE READING
Highly Cited
This paper has 79 citations. REVIEW CITATIONS

From This Paper

Figures, tables, and topics from this paper.

Citations

Publications citing this paper.
Showing 1-10 of 54 extracted citations

Grounding Semantic Roles in Images

View 8 Excerpts
Highly Influenced

Situation Recognition with Graph Neural Networks

2017 IEEE International Conference on Computer Vision (ICCV) • 2017
View 10 Excerpts
Highly Influenced

A Domain Based Approach to Social Relation Recognition

2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) • 2017
View 4 Excerpts
Highly Influenced

Subjects and Their Objects: Localizing Interactees for a Person-Centric View of Importance

International Journal of Computer Vision • 2016
View 4 Excerpts
Highly Influenced

80 Citations

020402016201720182019
Citations per Year
Semantic Scholar estimates that this publication has 80 citations based on the available data.

See our FAQ for additional information.

References

Publications referenced by this paper.
Showing 1-10 of 53 references

Background to framenet

C. J. Fillmore
International Journal of lexicography, • 2003
View 4 Excerpts
Highly Influenced

WordNet

C. Fellbaum
Wiley Online Library • 1998
View 4 Excerpts
Highly Influenced

CIDEr: Consensus-based image description evaluation

2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) • 2015
View 1 Excerpt

Deep Visual-Semantic Alignments for Generating Image Descriptions

IEEE Transactions on Pattern Analysis and Machine Intelligence • 2015
View 1 Excerpt

From captions to visual concepts and back

2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) • 2015
View 1 Excerpt

ImageNet Large Scale Visual Recognition Challenge

International Journal of Computer Vision • 2015
View 2 Excerpts

Similar Papers

Loading similar papers…