Actor and Observer: Joint Modeling of First and Third-Person Videos

@article{Alahari2018ActorAO,
  title={Actor and Observer: Joint Modeling of First and Third-Person Videos},
  author={Karteek Alahari},
  journal={2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year={2018},
  pages={7396-7404}
}
Several theories in cognitive neuroscience suggest that when people interact with the world, or simulate interactions, they do so from a first-person egocentric perspective, and seamlessly transfer knowledge between third-person (observer) and first-person (actor). Despite this, learning such models for human action recognition has not been well studied. We address this challenge by introducing Charades-Ego, a large-scale dataset of paired first-person and third-person videos, and presenting a… CONTINUE READING
7
Twitter Mentions

Citations

Publications citing this paper.
SHOWING 1-10 OF 12 CITATIONS

Temporal Reasoning Graph for Activity Recognition

  • ArXiv
  • 2019
VIEW 11 EXCERPTS
HIGHLY INFLUENCED

EPIC-Fusion: Audio-Visual Temporal Binding for Egocentric Action Recognition

Evangelos Kazakos, Arsha Nagrani, Andrew Zisserman, Dima Damen
  • ArXiv
  • 2019
VIEW 1 EXCERPT
CITES BACKGROUND

References

Publications referenced by this paper.
SHOWING 1-6 OF 6 REFERENCES

Identifying First-Person Camera Wearers in Third-Person Videos

  • 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2017
VIEW 5 EXCERPTS
HIGHLY INFLUENTIAL

Learning Image Representations Tied to Ego-Motion

  • 2015 IEEE International Conference on Computer Vision (ICCV)
  • 2015
VIEW 6 EXCERPTS
HIGHLY INFLUENTIAL

Detecting activities of daily living in first-person camera views

  • 2012 IEEE Conference on Computer Vision and Pattern Recognition
  • 2012
VIEW 5 EXCERPTS
HIGHLY INFLUENTIAL

Discovering important people and objects for egocentric video summarization

  • 2012 IEEE Conference on Computer Vision and Pattern Recognition
  • 2012
VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL