Joint Discovery of Object States and Manipulation Actions
@article{Alayrac2017JointDO, title={Joint Discovery of Object States and Manipulation Actions}, author={Jean-Baptiste Alayrac and Josef Sivic and I. Laptev and S. Lacoste-Julien}, journal={2017 IEEE International Conference on Computer Vision (ICCV)}, year={2017}, pages={2146-2155} }
Many human activities involve object manipulations aiming to modify the object state. Examples of common state changes include full/empty bottle, open/closed door, and attached/detached car wheel. In this work, we seek to automatically discover the states of objects and the associated manipulation actions. Given a set of videos for a particular task, we propose a joint model that learns to identify object states and to localize state-modifying actions. Our model is formulated as a… CONTINUE READING
Figures, Tables, and Topics from this paper
42 Citations
Recognizing Manipulation Actions from State-Transformations (Technical Report)
- Computer Science
- 2019
- PDF
Explainable Video Action Reasoning via Prior Knowledge and State Transitions
- Computer Science
- ACM Multimedia
- 2019
- 5
- PDF
Combining Common Sense Rules and Machine Learning to Understand Object Manipulation
- Computer Science
- Acta Cybern.
- 2019
- PDF
Joint Object and State Recognition Using Language Knowledge
- Computer Science
- 2019 IEEE International Conference on Image Processing (ICIP)
- 2019
- 3
- PDF
Intra- and Inter-Action Understanding via Temporal Action Parsing
- Computer Science
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- 2020
- 7
- Highly Influenced
- PDF
Jointly Recognizing Object Fluents and Tasks in Egocentric Videos
- Computer Science
- 2017 IEEE International Conference on Computer Vision (ICCV)
- 2017
- 9
- PDF
Activity Driven Weakly Supervised Object Detection
- Computer Science
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- 2019
- 15
- PDF
References
SHOWING 1-10 OF 52 REFERENCES
Modeling Actions through State Changes
- Computer Science
- 2013 IEEE Conference on Computer Vision and Pattern Recognition
- 2013
- 111
- PDF
Human action recognition by learning bases of action attributes and parts
- Computer Science
- 2011 International Conference on Computer Vision
- 2011
- 496
- PDF
Visual object-action recognition: Inferring object affordances from human demonstration
- Mathematics, Computer Science
- Comput. Vis. Image Underst.
- 2011
- 207
- PDF
Learning person-object interactions for action recognition in still images
- Computer Science
- NIPS
- 2011
- 139
- PDF
Actions ~ Transformations
- Computer Science, Mathematics
- 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- 2016
- 175
- PDF
Finding Actors and Actions in Movies
- Computer Science
- 2013 IEEE International Conference on Computer Vision
- 2013
- 116
- PDF
You-Do, I-Learn: Discovering Task Relevant Objects and their Modes of Interaction from Multi-User Egocentric Video
- Computer Science
- BMVC
- 2014
- 81
- PDF
Observing Human-Object Interactions: Using Spatial and Functional Compatibility for Recognition
- Computer Science, Medicine
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- 2009
- 460
- PDF
Learning realistic human actions from movies
- Computer Science
- 2008 IEEE Conference on Computer Vision and Pattern Recognition
- 2008
- 3,423
- PDF