Joint Discovery of Object States and Manipulation Actions

@article{Alayrac2017JointDO,
  title={Joint Discovery of Object States and Manipulation Actions},
  author={Jean-Baptiste Alayrac and Josef Sivic and I. Laptev and S. Lacoste-Julien},
  journal={2017 IEEE International Conference on Computer Vision (ICCV)},
  year={2017},
  pages={2146-2155}
}
  • Jean-Baptiste Alayrac, Josef Sivic, +1 author S. Lacoste-Julien
  • Published 2017
  • Computer Science
  • 2017 IEEE International Conference on Computer Vision (ICCV)
  • Many human activities involve object manipulations aiming to modify the object state. Examples of common state changes include full/empty bottle, open/closed door, and attached/detached car wheel. In this work, we seek to automatically discover the states of objects and the associated manipulation actions. Given a set of videos for a particular task, we propose a joint model that learns to identify object states and to localize state-modifying actions. Our model is formulated as a… CONTINUE READING
    42 Citations

    Figures, Tables, and Topics from this paper

    Explore Further: Topics Discussed in This Paper

    Recognizing Manipulation Actions from State-Transformations
    • 2
    • PDF
    Explainable Video Action Reasoning via Prior Knowledge and State Transitions
    • 5
    • PDF
    Learning Actionness via Long-Range Temporal Order Verification
    • 1
    • PDF
    Combining Common Sense Rules and Machine Learning to Understand Object Manipulation
    • PDF
    Identifying Object States in Cooking-Related Images
    • 22
    • PDF
    Joint Object and State Recognition Using Language Knowledge
    • 3
    • PDF
    Intra- and Inter-Action Understanding via Temporal Action Parsing
    • 7
    • Highly Influenced
    • PDF
    Jointly Recognizing Object Fluents and Tasks in Egocentric Videos
    • Y. Liu, P. Wei, S. Zhu
    • Computer Science
    • 2017 IEEE International Conference on Computer Vision (ICCV)
    • 2017
    • 9
    • PDF
    Activity Driven Weakly Supervised Object Detection
    • 15
    • PDF

    References

    SHOWING 1-10 OF 52 REFERENCES
    Modeling Actions through State Changes
    • A. Fathi, James M. Rehg
    • Computer Science
    • 2013 IEEE Conference on Computer Vision and Pattern Recognition
    • 2013
    • 111
    • PDF
    Human action recognition by learning bases of action attributes and parts
    • 496
    • PDF
    Visual object-action recognition: Inferring object affordances from human demonstration
    • 207
    • PDF
    Learning person-object interactions for action recognition in still images
    • 139
    • PDF
    Actions ~ Transformations
    • X. Wang, Ali Farhadi, A. Gupta
    • Computer Science, Mathematics
    • 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
    • 2016
    • 175
    • PDF
    Finding Actors and Actions in Movies
    • 116
    • PDF
    Observing Human-Object Interactions: Using Spatial and Functional Compatibility for Recognition
    • 460
    • PDF
    Learning realistic human actions from movies
    • 3,423
    • PDF
    Connectionist Temporal Modeling for Weakly Supervised Action Labeling
    • 137
    • PDF