Use the Force, Luke! Learning to Predict Physical Forces by Simulating Effects
@article{Ehsani2020UseTF, title={Use the Force, Luke! Learning to Predict Physical Forces by Simulating Effects}, author={Kiana Ehsani and Shubham Tulsiani and Saurabh Gupta and A. Farhadi and Abhinav Gupta}, journal={2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)}, year={2020}, pages={221-230} }
When we humans look at a video of human-object interaction, we can not only infer what is happening but we can even extract actionable information and imitate those interactions. On the other hand, current recognition or geometric approaches lack the physicality of action representation. In this paper, we take a step towards more physical understanding of actions. We address the problem of inferring contact points and the physical forces from videos of humans interacting with objects. One of… Expand
Figures, Tables, and Topics from this paper
6 Citations
Residual Force Control for Agile Human Behavior Imitation and Extended Motion Synthesis
- Computer Science, Mathematics
- NeurIPS
- 2020
- 5
- PDF
gradSim: Differentiable simulation for system identification and visuomotor control
- Computer Science
- ArXiv
- 2021
- Highly Influenced
- PDF
References
SHOWING 1-10 OF 35 REFERENCES
Inferring Interaction Force from Visual Information without Using Physical Force Sensors
- Engineering, Computer Science
- Sensors
- 2017
- 23
- PDF
"What Happens If..." Learning to Predict the Effect of Forces in Images
- Computer Science
- ECCV
- 2016
- 92
- PDF
Galileo: Perceiving Physical Object Properties by Integrating a Physics Engine with Deep Learning
- Computer Science
- NIPS
- 2015
- 234
- PDF
Newtonian Image Understanding: Unfolding the Dynamics of Objects in Static Images
- Computer Science
- 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- 2016
- 115
- PDF
Towards force sensing from vision: Observing hand-object interactions to infer manipulation forces
- Computer Science
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- 2015
- 63
- PDF
Hand-Object Contact Force Estimation from Markerless Visual Tracking
- Medicine, Computer Science
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- 2018
- 31
- PDF
Estimating 3D Motion and Forces of Person-Object Interactions From Monocular Video
- Computer Science
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- 2019
- 16
- PDF
Learning a Generative Model for Multi‐Step Human‐Object Interactions from Videos
- Computer Science
- Comput. Graph. Forum
- 2019
- 8
- PDF
Detecting and Recognizing Human-Object Interactions
- Computer Science
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- 2018
- 231
- PDF