"What Happens If..." Learning to Predict the Effect of Forces in Images
@article{Mottaghi2016WhatHI, title={"What Happens If..." Learning to Predict the Effect of Forces in Images}, author={R. Mottaghi and M. Rastegari and A. Gupta and Ali Farhadi}, journal={ArXiv}, year={2016}, volume={abs/1603.05600} }
What happens if one pushes a cup sitting on a table toward the edge of the table? How about pushing a desk against a wall? In this paper, we study the problem of understanding the movements of objects as a result of applying external forces to them. For a given force vector applied to a specific location in an image, our goal is to predict long-term sequential movements caused by that force. Doing so entails reasoning about scene geometry, objects, their attributes, and the physical rules that… CONTINUE READING
Figures, Tables, and Topics from this paper
83 Citations
Use the Force, Luke! Learning to Predict Physical Forces by Simulating Effects
- Computer Science
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- 2020
- 2
- PDF
IntPhys: A Framework and Benchmark for Visual Intuitive Physics Reasoning
- Computer Science
- ArXiv
- 2018
- 22
- PDF
Unsupervised Learning for Physical Interaction through Video Prediction
- Computer Science, Mathematics
- NIPS
- 2016
- 626
- PDF
References
SHOWING 1-10 OF 49 REFERENCES
Newtonian Image Understanding: Unfolding the Dynamics of Objects in Static Images
- Computer Science
- 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- 2016
- 112
- PDF
Galileo: Perceiving Physical Object Properties by Integrating a Physics Engine with Deep Learning
- Computer Science
- NIPS
- 2015
- 225
- PDF
Dense Optical Flow Prediction from a Static Image
- Computer Science
- 2015 IEEE International Conference on Computer Vision (ICCV)
- 2015
- 150
- PDF
Show and tell: A neural image caption generator
- Computer Science
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- 2015
- 3,635
- PDF
Predicting Object Dynamics in Scenes
- Computer Science
- 2014 IEEE Conference on Computer Vision and Pattern Recognition
- 2014
- 78
- PDF
Action-Conditional Video Prediction using Deep Networks in Atari Games
- Computer Science, Mathematics
- NIPS
- 2015
- 577
- PDF