Simulation as an engine of physical scene understanding

@article{Battaglia2013SimulationAA,
  title={Simulation as an engine of physical scene understanding},
  author={Peter W. Battaglia and Jessica B. Hamrick and Joshua B. Tenenbaum},
  journal={Proceedings of the National Academy of Sciences},
  year={2013},
  volume={110},
  pages={18327 - 18332}
}
In a glance, we can perceive whether a stack of dishes will topple, a branch will support a child’s weight, a grocery bag is poorly packed and liable to tear or crush its contents, or a tool is firmly attached to a table or free to be lifted. Such rapid physical inferences are central to how people interact with the world and with each other, yet their computational underpinnings are poorly understood. We propose a model based on an “intuitive physics engine,” a cognitive mechanism similar to… Expand
Inferring mass in complex scenes by mental simulation
TLDR
A cognitive model that combines Bayesian inference with approximate knowledge of Newtonian physics by estimating probabilities from noisy physical simulations is proposed and it is found that this model accurately predicts judgments from the authors' experiments, suggesting that the same simulation mechanism underlies both peoples' predictions and inferences about the physical world around them. Expand
Visual perception of surprising materials in dynamic scenes
TLDR
It is suggested that visual priors about materials can set up high-level expectations about complex future states of an object and show how these priors modulate material appearance. Expand
A Role for Visual Areas in Physics Simulations
TLDR
Using functional magnetic resonance imaging, it is demonstrated that when participants predict how a ball will fall through an obstacle-filled display, motion-sensitive brain regions are activated and suggested that the process of simulating the ball’s movement is accompanied by a sensory representation of this movement. Expand
Physical reasoning in complex scenes is sensitive to mass
TLDR
It is concluded that rich internal physics models are likely to play a key role in guiding human common-sense reasoning in prediction- based tasks and emphasize the need for further investigation in inference-based tasks. Expand
Principles Underlying Human Physical Prediction
Our days are filled with instances of reasoning about the physics of the world, from simple tasks such as stacking dishes in a way that keeps them stable, to life-and-death decisions such as notExpand
Neurocomputational Modeling of Human Physical Scene Understanding
TLDR
This model makes inferences over the inputs to a generative model of physics and graphics, using an LSTM based recognition network to efficiently approximate rational probabilistic conditioning and finds that its inferences evolve with more information in a way similar to human judgments. Expand
Physical object representations for perception and cognition
Theories of perception typically assume that the goal of sensory processing is to output simple categorical labels or low-dimensional quantities, such as the identities and locations of objects in aExpand
When it all falls down: the relationship between intuitive physics and spatial cognition
TLDR
A positive relationship between intuitive physics and spatial skills is found, but there were substantial, reliable individual differences in physical prediction ability that could not be accounted for by spatial measures or working memory. Expand
Draping an Elephant: Uncovering Children's Reasoning About Cloth-Covered Objects
TLDR
It is argued that a better understanding of the development of the concept of cloth as a physical entity is worthwhile in and of itself, as it may form a basic ontological category in intuitive physical reasoning akin to liquids and solids. Expand
Perception of soft materials relies on physics-based object representations: Behavioral and computational evidence
TLDR
It is hypothesized that the perception of cloths and their physical properties must involve not only image statistics, but also abstract object representations that incorporate ”intuitive physics”, and behavioral and computational evidence is provided for this hypothesis. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 43 REFERENCES
Reconciling intuitive physics and Newtonian mechanics for colliding objects.
TLDR
A range of effects in mass judgments that have been taken as strong evidence for heuristic use are investigated and show that they are well explained by the interplay between Newtonian constraints and sensory uncertainty. Expand
Perception and prediction of simple object interactions
TLDR
Computer simulations of a virtual ball bouncing on a horizontal plane are used to study the correspondence between ability to estimate the ball's elasticity and to predict its future path, suggesting that different strategies and information sources are used for passive perception versus actively predicting future behavior. Expand
Mechanical reasoning by mental simulation
  • M. Hegarty
  • Medicine, Psychology
  • Trends in Cognitive Sciences
  • 2004
TLDR
Although it is frequently accompanied by imagery, mental simulation is not a process of inspecting a holistic visual image in the 'mind's eye'. Expand
Sources of uncertainty in intuitive physics
TLDR
It is found that human judgments cannot be captured by simple heuristics and must incorporate noisy dynamics, suggesting that people use simple expectations about outcomes to compensate for uncertainty about their physical models. Expand
Understanding collision dynamics.
  • D. Gilden, D. Proffitt
  • Computer Science, Medicine
  • Journal of experimental psychology. Human perception and performance
  • 1989
TLDR
In two experiments, people's ability to judge the relative mass of two objects involved in a collision was investigated and it was found that judgments of relative mass were made on the basis of two heuristics. Expand
Scene perception: Detecting and judging objects undergoing relational violations
TLDR
Results provide converging evidence that semantic relations can be accessed from the results of a single fixation and were available sufficiently early during the time course of scene perception to affect the perception of the objects in the scene. Expand
Consistent physics underlying ballistic motion prediction
TLDR
It is argued that people can apply correct physical principles consistently to simulate the world forward, and that the tasks that require implicit prediction (catching the ball and cutting the string) can be explained by veridical physical principles. Expand
Mental Models : Towards a Cognitive Science of Language
Mental Models offers nothing less than a unified theory of the major properties of mind: comprehension, inference, and consciousness. In spirited and graceful prose, Johnson-Laird argues that weExpand
The Acquisition of Physical Knowledge in Infancy: A Summary in Eight Lessons
As adults we possess a great deal of knowledge about the physical world. For example, we realize that an object continues to exist when placed behind a nearer object, that a wide object can beExpand
Visuo-motor coordination and internal models for object interception
TLDR
It is shown that visual cues alone are insufficient to predict the time and place of interception or avoidance, and they need to be supplemented by prior knowledge (or internal models) about several features of the dynamic interaction with the moving object. Expand
...
1
2
3
4
5
...