• Corpus ID: 18693099

Information Selection in Noisy Environments with Large Action Spaces

  title={Information Selection in Noisy Environments with Large Action Spaces},
  author={Pedro Tsividis and Samuel J. Gershman and Joshua B. Tenenbaum and Laura E. Schulz},
  journal={Cognitive Science},
Information Selection in Noisy Environments with Large Action Spaces Pedro Tsividis (tsividis@mit.edu), Samuel J. Gershman (sjgershm@mit.edu), Joshua B. Tenenbaum (jbt@mit.edu), Laura Schulz (lshulz@mit.edu) Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences, 77 Massachusetts Ave., Cambridge, MA 02139 USA Abstract A critical aspect of human cognition is the ability to effec- tively query the environment for information. The ‘real’ world is large and noisy, and… 

Visuospatial information foraging describes search behavior in learning latent environmental features

A task in which humans and monkeys made a series of choices to search for shapes hidden on a grid and how quickly humans learned the shapes was predicted by how well their choice sequences matched the foraging pattern.

Black boxes: Hypothesis testing via indirect perceptual evidence

It is proposed that effective learning and exploration depend on being able to interpret evidence through the lens of intuitive theories – theories of both the physical world and one's own perceptual apparatus – to imagine how one’s actions might change the state of the world and what kinds of changes would be most perceptually discriminable.

Signatures of visuospatial information foraging during learning of complex environments

It is suggested that humans are more tuned to the search for information than reward than monkeys and that foraging competence predicts the capacity to learn complex environments.

Human-Level Reinforcement Learning through Theory-Based Modeling, Exploration, and Planning

This work proposes a new approach to reinforcement learning called Theory-Based Reinforcement Learning, which uses human-like intuitive theories — rich, abstract, causal models of physical objects, intentional agents, and their interactions — to explore and model an environment, and plan effectively to achieve task goals.

Toward the neural implementation of structure learning

What does the free energy principle tell us about the brain

The free energy principle has been proposed as a unifying account of brain function. It is closely related, and in some cases subsumes, earlier unifying ideas such as Bayesian inference, predictive

Building machines that learn and think like people

It is argued that truly human-like learning and thinking machines should build causal models of the world that support explanation and understanding, rather than merely solving pattern recognition problems, and harness compositionality and learning-to-learn to rapidly acquire and generalize knowledge to new tasks and situations.



Does the utility of information influence sampling behavior?

There is greater support for the idea that people gather information to reduce their uncer- tainty about the current state of the environment (a “disinter- ested”, or cost-insenstive, sampling strategy).

Bayesian model selection for group studies

A rational analysis of the selection task as optimal data selection.

The experimental data is reassessed in the light of a Bayesian model of optimal data selection in inductive hypothesis testing that suggests that reasoning in hypothesis-testing tasks may be rational rather than subject to systematic bias.

Hypothesis generation, sparse categories, and the positive test strategy.

It is demonstrated that a preference for sparse hypotheses (a sparsity bias) emerges as a natural consequence of the family resemblance principle; that is, it arises from the requirement that good rules index entities that are more similar to one another than they are to entities that do not satisfy the rule.

Reasoning about a Rule

  • P. Wason
  • Psychology
    The Quarterly journal of experimental psychology
  • 1968
It is argued that the subjects did not give evidence of having acquired the characteristics of Piaget's “formal operational thought,” and it is suggested that the difficulty is due to a mental set for expecting a relation of truth, correspondence, or match to hold between sentences and states of affairs.