Observing the Observer (II): Deciding When to Decide

Abstract

In a companion paper [1], we have presented a generic approach for inferring how subjects make optimal decisions under uncertainty. From a Bayesian decision theoretic perspective, uncertain representations correspond to "posterior" beliefs, which result from integrating (sensory) information with subjective "prior" beliefs. Preferences and goals are encoded through a "loss" (or "utility") function, which measures the cost incurred by making any admissible decision for any given (hidden or unknown) state of the world. By assuming that subjects make optimal decisions on the basis of updated (posterior) beliefs and utility (loss) functions, one can evaluate the likelihood of observed behaviour. In this paper, we describe a concrete implementation of this meta-Bayesian approach (i.e. a Bayesian treatment of Bayesian decision theoretic predictions) and demonstrate its utility by applying it to both simulated and empirical reaction time data from an associative learning task. Here, inter-trial variability in reaction times is modelled as reflecting the dynamics of the subjects' internal recognition process, i.e. the updating of representations (posterior densities) of hidden states over trials while subjects learn probabilistic audio-visual associations. We use this paradigm to demonstrate that our meta-Bayesian framework allows for (i) probabilistic inference on the dynamics of the subject's representation of environmental states, and for (ii) model selection to disambiguate between alternative preferences (loss functions) human subjects could employ when dealing with trade-offs, such as between speed and accuracy. Finally, we illustrate how our approach can be used to quantify subjective beliefs and preferences that underlie inter-individual differences in behaviour.

DOI: 10.1371/journal.pone.0015555

Extracted Key Phrases

16 Figures and Tables

010203020102011201220132014201520162017
Citations per Year

88 Citations

Semantic Scholar estimates that this publication has 88 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@inproceedings{Daunizeau2010ObservingTO, title={Observing the Observer (II): Deciding When to Decide}, author={Jean Daunizeau and Hanneke E. M. den Ouden and Matthias Pessiglione and Stefan J. Kiebel and Karl J. Friston and Klaas Enno Stephan}, booktitle={PloS one}, year={2010} }