Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation

Abstract

The basal ganglia support learning to exploit decisions that have yielded positive outcomes in the past. In contrast, limited evidence implicates the prefrontal cortex in the process of making strategic exploratory decisions when the magnitude of potential outcomes is unknown. Here we examine neurogenetic contributions to individual differences in these distinct aspects of motivated human behavior, using a temporal decision-making task and computational analysis. We show that two genes controlling striatal dopamine function, DARPP-32 (also called PPP1R1B) and DRD2, are associated with exploitative learning to adjust response times incrementally as a function of positive and negative decision outcomes. In contrast, a gene primarily controlling prefrontal dopamine function (COMT) is associated with a particular type of 'directed exploration', in which exploratory decisions are made in proportion to Bayesian uncertainty about whether other choices might produce outcomes that are better than the status quo. Quantitative model fits reveal that genetic factors modulate independent parameters of a reinforcement learning system.

DOI: 10.1038/nn.2342

Extracted Key Phrases

7 Figures and Tables

05010020102011201220132014201520162017
Citations per Year

633 Citations

Semantic Scholar estimates that this publication has 633 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@article{Frank2009PrefrontalAS, title={Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation}, author={Michael J. Frank and Bradley B. Doll and Jen Oas-Terpstra and Francisco Moreno}, journal={Nature Neuroscience}, year={2009}, volume={12}, pages={1062-1068} }