How instructed knowledge modulates the neural systems of reward learning
- 20 December 2010
- journal article
- research article
- Published by Proceedings of the National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 108 (1), 55-60
- https://doi.org/10.1073/pnas.1014938108
Abstract
Recent research in neuroeconomics has demonstrated that the reinforcement learning model of reward learning captures the patterns of both behavioral performance and neural responses during a range of economic decision-making tasks. However, this powerful theoretical model has its limits. Trial-and-error is only one of the means by which individuals can learn the value associated with different decision options. Humans have also developed efficient, symbolic means of communication for learning without the necessity for committing multiple errors across trials. In the present study, we observed that instructed knowledge of cue-reward probabilities improves behavioral performance and diminishes reinforcement learning-related blood-oxygen level-dependent (BOLD) responses to feedback in the nucleus accumbens, ventromedial prefrontal cortex, and hippocampal complex. The decrease in BOLD responses in these brain regions to reward-feedback signals was functionally correlated with activation of the dorsolateral prefrontal cortex (DLPFC). These results suggest that when learning action values, participants use the DLPFC to dynamically adjust outcome responses in valuation regions depending on the usefulness of action-outcome information.Keywords
This publication has 53 references indexed in Scilit:
- Neural mechanisms of observational learningProceedings of the National Academy of Sciences, 2010
- States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement LearningNeuron, 2010
- Neural responses to sanction threats in two-party economic exchangeProceedings of the National Academy of Sciences, 2009
- Instructional control of reinforcement learning: A behavioral and neurocomputational investigationBrain Research, 2009
- Decision theory, reinforcement learning, and the brainCognitive, Affective, & Behavioral Neuroscience, 2008
- Regulating the expectation of reward via cognitive strategiesNature Neuroscience, 2008
- Neural correlates of mentalizing-related computations during strategic interactions in humansProceedings of the National Academy of Sciences, 2008
- Policy Adjustment in a Dynamic Economic GamePLOS ONE, 2006
- Neurons in the orbitofrontal cortex encode economic valueNature, 2006
- A Neural Substrate of Prediction and RewardScience, 1997