Phasic Dopamine Release in the Rat Nucleus Accumbens Symmetrically Encodes a Reward Prediction Error Term

被引:189
作者
Hart, Andrew S. [1 ,2 ]
Rutledge, Robb B. [3 ]
Glimcher, Paul W. [3 ]
Phillips, Paul E. M. [1 ,2 ]
机构
[1] Univ Washington, Dept Psychiat & Behav Sci, Dept Pharmacol, Seattle, WA 98195 USA
[2] Univ Washington, Grad Program Neurobiol & Behav, Seattle, WA 98195 USA
[3] NYU, Ctr Neural Sci, New York, NY 10003 USA
基金
美国国家卫生研究院;
关键词
NEURONS ENCODE; UNCERTAINTY; RESPONSES;
D O I
10.1523/JNEUROSCI.2489-13.2014
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Making predictions about the rewards associated with environmental stimuli and updating those predictions through feedback is an essential aspect of adaptive behavior. Theorists have argued that dopamine encodes a reward prediction error (RPE) signal that is used in such a reinforcement learning process. Recent work with fMRI has demonstrated that the BOLD signal in dopaminergic target areas meets both necessary and sufficient conditions of an axiomatic model of the RPE hypothesis. However, there has been no direct evidence that dopamine release itself also meets necessary and sufficient criteria for encoding an RPE signal. Further, the fact that dopamine neurons have low tonic firing rates that yield a limited dynamic range for encoding negative RPEs has led to significant debate about whether positive and negative prediction errors are encoded on a similar scale. To address both of these issues, we used fast-scan cyclic voltammetry to measure reward-evoked dopamine release at carbon fiber electrodes chronically implanted in the nucleus accumbens core of rats trained on a probabilistic decision-making task. We demonstrate that dopamine concentrations transmit a bidirectional RPE signal with symmetrical encoding of positive and negative RPEs. Our findings strengthen the case that changes in dopamine concentration alone are sufficient to encode the full range of RPEs necessary for reinforcement learning.
引用
收藏
页码:698 / 704
页数:7
相关论文
共 28 条
  • [1] Statistics of midbrain dopamine neuron spike trains in the awake primate
    Bayer, Hannah M.
    Lau, Brian
    Glimcher, Paul W.
    [J]. JOURNAL OF NEUROPHYSIOLOGY, 2007, 98 (03) : 1428 - 1439
  • [2] Midbrain dopamine neurons encode a quantitative reward prediction error signal
    Bayer, HM
    Glimcher, PW
    [J]. NEURON, 2005, 47 (01) : 129 - 141
  • [3] Dopamine, reward prediction error, and economics
    Caplin, Andrew
    Dean, Mark
    [J]. QUARTERLY JOURNAL OF ECONOMICS, 2008, 123 (02) : 663 - 701
  • [4] MEASURING BELIEFS AND REWARDS: A NEUROECONOMIC APPROACH
    Caplin, Andrew
    Dean, Mark
    Glimcher, Paul W.
    Rutledge, Robb B.
    [J]. QUARTERLY JOURNAL OF ECONOMICS, 2010, 125 (03) : 923 - 960
  • [5] Clark JJ, 2010, NAT METHODS, V7, P126, DOI [10.1038/nmeth.1412, 10.1038/NMETH.1412]
  • [6] Influence of Phasic and Tonic Dopamine Release on Receptor Activation
    Dreyer, Jakob K.
    Herrik, Kjartan F.
    Berg, Rune W.
    Hounsgaard, Jorn D.
    [J]. JOURNAL OF NEUROSCIENCE, 2010, 30 (42) : 14273 - 14283
  • [7] Reconciling the influence of predictiveness and uncertainty on stimulus salience: a model of attention in associative learning
    Esber, Guillem R.
    Haselgrove, Mark
    [J]. PROCEEDINGS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 2011, 278 (1718) : 2553 - 2561
  • [8] Discrete coding of reward probability and uncertainty by dopamine neurons
    Fiorillo, CD
    Tobler, PN
    Schultz, W
    [J]. SCIENCE, 2003, 299 (5614) : 1898 - 1902
  • [9] A selective role for dopamine in stimulus-reward learning
    Flagel, Shelly B.
    Clark, Jeremy J.
    Robinson, Terry E.
    Mayo, Leah
    Czuj, Alayna
    Willuhn, Ingo
    Akers, Christina A.
    Clinton, Sarah M.
    Phillips, Paul E. M.
    Akil, Huda
    [J]. NATURE, 2011, 469 (7328) : 53 - U63
  • [10] Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine
    Gan, Jerylin O.
    Walton, Mark E.
    Phillips, Paul E. M.
    [J]. NATURE NEUROSCIENCE, 2010, 13 (01) : 25 - 27