Brief optogenetic inhibition of dopamine neurons mimics endogenous negative reward prediction errors

被引:147
作者
Chang, Chun Yun [1 ]
Esber, Guillem R. [2 ]
Marrero-Garcia, Yasmin [1 ]
Yau, Hau-Jie [1 ]
Bonci, Antonello [1 ,3 ,4 ]
Schoenbaum, Geoffrey [1 ,3 ,5 ]
机构
[1] NIDA, Intramural Res Program, Cellular Neurobiol Res Branch, Behav Neurophysiol Res Sect, Baltimore, MD 21224 USA
[2] CUNY, Dept Psychol, Brooklyn Coll, New York, NY 10021 USA
[3] Johns Hopkins Univ, Solomon H Snyder Dept Neurosci, Baltimore, MD USA
[4] Johns Hopkins Univ, Dept Psychiat, Baltimore, MD USA
[5] Univ Maryland, Sch Med, Dept Anat & Neurobiol, Baltimore, MD 21201 USA
关键词
VENTRAL TEGMENTAL AREA; LATERAL HABENULA; NUCLEUS-ACCUMBENS; ORBITOFRONTAL CORTEX; MESOLIMBIC DOPAMINE; SIGNALS; REINFORCEMENT; RESPONSES; OVEREXPECTATION; AVOIDANCE;
D O I
10.1038/nn.4191
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Correlative studies have strongly linked phasic changes in dopamine activity with reward prediction error signaling. But causal evidence that these brief changes in firing actually serve as error signals to drive associative learning is more tenuous. Although there is direct evidence that brief increases can substitute for positive prediction errors, there is no comparable evidence that similarly brief pauses can substitute for negative prediction errors. In the absence of such evidence, the effect of increases in firing could reflect novelty or salience, variables also correlated with dopamine activity. Here we provide evidence in support of the proposed linkage, showing in a modified Pavlovian over-expectation task that brief pauses in the firing of dopamine neurons in rat ventral tegmental area at the time of reward are sufficient to mimic the effects of endogenous negative prediction errors. These results support the proposal that brief changes in the firing of dopamine neurons serve as full-fledged bidirectional prediction error signals.
引用
收藏
页码:111 / +
页数:8
相关论文
共 50 条
  • [1] Statistics of midbrain dopamine neuron spike trains in the awake primate
    Bayer, Hannah M.
    Lau, Brian
    Glimcher, Paul W.
    [J]. JOURNAL OF NEUROPHYSIOLOGY, 2007, 98 (03) : 1428 - 1439
  • [2] What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
    Berridge, KC
    Robinson, TE
    [J]. BRAIN RESEARCH REVIEWS, 1998, 28 (03) : 309 - 369
  • [3] BOLD responses reflecting dopaminergic signals in the human ventral tegmental area
    D'Ardenne, Kimberlee
    McClure, Samuel M.
    Nystrom, Leigh E.
    Cohen, Jonathan D.
    [J]. SCIENCE, 2008, 319 (5867) : 1264 - 1267
  • [4] The habenula governs the attribution of incentive salience to reward predictive cues
    Danna, Carey L.
    Shepard, Paul D.
    Elmer, Greg I.
    [J]. FRONTIERS IN HUMAN NEUROSCIENCE, 2013, 7
  • [5] Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens
    Day, Jeremy J.
    Roitman, Mitchell F.
    Wightman, R. Mark
    Carelli, Regina M.
    [J]. NATURE NEUROSCIENCE, 2007, 10 (08) : 1020 - 1028
  • [6] Reconciling the influence of predictiveness and uncertainty on stimulus salience: a model of attention in associative learning
    Esber, Guillem R.
    Haselgrove, Mark
    [J]. PROCEEDINGS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 2011, 278 (1718) : 2553 - 2561
  • [7] Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning
    Frank, Michael J.
    Moustafa, Ahmed A.
    Haughey, Heather M.
    Curran, Tim
    Hutchison, Kent E.
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2007, 104 (41) : 16311 - 16316
  • [8] Understanding dopamine and reinforcement learning: The dopamine reward prediction error hypothesis
    Glimcher, Paul W.
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2011, 108 : 15647 - 15654
  • [9] Phasic Dopamine Release in the Rat Nucleus Accumbens Symmetrically Encodes a Reward Prediction Error Term
    Hart, Andrew S.
    Rutledge, Robb B.
    Glimcher, Paul W.
    Phillips, Paul E. M.
    [J]. JOURNAL OF NEUROSCIENCE, 2014, 34 (03) : 698 - 704
  • [10] Negative Reward Signals from the Lateral Habenula to Dopamine Neurons Are Mediated by Rostromedial Tegmental Nucleus in Primates
    Hong, Simon
    Jhou, Thomas C.
    Smith, Mitchell
    Saleem, Kadharbatcha S.
    Hikosaka, Okihide
    [J]. JOURNAL OF NEUROSCIENCE, 2011, 31 (32) : 11457 - 11471