Brief optogenetic inhibition of dopamine neurons mimics endogenous negative reward prediction errors

被引:151
作者
Chang, Chun Yun [1 ]
Esber, Guillem R. [2 ]
Marrero-Garcia, Yasmin [1 ]
Yau, Hau-Jie [1 ]
Bonci, Antonello [1 ,3 ,4 ]
Schoenbaum, Geoffrey [1 ,3 ,5 ]
机构
[1] NIDA, Intramural Res Program, Cellular Neurobiol Res Branch, Behav Neurophysiol Res Sect, Baltimore, MD 21224 USA
[2] CUNY, Dept Psychol, Brooklyn Coll, New York, NY 10021 USA
[3] Johns Hopkins Univ, Solomon H Snyder Dept Neurosci, Baltimore, MD USA
[4] Johns Hopkins Univ, Dept Psychiat, Baltimore, MD USA
[5] Univ Maryland, Sch Med, Dept Anat & Neurobiol, Baltimore, MD 21201 USA
关键词
VENTRAL TEGMENTAL AREA; LATERAL HABENULA; NUCLEUS-ACCUMBENS; ORBITOFRONTAL CORTEX; MESOLIMBIC DOPAMINE; SIGNALS; REINFORCEMENT; RESPONSES; OVEREXPECTATION; AVOIDANCE;
D O I
10.1038/nn.4191
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Correlative studies have strongly linked phasic changes in dopamine activity with reward prediction error signaling. But causal evidence that these brief changes in firing actually serve as error signals to drive associative learning is more tenuous. Although there is direct evidence that brief increases can substitute for positive prediction errors, there is no comparable evidence that similarly brief pauses can substitute for negative prediction errors. In the absence of such evidence, the effect of increases in firing could reflect novelty or salience, variables also correlated with dopamine activity. Here we provide evidence in support of the proposed linkage, showing in a modified Pavlovian over-expectation task that brief pauses in the firing of dopamine neurons in rat ventral tegmental area at the time of reward are sufficient to mimic the effects of endogenous negative prediction errors. These results support the proposal that brief changes in the firing of dopamine neurons serve as full-fledged bidirectional prediction error signals.
引用
收藏
页码:111 / +
页数:8
相关论文
共 50 条
[1]   Statistics of midbrain dopamine neuron spike trains in the awake primate [J].
Bayer, Hannah M. ;
Lau, Brian ;
Glimcher, Paul W. .
JOURNAL OF NEUROPHYSIOLOGY, 2007, 98 (03) :1428-1439
[2]   What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? [J].
Berridge, KC ;
Robinson, TE .
BRAIN RESEARCH REVIEWS, 1998, 28 (03) :309-369
[3]   BOLD responses reflecting dopaminergic signals in the human ventral tegmental area [J].
D'Ardenne, Kimberlee ;
McClure, Samuel M. ;
Nystrom, Leigh E. ;
Cohen, Jonathan D. .
SCIENCE, 2008, 319 (5867) :1264-1267
[4]   The habenula governs the attribution of incentive salience to reward predictive cues [J].
Danna, Carey L. ;
Shepard, Paul D. ;
Elmer, Greg I. .
FRONTIERS IN HUMAN NEUROSCIENCE, 2013, 7
[5]   Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens [J].
Day, Jeremy J. ;
Roitman, Mitchell F. ;
Wightman, R. Mark ;
Carelli, Regina M. .
NATURE NEUROSCIENCE, 2007, 10 (08) :1020-1028
[6]   Reconciling the influence of predictiveness and uncertainty on stimulus salience: a model of attention in associative learning [J].
Esber, Guillem R. ;
Haselgrove, Mark .
PROCEEDINGS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 2011, 278 (1718) :2553-2561
[7]   Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning [J].
Frank, Michael J. ;
Moustafa, Ahmed A. ;
Haughey, Heather M. ;
Curran, Tim ;
Hutchison, Kent E. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2007, 104 (41) :16311-16316
[8]   Understanding dopamine and reinforcement learning: The dopamine reward prediction error hypothesis [J].
Glimcher, Paul W. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2011, 108 :15647-15654
[9]   Phasic Dopamine Release in the Rat Nucleus Accumbens Symmetrically Encodes a Reward Prediction Error Term [J].
Hart, Andrew S. ;
Rutledge, Robb B. ;
Glimcher, Paul W. ;
Phillips, Paul E. M. .
JOURNAL OF NEUROSCIENCE, 2014, 34 (03) :698-704
[10]   Negative Reward Signals from the Lateral Habenula to Dopamine Neurons Are Mediated by Rostromedial Tegmental Nucleus in Primates [J].
Hong, Simon ;
Jhou, Thomas C. ;
Smith, Mitchell ;
Saleem, Kadharbatcha S. ;
Hikosaka, Okihide .
JOURNAL OF NEUROSCIENCE, 2011, 31 (32) :11457-11471