Dopamine Encoding of Pavlovian Incentive Stimuli Diminishes with Extended Training

被引:70
作者
Clark, Jeremy J. [1 ]
Collins, Anne L. [1 ]
Sanford, Christina Akers [1 ,2 ]
Phillips, Paul E. M. [1 ,2 ]
机构
[1] Univ Washington, Dept Psychiat & Behav Sci, Seattle, WA 98195 USA
[2] Univ Washington, Dept Pharmacol, Seattle, WA 98195 USA
关键词
REWARD; NEURONS; TIME; INVOLVEMENT; SALIENCE; SYSTEMS; COCAINE;
D O I
10.1523/JNEUROSCI.5119-12.2013
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Dopamine is highly implicated both as a teaching signal in reinforcement learning and in motivating actions to obtain rewards. However, theoretical disconnects remain between the temporal encoding properties of dopamine neurons and the behavioral consequences of its release. Here, we demonstrate in rats that dopamine evoked by pavlovian cues increases during acquisition, but dissociates from stable conditioned appetitive behavior as this signal returns to preconditioning levels with extended training. Experimental manipulation of the statistical parameters of the behavioral paradigm revealed that this attenuation of cue-evoked dopamine release during the postasymptotic period was attributable to acquired knowledge of the temporal structure of the task. In parallel, conditioned behavior became less dopamine dependent after extended training. Thus, the current work demonstrates that as the presentation of reward-predictive stimuli becomes anticipated through the acquisition of task information, there is a shift in the neurobiological substrates that mediate the motivational properties of these incentive stimuli.
引用
收藏
页码:3526 / 3532
页数:7
相关论文
共 26 条
[11]   A selective role for dopamine in stimulus-reward learning [J].
Flagel, Shelly B. ;
Clark, Jeremy J. ;
Robinson, Terry E. ;
Mayo, Leah ;
Czuj, Alayna ;
Willuhn, Ingo ;
Akers, Christina A. ;
Clinton, Sarah M. ;
Phillips, Paul E. M. ;
Akil, Huda .
NATURE, 2011, 469 (7328) :53-U63
[12]   The learning curve: Implications of a quantitative analysis [J].
Gallistel, CR ;
Fairhurst, S ;
Balsam, P .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2004, 101 (36) :13124-13131
[13]   Time, rate, and conditioning [J].
Gallistel, CR ;
Gibbon, J .
PSYCHOLOGICAL REVIEW, 2000, 107 (02) :289-344
[14]   Real-time measurement of dopamine fluctuations after cocaine in the brain of behaving rats [J].
Heien, MLAV ;
Khan, AS ;
Ariansen, JL ;
Cheer, JF ;
Phillips, PEM ;
Wassum, KM ;
Wightman, RM .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2005, 102 (29) :10023-10028
[15]   A representation of the hazard rate of elapsed time in macaque area LIP [J].
Janssen, P ;
Shadlen, MN .
NATURE NEUROSCIENCE, 2005, 8 (02) :234-241
[16]   RESPONSES OF MONKEY DOPAMINE NEURONS DURING LEARNING OF BEHAVIORAL REACTIONS [J].
LJUNGBERG, T ;
APICELLA, P ;
SCHULTZ, W .
JOURNAL OF NEUROPHYSIOLOGY, 1992, 67 (01) :145-163
[17]   A computational substrate for incentive salience [J].
McClure, SM ;
Daw, ND ;
Montague, PR .
TRENDS IN NEUROSCIENCES, 2003, 26 (08) :423-428
[18]   A framework for mesencephalic dopamine systems based on predictive Hebbian learning [J].
Montague, PR ;
Dayan, P ;
Sejnowski, TJ .
JOURNAL OF NEUROSCIENCE, 1996, 16 (05) :1936-1947
[19]   CONTEXT, CONDITIONING, AND HIPPOCAMPAL REREPRESENTATION IN ANIMAL LEARNING [J].
MYERS, CE ;
GLUCK, MA .
BEHAVIORAL NEUROSCIENCE, 1994, 108 (05) :835-847
[20]  
Paxinos G, 2005, RAT BRAIN STEREOTAXI