From prediction error to incentive salience: mesolimbic computation of reward motivation

被引:425
作者
Berridge, Kent C. [1 ]
机构
[1] Univ Michigan, Dept Psychol, Ann Arbor, MI 48109 USA
关键词
dopamine; incentive salience; learning; mesolimbic; nucleus accumbens; prediction error; PAVLOVIAN-INSTRUMENTAL TRANSFER; NUCLEUS-ACCUMBENS DOPAMINE; STRIATAL DOPAMINE; SODIUM DEPLETION; LEARNING SIGNALS; FOOD ADDICTION; SUCROSE REWARD; D-AMPHETAMINE; SUBSTANCE USE; COCAINE CUE;
D O I
10.1111/j.1460-9568.2012.07990.x
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Reward contains separable psychological components of learning, incentive motivation and pleasure. Most computational models have focused only on the learning component of reward, but the motivational component is equally important in reward circuitry, and even more directly controls behavior. Modeling the motivational component requires recognition of additional control factors besides learning. Here I discuss how mesocorticolimbic mechanisms generate the motivation component of incentive salience. Incentive salience takes Pavlovian learning and memory as one input and as an equally important input takes neurobiological state factors (e.g. drug states, appetite states, satiety states) that can vary independently of learning. Neurobiological state changes can produce unlearned fluctuations or even reversals in the ability of a previously learned reward cue to trigger motivation. Such fluctuations in cue-triggered motivation can dramatically depart from all previously learned values about the associated reward outcome. Thus, one consequence of the difference between incentive salience and learning can be to decouple cue-triggered motivation of the moment from previously learned values of how good the associated reward has been in the past. Another consequence can be to produce irrationally strong motivation urges that are not justified by any memories of previous reward values (and without distorting associative predictions of future reward value). Such irrationally strong motivation may be especially problematic in addiction. To understand these phenomena, future models of mesocorticolimbic reward function should address the neurobiological state factors that participate to control generation of incentive salience.
引用
收藏
页码:1124 / 1143
页数:20
相关论文
共 178 条
[1]   Striatal dopamine and the interface between motivation and cognition [J].
Aarts, Esther ;
van Holstein, Mieke ;
Cools, Roshan .
FRONTIERS IN PSYCHOLOGY, 2011, 2
[2]   AUTOSHAPING THE PIGEONS GAPE RESPONSE - ACQUISITION AND TOPOGRAPHY AS A FUNCTION OF REINFORCER TYPE AND MAGNITUDE [J].
ALLAN, RW ;
ZEIGLER, HP .
JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR, 1994, 62 (02) :201-223
[3]   Value-driven attentional capture [J].
Anderson, Brian A. ;
Laurent, Patryk A. ;
Yantis, Steven .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2011, 108 (25) :10367-10371
[4]   Regional specificity in the real-time development of phasic dopamine transmission patterns during acquisition of a cue-cocaine association in rats [J].
Aragona, Brandon J. ;
Day, Jeremy J. ;
Roitman, Mitchell F. ;
Cleaveland, Nathan A. ;
Wightman, R. Mark ;
Carelli, Regina M. .
EUROPEAN JOURNAL OF NEUROSCIENCE, 2009, 30 (10) :1889-1899
[5]  
Attneave F., 1959, Applications of information theory to psychology: A summary of basic concepts, methods, and results
[6]   Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action [J].
Balleine, Bernard W. ;
O'Doherty, John P. .
NEUROPSYCHOPHARMACOLOGY, 2010, 35 (01) :48-69
[7]   Temporal maps and informativeness in associative learning [J].
Balsam, Peter D. ;
Gallistel, C. Randy .
TRENDS IN NEUROSCIENCES, 2009, 32 (02) :73-78
[8]   Opioids for hedonic experience and dopamine to get ready for it [J].
Barbano, M. Flavia ;
Cador, Martine .
PSYCHOPHARMACOLOGY, 2007, 191 (03) :497-506
[9]   Goal Representations and Motivational Drive in Schizophrenia: The Role of Prefrontal-Striatal Interactions [J].
Barch, Deanna M. ;
Dowd, Erin C. .
SCHIZOPHRENIA BULLETIN, 2010, 36 (05) :919-934
[10]   Individual differences in reward drive predict neural responses to images of food [J].
Beaver, John D. ;
Lawrence, Andrew D. ;
Van Ditzhuijzen, Jenneke ;
Davis, Matt H. ;
Woods, Andrew ;
Calder, Andrew J. .
JOURNAL OF NEUROSCIENCE, 2006, 26 (19) :5160-5166