A universal role of the ventral striatum in reward-based learning: Evidence from human studies

被引:127
作者
Daniel, Reka [1 ,2 ]
Pollmann, Stefan [1 ,3 ]
机构
[1] Univ Magdeburg, Dept Expt Psychol, D-39016 Magdeburg, Germany
[2] Princeton Univ, Princeton Neurosci Inst, Princeton, NJ 08450 USA
[3] Ctr Behav Brain Sci, D-39016 Magdeburg, Germany
关键词
Ventral striatum; Reward; Feedback; Learning; fMRI; Human; PREDICTION ERRORS; DOPAMINE NEURONS; NUCLEUS-ACCUMBENS; NEURAL RESPONSES; COGNITIVE FEEDBACK; MONETARY REWARD; DORSAL STRIATUM; VISUAL-CORTEX; BASAL GANGLIA; REINFORCEMENT;
D O I
10.1016/j.nlm.2014.05.002
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Reinforcement learning enables organisms to adjust their behavior in order to maximize rewards. Electrophysiological recordings of dopaminergic midbrain neurons have shown that they code the difference between actual and predicted rewards, i.e., the reward prediction error, in many species. This error signal is conveyed to both the striatum and cortical areas and is thought to play a central role in learning to optimize behavior. However, in human daily life rewards are diverse and often only indirect feedback is available. Here we explore the range of rewards that are processed by the dopaminergic system in human participants, and examine whether it is also involved in learning in the absence of explicit rewards. While results from electrophysiological recordings in humans are sparse, evidence linking dopaminergic activity to the metabolic signal recorded from the midbrain and striatum with functional magnetic resonance imaging (fMRI) is available. Results from fMRI studies suggest that the human ventral striatum (VS) receives valuation information for a diverse set of rewarding stimuli. These range from simple primary reinforcers such as juice rewards over abstract social rewards to internally generated signals on perceived correctness, suggesting that the VS is involved in learning from trial-and-error irrespective of the specific nature of provided rewards. In addition, we summarize evidence that the VS can also be implicated when learning from observing others, and in tasks that go beyond simple stimulus-action-outcome learning, indicating that the reward system is also recruited in more complex learning tasks. (C) 2014 Elsevier Inc. All rights reserved.
引用
收藏
页码:90 / 100
页数:11
相关论文
共 151 条
  • [1] Prediction error as a linear function of reward probability is coded in human nucleus accumbens
    Abler, Birgit
    Walter, Henrik
    Erk, Susanne
    Kammerer, Hannes
    Spitzer, Manfred
    [J]. NEUROIMAGE, 2006, 31 (02) : 790 - 795
  • [2] Neural correlates of long-term intense romantic love
    Acevedo, Bianca P.
    Aron, Arthur
    Fisher, Helen E.
    Brown, Lucy L.
    [J]. SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE, 2012, 7 (02) : 145 - 159
  • [3] Reward-motivated learning: Mesolimbic activation precedes memory formation
    Adcock, R. Alison
    Thangavel, Arul
    Whitfield-Gabrieli, Susan
    Knutson, Brian
    Gabrieli, John D. E.
    [J]. NEURON, 2006, 50 (03) : 507 - 517
  • [4] Beautiful faces have variable reward value: fMRI and behavioral evidence
    Aharon, I
    Etcoff, N
    Ariely, D
    Chabris, CF
    O'Connor, E
    Breiter, HC
    [J]. NEURON, 2001, 32 (03) : 537 - 551
  • [5] [Anonymous], KUNSTLICHE INTELLIGE
  • [6] [Anonymous], 1996, Neuro-dynamic programming
  • [7] Reward, motivation, and emotion systems associated with early-stage intense romantic love
    Aron, A
    Fisher, H
    Mashek, DJ
    Strong, G
    Li, HF
    Brown, LL
    [J]. JOURNAL OF NEUROPHYSIOLOGY, 2005, 94 (01) : 327 - 337
  • [8] Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning
    Aron, AR
    Shohamy, D
    Clark, J
    Myers, C
    Gluck, MA
    Poldrack, RA
    [J]. JOURNAL OF NEUROPHYSIOLOGY, 2004, 92 (02) : 1144 - 1152
  • [9] How well do we understand the neural origins of the fMRI BOLD signal?
    Arthurs, OJ
    Boniface, S
    [J]. TRENDS IN NEUROSCIENCES, 2002, 25 (01) : 27 - 31
  • [10] Human category learning
    Ashby, EG
    Maddox, WT
    [J]. ANNUAL REVIEW OF PSYCHOLOGY, 2005, 56 : 149 - 178