Reward expectation and prediction error in human medial frontal cortex: An EEG study

被引:27
作者
Silvetti, Massimo [1 ,2 ]
Castellar, Elena Nunez [1 ,3 ]
Roger, Clemence [1 ]
Verguts, Tom [1 ,2 ]
机构
[1] Univ Ghent, Dept Expt Psychol, B-9000 Ghent, Belgium
[2] Ghent Univ Hosp, GIfMI Ghent Inst Funct & Metab Imaging, B-9000 Ghent, Belgium
[3] IMinds MICT Ghent Univ, Dept Commun Sci, Ghent, Belgium
关键词
ACC; Reward; Reinforcement learning; Prediction error; Medial frontal cortex; CONTINGENT NEGATIVE-VARIATION; INDEPENDENT COMPONENT ANALYSIS; ANTERIOR CINGULATE CORTEX; NEURAL REPRESENTATION; PREFRONTAL CORTEX; BRAIN POTENTIALS; RESPONSE ERRORS; ERP COMPONENTS; REACTION-TIME; VARIATION CNV;
D O I
10.1016/j.neuroimage.2013.08.058
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The mammalian medial frontal cortex (MFC) is involved in reward-based decision making. In particular, in nonhuman primates this area constructs expectations about upcoming rewards, given an environmental state or a choice planned by the animal. At the same time, in both humans and nonhuman primates, the MFC computes the difference between such predictions and actual environmental outcomes (reward prediction errors). However, there is a paucity of evidence about the time course of MFC-related activity during reward prediction and prediction error in humans. Here we experimentally investigated this by recording the EEG during a reinforcement learning task. Our results support the hypothesis that human MFC codes for reward prediction during the cue period and for prediction error during the outcome period. Further, reward expectation (cue period) was positively correlated with prediction error (outcome period) in error trials but negatively in correct trials, consistent with updating of reward expectation by prediction error. This demonstrates in humans, like in nonhuman primates, a role of the MFC in the rapid updating of reward expectations through prediction errors. (C) 2013 Elsevier Inc. All rights reserved.
引用
收藏
页码:376 / 382
页数:7
相关论文
共 45 条
[1]   Medial prefrontal cortex as an action-outcome predictor [J].
Alexander, William H. ;
Brown, Joshua W. .
NATURE NEUROSCIENCE, 2011, 14 (10) :1338-U163
[2]   Reward encoding in the monkey anterior cingulate cortex [J].
Amiez, C. ;
Joseph, J. P. ;
Procyk, E. .
CEREBRAL CORTEX, 2006, 16 (07) :1040-1055
[3]  
[Anonymous], COGN AFFECT BEHAV NE
[4]   Trial-by-trial coupling of concurrent electroencephalogram and functional magnetic resonance imaging identifies the dynamics of performance monitoring [J].
Debener, S ;
Ullsperger, M ;
Siegel, M ;
Fiehler, K ;
von Cramon, DY ;
Engel, AK .
JOURNAL OF NEUROSCIENCE, 2005, 25 (50) :11730-11737
[5]   LOCALIZATION OF A NEURAL SYSTEM FOR ERROR-DETECTION AND COMPENSATION [J].
DEHAENE, S ;
POSNER, MI ;
TUCKER, DM .
PSYCHOLOGICAL SCIENCE, 1994, 5 (05) :303-305
[6]   EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis [J].
Delorme, A ;
Makeig, S .
JOURNAL OF NEUROSCIENCE METHODS, 2004, 134 (01) :9-21
[7]   Early error detection is generic, but subsequent adaption to errors is not: Evidence from ERPs [J].
Dhar, Monica ;
Pourtois, Gilles .
NEUROPSYCHOLOGIA, 2011, 49 (05) :1236-1245
[8]   Neural Correlates of the Spatial and Expectancy Components of Endogenous and Stimulus-Driven Orienting of Attention in the Posner Task [J].
Doricchi, Fabrizio ;
Macci, Enrica ;
Silvetti, Massimo ;
Macaluso, Emiliano .
CEREBRAL CORTEX, 2010, 20 (07) :1574-1585
[9]   Better or worse than expected? Aging, learning, and the ERN [J].
Eppinger, Ben ;
Kray, Jutta ;
Mock, Barbara ;
Mecklinger, Axel .
NEUROPSYCHOLOGIA, 2008, 46 (02) :521-539
[10]   EFFECTS OF CROSSMODAL DIVIDED ATTENTION ON LATE ERP COMPONENTS .2. ERROR PROCESSING IN CHOICE REACTION TASKS [J].
FALKENSTEIN, M ;
HOHNSBEIN, J ;
HOORMANN, J ;
BLANKE, L .
ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1991, 78 (06) :447-455