A Neural Reward Prediction Error Revealed by a Meta-Analysis of ERPs Using Great Grand Averages

被引:313
作者
Sambrook, Thomas D. [1 ]
Goslin, Jeremy [1 ]
机构
[1] Univ Plymouth, Cognit Inst, Sch Psychol, Plymouth PL4 8AA, Devon, England
关键词
feedback related negativity (FRN); event-related potential (ERP); reward prediction error (RPE); meta-analysis; great grand average; FEEDBACK-RELATED NEGATIVITY; ELECTROPHYSIOLOGICAL RESPONSES; INDIVIDUAL-DIFFERENCES; ANTERIOR CINGULATE; BRAIN POTENTIALS; COMMON MECHANISM; PROSPECT-THEORY; MONETARY GAINS; DOPAMINE; MAGNITUDE;
D O I
10.1037/bul0000006
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Economic approaches to decision making assume that people attach values to prospective goods and act to maximize their obtained value. Neuroeconomics strives to observe these values directly in the brain. A widely used valuation term in formal learning and decision-making models is the reward prediction error: the value of an outcome relative to its expected value. An influential theory (Holroyd & Coles, 2002) claims that an electrophysiological component, feedback related negativity (FRN), codes a reward prediction error in the human brain. Such a component should be sensitive to both the prior likelihood of reward and its magnitude on receipt. A number of studies have found the FRN to be insensitive to reward magnitude, thus questioning the Holroyd and Coles account. However, because of marked inconsistencies in how the FRN is measured, a meaningful synthesis of this evidence is highly problematic. We conducted a meta-analysis of the FRN's response to both reward magnitude and likelihood using a novel method in which published effect sizes were disregarded in favor of direct measurement of the published waveforms themselves, with these waveforms then averaged to produce "great grand averages." Under this standardized measure, the meta-analysis revealed strong effects of magnitude and likelihood on the FRN, consistent with it encoding a reward prediction error. In addition, it revealed strong main effects of reward magnitude and likelihood across much of the waveform, indicating sensitivity to unsigned prediction errors or "salience." The great grand average technique is proposed as a general method for meta-analysis of event-related potential (ERP).
引用
收藏
页码:213 / 235
页数:23
相关论文
共 117 条
[21]   Reinforcement learning signals predict future decisions [J].
Cohen, Michael X. ;
Ranganath, Charan .
JOURNAL OF NEUROSCIENCE, 2007, 27 (02) :371-378
[22]   The role of the human ventral striatum and the medial orbitofrontal cortex in the representation of reward magnitude - An activation likelihood estimation meta-analysis of neuroimaging studies of passive reward expectancy and outcome processing [J].
Diekhof, Esther Kristina ;
Kaps, Lisa ;
Falkai, Peter ;
Gruber, Oliver .
NEUROPSYCHOLOGIA, 2012, 50 (07) :1252-1266
[23]   Meta-analysis of experiments with matched groups or repeated measures designs [J].
Dunlap, WP ;
Cortina, JM ;
Vaslow, JB ;
Burke, MJ .
PSYCHOLOGICAL METHODS, 1996, 1 (02) :170-177
[24]   Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis [J].
Duval, S ;
Tweedie, R .
BIOMETRICS, 2000, 56 (02) :455-463
[25]   How to do a meta-analysis [J].
Field, Andy P. ;
Gillett, Raphael .
BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY, 2010, 63 (03) :665-694
[26]   Influence of cognitive control and mismatch on the N2 component of the ERP: A review [J].
Folstein, Jonathan R. ;
Van Petten, Cyma .
PSYCHOPHYSIOLOGY, 2008, 45 (01) :152-170
[27]   Genetic variation in dopamine moderates neural response during reward anticipation and delivery: Evidence from event-related potentials [J].
Foti, Dan ;
Hajcak, Greg .
PSYCHOPHYSIOLOGY, 2012, 49 (05) :617-626
[28]   Individual Differences in Alcohol Drinking Frequency Are Associated With Electrophysiological Responses to Unexpected Nonrewards [J].
Franken, Ingmar H. A. ;
Van den Berg, Ivo ;
Van Strien, Jan W. .
ALCOHOLISM-CLINICAL AND EXPERIMENTAL RESEARCH, 2010, 34 (04) :702-707
[29]  
Friedman M., 1953, Essays in positive economics, P3
[30]   Prediction error in reinforcement learning: A meta-analysis of neuroimaging studies [J].
Garrison, Jane ;
Erdeniz, Burak ;
Done, John .
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2013, 37 (07) :1297-1310