Dorsal anterior cingulate cortex integrates reinforcement history to guide voluntary behaviour

被引:126
作者
Holroyd, Clay B. [1 ]
Coles, Michael G. H. [2 ]
机构
[1] Univ Victoria, Dept Psychol, Victoria, BC V8W 3P5, Canada
[2] Donders Ctr Cognit Neuroimaging, Nijmegen, Netherlands
关键词
anterior cingulate cortex; reinforcement; error-related negativity; prediction error; decision making;
D O I
10.1016/j.cortex.2007.08.013
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Two competing types of theory have been proposed about the function of dorsal anterior cingulate cortex (dACC): evaluative theories hold that dACC monitors ongoing behavior to detect errors or conflict, whereas response selection theories hold that dACC is directly involved in the decision making process. In particular, one response selection theory proposes that dACC utilizes reward prediction error signals carried by the midbrain dopamine system to decide which of several competing motor control systems should be given control over the motor system (Holroyd and Coles, 2002). The theory further proposes that the impact of these dopamine signals on dACC determines the amplitude of a component of the event-related brain potential called the error-related negativity (ERN). in the present study, we applied this theory to a decision making problem that requires participants to select between two response options in which an erroneous choice is not clearly defined. Rather, the reward received for a particular response evolves in relation to the individual's previous behavior. We adapted a computational model associated with the theory to simulate human performance and the ERN in the task, and tested the predictions of the model against empirical ERP data. our results indicate that ERN amplitude reflects the subjective value attributed by each participant to their response options as derived from their recent reward history. This finding is consistent with the position that dACC integrates the recent history of reinforcements to guide voluntary choice behavior, as opposed to evaluating behaviors per se. (c) 2007 Elsevier Masson Srl. All rights reserved.
引用
收藏
页码:548 / 559
页数:12
相关论文
共 66 条
[1]   Anterior cingulate error-related activity is modulated by predicted reward [J].
Amiez, C ;
Joseph, JP ;
Procyk, E .
EUROPEAN JOURNAL OF NEUROSCIENCE, 2005, 21 (12) :3447-3452
[2]  
Baker TE, 2006, PSYCHOPHYSIOLOGY, V43, pS22
[3]   Conflict monitoring and anterior cingulate cortex: an update [J].
Botvinick, Matthew M. ;
Cohen, Jonathan D. ;
Carter, Cameron S. .
TRENDS IN COGNITIVE SCIENCES, 2004, 8 (12) :539-546
[4]   Conflict monitoring and cognitive control [J].
Botvinick, MM ;
Braver, TS ;
Barch, DM ;
Carter, CS ;
Cohen, JD .
PSYCHOLOGICAL REVIEW, 2001, 108 (03) :624-652
[6]   Reinforcement learning signals predict future decisions [J].
Cohen, Michael X. ;
Ranganath, Charan .
JOURNAL OF NEUROSCIENCE, 2007, 27 (02) :371-378
[7]  
Coles M. G. H., 1998, QUANTITATIVE TOPOLOG, P96
[8]   Trial-by-trial coupling of concurrent electroencephalogram and functional magnetic resonance imaging identifies the dynamics of performance monitoring [J].
Debener, S ;
Ullsperger, M ;
Siegel, M ;
Fiehler, K ;
von Cramon, DY ;
Engel, AK .
JOURNAL OF NEUROSCIENCE, 2005, 25 (50) :11730-11737
[9]   LOCALIZATION OF A NEURAL SYSTEM FOR ERROR-DETECTION AND COMPENSATION [J].
DEHAENE, S ;
POSNER, MI ;
TUCKER, DM .
PSYCHOLOGICAL SCIENCE, 1994, 5 (05) :303-305
[10]  
DONCHIN E, 1943, MULTIDISCIPLINARY PE, P555