Dorsal anterior cingulate cortex integrates reinforcement history to guide voluntary behaviour

被引:126
作者
Holroyd, Clay B. [1 ]
Coles, Michael G. H. [2 ]
机构
[1] Univ Victoria, Dept Psychol, Victoria, BC V8W 3P5, Canada
[2] Donders Ctr Cognit Neuroimaging, Nijmegen, Netherlands
关键词
anterior cingulate cortex; reinforcement; error-related negativity; prediction error; decision making;
D O I
10.1016/j.cortex.2007.08.013
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Two competing types of theory have been proposed about the function of dorsal anterior cingulate cortex (dACC): evaluative theories hold that dACC monitors ongoing behavior to detect errors or conflict, whereas response selection theories hold that dACC is directly involved in the decision making process. In particular, one response selection theory proposes that dACC utilizes reward prediction error signals carried by the midbrain dopamine system to decide which of several competing motor control systems should be given control over the motor system (Holroyd and Coles, 2002). The theory further proposes that the impact of these dopamine signals on dACC determines the amplitude of a component of the event-related brain potential called the error-related negativity (ERN). in the present study, we applied this theory to a decision making problem that requires participants to select between two response options in which an erroneous choice is not clearly defined. Rather, the reward received for a particular response evolves in relation to the individual's previous behavior. We adapted a computational model associated with the theory to simulate human performance and the ERN in the task, and tested the predictions of the model against empirical ERP data. our results indicate that ERN amplitude reflects the subjective value attributed by each participant to their response options as derived from their recent reward history. This finding is consistent with the position that dACC integrates the recent history of reinforcements to guide voluntary choice behavior, as opposed to evaluating behaviors per se. (c) 2007 Elsevier Masson Srl. All rights reserved.
引用
收藏
页码:548 / 559
页数:12
相关论文
共 66 条
[41]   Medial prefrontal cell activity signaling prediction errors of action values [J].
Matsumoto, Madoka ;
Matsumoto, Kenji ;
Abe, Hiroshi ;
Tanaka, Keiji .
NATURE NEUROSCIENCE, 2007, 10 (05) :647-656
[42]   Event-related brain potentials following incorrect feedback in a time-estimation task: Evidence for a "generic" neural system for error detection [J].
Miltner, WHR ;
Braun, CH ;
Coles, MGH .
JOURNAL OF COGNITIVE NEUROSCIENCE, 1997, 9 (06) :788-798
[43]   Neural economics and the biological substrates of valuation [J].
Montague, PR ;
Berns, GS .
NEURON, 2002, 36 (02) :265-284
[44]   Computational roles for dopamine in behavioural control [J].
Montague, PR ;
Hyman, SE ;
Cohen, JD .
NATURE, 2004, 431 (7010) :760-767
[45]   Knowing good from bad: differential activation of human cortical areas by positive and negative outcomes [J].
Nieuwenhuis, S ;
Slagter, HA ;
von Geusau, NJA ;
Heslenfeld, DJ ;
Holroyd, CB .
EUROPEAN JOURNAL OF NEUROSCIENCE, 2005, 21 (11) :3161-3168
[46]   Reinforcement-related brain potentials from medial frontal cortex: origins and functional significance [J].
Nieuwenhuis, S ;
Holroyd, CB ;
Mol, N ;
Coles, MGH .
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2004, 28 (04) :441-448
[47]   Sensitivity of electrophysiological activity from medial frontal cortex to utilitarian and performance feedback [J].
Nieuwenhuis, S ;
Yeung, N ;
Holroyd, CB ;
Schurger, A ;
Cohen, JD .
CEREBRAL CORTEX, 2004, 14 (07) :741-747
[48]   A computational account of altered error processing in older age: Dopamine and the error-related negativity [J].
Nieuwenhuis, Sander ;
Ridderinkhof, K. Richard ;
Talsma, Durk ;
Coles, Michael G. H. ;
Holroyd, Clay B. ;
Kok, Albert ;
van der Molen, Maurits W. .
COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2002, 2 (01) :19-36
[49]  
Pakzad-Vaezi K, 2006, PSYCHOPHYSIOLOGY, V43, pS75
[50]   Primate anterior cingulate cortex: Where motor control, drive and cognition interface [J].
Paus, T .
NATURE REVIEWS NEUROSCIENCE, 2001, 2 (06) :417-424