Modulation of feedback related activity in the rostral anterior cingulate cortex during trial and error exploration

被引:54
作者
Amiez, Celine [2 ]
Sallet, Jerome [1 ]
Procyk, Emmanuel [1 ]
Petrides, Michael [2 ]
机构
[1] INSERM, U846, Stem Cell & Brain Res Inst, F-69000 Bron, France
[2] McGill Univ, Cognit Neurosci Unit, Montreal Neurol Inst, Montreal, PQ H3A 2B4, Canada
基金
加拿大健康研究院;
关键词
Anterior cingulate cortex; Reward prediction error; Trial and error exploration; Exploitation; fMRI; DORSOLATERAL PREFRONTAL CORTEX; FRONTAL-CORTEX; REWARD PREDICTION; DECISION-MAKING; PATTERN-ANALYSIS; VISUAL-STIMULI; NEURONAL BASIS; DOPAMINE; FMRI; SIGNALS;
D O I
10.1016/j.neuroimage.2012.06.023
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The present functional magnetic resonance imaging (fMRI) experiment aims at clarifying the role of the rostral anterior cingulate cortex (rACC) in the evaluation of feedback in a deterministic environment. We tested, in particular, the response of the rACC to the detection of different types of feedback, and to varying levels of outcome expectancy. We used a problem-solving task in which subjects had to discover, in successive trials, which one of the four presented stimuli was associated with a positive feedback, the other ones being associated with error feedback. In this task, two periods alternated: 1. an exploratory period in which error feedback indicated to adapt the following response appropriately (and continue to explore), and first positive feedback indicated to change strategy (i.e. to shift from explorative to exploitative behavior), and 2. an exploitative period in which subjects had to repeat the correct choice. The rACC is recruited in the exploratory period during the analysis of both error and first correct positive feedback. In addition, the rACC activity was modulated by positive reward prediction error values (i.e. the difference between obtained and expected feedback). Altogether, these results reveal the critical role of the rACC in the evaluation of salient feedback for learning optimal strategies. (C) 2012 Elsevier Inc. All rights reserved.
引用
收藏
页码:1078 / 1090
页数:13
相关论文
共 91 条
[1]   Anterior cingulate error-related activity is modulated by predicted reward [J].
Amiez, C ;
Joseph, JP ;
Procyk, E .
EUROPEAN JOURNAL OF NEUROSCIENCE, 2005, 21 (12) :3447-3452
[2]   Reward encoding in the monkey anterior cingulate cortex [J].
Amiez, C. ;
Joseph, J. P. ;
Procyk, E. .
CEREBRAL CORTEX, 2006, 16 (07) :1040-1055
[3]   Response selection versus feedback analysis in conditional visuo-motor learning [J].
Amiez, C. ;
Hadj-Bouziane, F. ;
Petrides, M. .
NEUROIMAGE, 2012, 59 (04) :3723-3735
[4]   Selective involvement of the mid-dorsolateral prefrontal cortex in the coding of the serial order of visual stimuli in working memory [J].
Amiez, Celine ;
Petrides, Michael .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2007, 104 (34) :13786-13791
[5]   The Role of Striatal Tonically Active Neurons in Reward Prediction Error Signaling during Instrumental Task Performance [J].
Apicella, Paul ;
Ravel, Sabrina ;
Deffains, Marc ;
Legallet, Eric .
JOURNAL OF NEUROSCIENCE, 2011, 31 (04) :1507-1515
[6]   Tonically active neurons in the striatum differentiate between delivery and omission of expected reward in a probabilistic task context [J].
Apicella, Paul ;
Deffains, Marc ;
Ravel, Sabrina ;
Legallet, Eric .
EUROPEAN JOURNAL OF NEUROSCIENCE, 2009, 30 (03) :515-526
[7]   Connectivity-Based Parcellation of Human Cingulate Cortex and Its Relation to Functional Specialization [J].
Beckmann, Matthias ;
Johansen-Berg, Heidi ;
Rushworth, Matthew F. S. .
JOURNAL OF NEUROSCIENCE, 2009, 29 (04) :1175-1190
[8]   Learning the value of information in an uncertain world [J].
Behrens, Timothy E. J. ;
Woolrich, Mark W. ;
Walton, Mark E. ;
Rushworth, Matthew F. S. .
NATURE NEUROSCIENCE, 2007, 10 (09) :1214-1221
[9]   Counterfactual Choice and Learning in a Neural Network Centered on Human Lateral Frontopolar Cortex [J].
Boorman, Erie D. ;
Behrens, Timothy E. ;
Rushworth, Matthew F. .
PLOS BIOLOGY, 2011, 9 (06)
[10]   How Green Is the Grass on the Other Side? Frontopolar Cortex and the Evidence in Favor of Alternative Courses of Action [J].
Boorman, Erie D. ;
Behrens, Timothy E. J. ;
Woolrich, Mark W. ;
Rushworth, Matthew F. S. .
NEURON, 2009, 62 (05) :733-743