Frontal Theta Oscillatory Activity Is a Common Mechanism for the Computation of Unexpected Outcomes and Learning Rate

被引:62
作者
Mas-Herrero, Ernest [1 ]
Marco-Pallares, Josep [1 ,2 ]
机构
[1] LHospitalet Llobregat, Barcelona, Spain
[2] Univ Barcelona, Barcelona 08097, Spain
关键词
FEEDBACK-RELATED NEGATIVITY; ANTERIOR CINGULATE CORTEX; PREDICTION ERROR; PREFRONTAL CORTEX; DECISION-MAKING; MIDLINE THETA; SIGNALS; EEG; INFORMATION; ADJUSTMENTS;
D O I
10.1162/jocn_a_00516
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
In decision-making processes, the relevance of the information yielded by outcomes varies across time and situations. It increases when previous predictions are not accurate and in contexts with high environmental uncertainty. Previous fMRI studies have shown an important role of medial pFC in coding both reward prediction errors and the impact of this information to guide future decisions. However, it is unclear whether these two processes are dissociated in time or occur simultaneously, suggesting that a common mechanism is engaged. In the present work, we studied the modulation of two electro-physiological responses associated to outcome processing-the feedback-related negativity ERP and frontocentral theta oscillatory activity-with the reward prediction error and the learning rate. Twenty-six participants performed two learning tasks differing in the degree of predictability of the outcomes: a reversal learning task and a probabilistic learning task with multiple blocks of novel cue-outcome associations. We implemented a reinforcement learning model to obtain the single-trial reward prediction error and the learning rate for each participant and task. Our results indicated that midfrontal theta activity and feedback-related negativity increased linearly with the unsigned prediction error. In addition, variations of frontal theta oscillatory activity predicted the learning rate across tasks and participants. These results support the existence of a common brain mechanism for the computation of unsigned prediction error and learning rate.
引用
收藏
页码:447 / 458
页数:12
相关论文
共 46 条
[1]   Medial prefrontal cortex as an action-outcome predictor [J].
Alexander, William H. ;
Brown, Joshua W. .
NATURE NEUROSCIENCE, 2011, 14 (10) :1338-U163
[2]   An integrative theory of locus coeruleus-norepinephrine function: Adaptive gain and optimal performance [J].
Aston-Jones, G ;
Cohen, JD .
ANNUAL REVIEW OF NEUROSCIENCE, 2005, 28 :403-450
[3]   Learning the value of information in an uncertain world [J].
Behrens, Timothy E. J. ;
Woolrich, Mark W. ;
Walton, Mark E. ;
Rushworth, Matthew F. S. .
NATURE NEUROSCIENCE, 2007, 10 (09) :1214-1221
[4]   Conflict monitoring and cognitive control [J].
Botvinick, MM ;
Braver, TS ;
Barch, DM ;
Carter, CS ;
Cohen, JD .
PSYCHOLOGICAL REVIEW, 2001, 108 (03) :624-652
[5]   Directional Functional Coupling of Cerebral Rhythms Between Anterior Cingulate and Dorsolateral Prefrontal Areas During Rare Stimuli: A Directed Transfer Function Analysis of Human Depth EEG Signal [J].
Brazdil, Milan ;
Babiloni, Claudio ;
Roman, Robert ;
Daniel, Pavel ;
Bares, Martin ;
Rektor, Ivan ;
Eusebi, Fabrizio ;
Rossini, Paolo Maria ;
Vecchio, Fabrizio .
HUMAN BRAIN MAPPING, 2009, 30 (01) :138-146
[6]   Attention for Learning Signals in Anterior Cingulate Cortex [J].
Bryden, Daniel W. ;
Johnson, Emily E. ;
Tobia, Steven C. ;
Kashtelyan, Vadim ;
Roesch, Matthew R. .
JOURNAL OF NEUROSCIENCE, 2011, 31 (50) :18266-18274
[7]   Neuronal oscillations in cortical networks [J].
Buzsáki, G ;
Draguhn, A .
SCIENCE, 2004, 304 (5679) :1926-1929
[8]   Frontal Theta Reflects Uncertainty and Unexpectedness during Exploration and Exploitation [J].
Cavanagh, James F. ;
Figueroa, Christina M. ;
Cohen, Michael X. ;
Frank, Michael J. .
CEREBRAL CORTEX, 2012, 22 (11) :2575-2586
[9]   Theta lingua franca: A common mid-frontal substrate for action monitoring processes [J].
Cavanagh, James F. ;
Zambrano-Vazquez, Laura ;
Allen, John J. B. .
PSYCHOPHYSIOLOGY, 2012, 49 (02) :220-238
[10]   Frontal theta links prediction errors to behavioral adaptation in reinforcement learning [J].
Cavanagh, James F. ;
Frank, Michael J. ;
Klein, Theresa J. ;
Allen, John J. B. .
NEUROIMAGE, 2010, 49 (04) :3198-3209