Feedback-related Negativity Codes Prediction Error but Not Behavioral Adjustment during Probabilistic Reversal Learning

被引:169
作者
Chase, Henry W. [1 ]
Swainson, Rachel [2 ]
Durham, Lucy [1 ]
Benham, Laura [1 ]
Cools, Roshan [1 ,3 ]
机构
[1] Univ Cambridge, Cambridge CB2 1TN, England
[2] Univ Aberdeen, Aberdeen AB9 1FX, Scotland
[3] Radboud Univ Nijmegen, Nijmegen, Netherlands
基金
英国惠康基金; 英国医学研究理事会;
关键词
ANTERIOR CINGULATE CORTEX; MEDIAL FRONTAL-CORTEX; DECISION-MAKING; PARKINSONS-DISEASE; PREFRONTAL CORTEX; COGNITIVE CONTROL; DOPAMINERGIC MEDICATION; REWARD PREDICTION; HUMAN BRAIN; CONFLICT;
D O I
10.1162/jocn.2010.21456
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
We assessed electrophysiological activity over the medial frontal cortex (MFC) during outcome-based behavioral adjustment using a probabilistic reversal learning task. During recording, participants were presented two abstract visual patterns on each trial and had to select the stimulus rewarded on 80% of trials and to avoid the stimulus rewarded on 20% of trials. These contingencies were reversed frequently during the experiment. Previous EEG work has revealed feedback-locked electrophysiological responses over the MFC (feedback-related negativity; FRN), which correlate with the negative prediction error [Holroyd, C. B., & Coles, M. G. The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679-709, 2002] and which predict outcome-based adjustment of decision values [Cohen, M. X., & Ranganath, C. Reinforcement learning signals predict future decisions. Journal of Neuroscience, 27, 371-378, 2007]. Unlike previous paradigms, our paradigm enabled us to disentangle, on the one hand, mechanisms related to the reward prediction error, derived from reinforcement learning (RL) modeling, and on the other hand, mechanisms related to explicit rule-based adjustment of actual behavior. Our results demonstrate greater FRN amplitudes with greater RL model-derived prediction errors. Conversely expected negative outcomes that preceded rule-based behavioral reversal were not accompanied by an FRN. This pattern contrasted remarkably with that of the P3 amplitude, which was significantly greater for expected negative outcomes that preceded rule-based behavioral reversal than for unexpected negative outcomes that did not precede behavioral reversal. These data suggest that the FRN reflects prediction error and associated RL-based adjustment of decision values, whereas the P3 reflects adjustment of behavior on the basis of explicit rules.
引用
收藏
页码:936 / 946
页数:11
相关论文
共 52 条
  • [1] An information-theoretical approach to contextual processing in the human brain: Evidence from prefrontal lesions
    Barcelo, Francisco
    Knight, Robert T.
    [J]. CEREBRAL CORTEX, 2007, 17 : I51 - I60
  • [2] Task switching and novelty processing activate a common neural network for cognitive control
    Barcelo, Francisco
    Escera, Carles
    Corral, Maria J.
    Perianez, Jose A.
    [J]. JOURNAL OF COGNITIVE NEUROSCIENCE, 2006, 18 (10) : 1734 - 1748
  • [3] Learning the value of information in an uncertain world
    Behrens, Timothy E. J.
    Woolrich, Mark W.
    Walton, Mark E.
    Rushworth, Matthew F. S.
    [J]. NATURE NEUROSCIENCE, 2007, 10 (09) : 1214 - 1221
  • [4] Learning-related changes in reward expectancy are reflected in the feedback-related negativity
    Bellebaum, Christian
    Daum, Irene
    [J]. EUROPEAN JOURNAL OF NEUROSCIENCE, 2008, 27 (07) : 1823 - 1835
  • [5] Conflict monitoring and decision making: Reconciling two perspectives on anterior cingulate function
    Botvinick, Matthiew M.
    [J]. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2007, 7 (04) : 356 - 366
  • [6] Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli
    Brischoux, Frederic
    Chakraborty, Subhojit
    Brierley, Daniel I.
    Ungless, Mark A.
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2009, 106 (12) : 4894 - 4899
  • [7] Neurochemical modulation of response inhibition and probabilistic learning in humans
    Chamberlain, SR
    Müller, U
    Blackwell, AD
    Clark, L
    Robbins, TW
    Sahakian, BJ
    [J]. SCIENCE, 2006, 311 (5762) : 861 - 863
  • [8] Reinforcement learning signals predict future decisions
    Cohen, Michael X.
    Ranganath, Charan
    [J]. JOURNAL OF NEUROSCIENCE, 2007, 27 (02) : 371 - 378
  • [9] Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands
    Cools, R
    Barker, RA
    Sahakian, BJ
    Robbins, TW
    [J]. CEREBRAL CORTEX, 2001, 11 (12) : 1136 - 1143
  • [10] Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging
    Cools, R
    Clark, L
    Owen, AM
    Robbins, TW
    [J]. JOURNAL OF NEUROSCIENCE, 2002, 22 (11) : 4563 - 4567