Goal-directed EEG activity evoked by discriminative stimuli in reinforcement learning

被引:21
作者
Luque, David [1 ]
Moris, Joaquin [1 ]
Rushby, Jacqueline A. [2 ]
Le Pelley, Mike E. [2 ]
机构
[1] Univ Malaga, Inst Invest Biomed Malaga IBIMA, Dept Psicol Basica, E-29071 Malaga, Spain
[2] Univ New S Wales, Sch Psychol, Sydney, NSW, Australia
基金
澳大利亚研究理事会;
关键词
Reinforcement learning; Goal-directed action; Cognitive neuroscience; Event-related potentials; Feedback correct-related positivity; P2; P3; P3b; EVENT-RELATED POTENTIALS; FEEDBACK-RELATED NEGATIVITY; REWARD; ATTENTION; ERROR; MODULATION; SCHIZOPHRENIA; ASSOCIABILITY; POSITIVITY; COMPONENTS;
D O I
10.1111/psyp.12302
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
In reinforcement learning (RL), discriminative stimuli (S) allow agents to anticipate the value of a future outcome, and the response that will produce that outcome. We examined this processing by recording EEG locked to S during RL. Incentive value of outcomes and predictive value of S were manipulated, allowing us to discriminate between outcome-related and response-related activity. S predicting the correct response differed from nonpredictive S in the P2. S paired with high-value outcomes differed from those paired with low-value outcomes in a frontocentral positivity and in the P3b. A slow negativity then distinguished between predictive and nonpredictive S. These results suggest that, first, attention prioritizes detection of informative S. Activation of mental representations of these informative S then retrieves representations of outcomes, which in turn retrieve representations of responses that previously produced those outcomes.
引用
收藏
页码:238 / 248
页数:11
相关论文
共 57 条
  • [1] Value-driven attentional capture
    Anderson, Brian A.
    Laurent, Patryk A.
    Yantis, Steven
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2011, 108 (25) : 10367 - 10371
  • [2] Which Way Do I Go? Neural Activation in Response to Feedback and Spatial Processing in a Virtual T-Maze
    Baker, Travis E.
    Holroyd, Clay B.
    [J]. CEREBRAL CORTEX, 2009, 19 (08) : 1708 - 1722
  • [3] A blind source separation technique using second-order statistics
    Belouchrani, A
    AbedMeraim, K
    Cardoso, JF
    Moulines, E
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1997, 45 (02) : 434 - 444
  • [4] Modulation of pain ratings by expectation and uncertainty: Behavioral characteristics and anticipatory neural correlates
    Brown, Christopher A.
    Seymour, Ben
    Boyle, Yvonne
    El-Deredy, Wael
    Jones, Anthony K. P.
    [J]. PAIN, 2008, 135 (03) : 240 - 250
  • [5] Waiting to perceive: Reward or punishment?
    Brunia, Cornelis H. M.
    Hackley, Steven A.
    van Boxtel, Geert J. M.
    Kotani, Yasunori
    Ohgami, Yoshimi
    [J]. CLINICAL NEUROPHYSIOLOGY, 2011, 122 (05) : 858 - 868
  • [6] Emotion, attention, and the 'negativity bias', studied through event-related potentials
    Carretié, L
    Mercado, F
    Tapia, M
    Hinojosa, JA
    [J]. INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2001, 41 (01) : 75 - 85
  • [7] Feedback-related Negativity Codes Prediction Error but Not Behavioral Adjustment during Probabilistic Reversal Learning
    Chase, Henry W.
    Swainson, Rachel
    Durham, Lucy
    Benham, Laura
    Cools, Roshan
    [J]. JOURNAL OF COGNITIVE NEUROSCIENCE, 2011, 23 (04) : 936 - 946
  • [8] A common reference frame for movement plans in the posterior parietal cortex
    Cohen, YE
    Andersen, RA
    [J]. NATURE REVIEWS NEUROSCIENCE, 2002, 3 (07) : 553 - 562
  • [9] STIMULUS NOVELTY, TASK RELEVANCE AND VISUAL EVOKED-POTENTIAL IN MAN
    COURCHESNE, E
    HILLYARD, SA
    GALAMBOS, R
    [J]. ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1975, 39 (02): : 131 - 143
  • [10] Stimulus-outcome interactions during instrumental discrimination learning by rats and humans
    de Wit, S.
    Niry, D.
    Wariyar, R.
    Aitken, M. R. F.
    Dickinson, A.
    [J]. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-ANIMAL BEHAVIORAL PROCESSES, 2007, 33 (01): : 1 - 11