Dissociable feedback valence effects on frontal midline theta during reward gain versus threat avoidance learning

被引:2
作者
Stolz, Christopher [1 ,2 ,3 ,4 ]
Pickering, Alan D.
Mueller, Erik M. [1 ,3 ]
机构
[1] Univ Marburg, Dept Psychol, Marburg, Germany
[2] Leibniz Inst Neurobiol LIN, Magdeburg, Germany
[3] Goldsmiths Univ London, Dept Psychol, London, England
[4] Univ Marburg, Fac Psychol Differential & Personal Psychol, Gutenbergstr 18, D-35032 Marburg, Germany
关键词
computational model; EEG; prediction error; punishment avoidance; reinforcement learning; theta; PREDICTION ERROR; COGNITIVE CONTROL; OSCILLATORY ACTIVITY; PREFRONTAL CORTEX; NEGATIVITY FRN; DOPAMINE; SEROTONIN; ANTICIPATION; METAANALYSIS; EXPECTATION;
D O I
10.1111/psyp.14235
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
While frontal midline theta (FM theta) has been associated with threat processing, with cognitive control in the context of anxiety, and with reinforcement learning, most reinforcement learning studies on FM theta have used reward rather than threat-related stimuli as reinforcer. Accordingly, the role of FM theta in threat-related reinforcement learning is largely unknown. Here, n = 23 human participants underwent one reward-, and one punishment-, based reversal learning task, which differed only with regard to the kind of reinforcers that feedback was tied to (i.e., monetary gain vs. loud noise burst, respectively). In addition to single-trial EEG, we assessed single-trial feedback expectations based on both a reinforcement learning computational model and trial-by-trial subjective feedback expectation ratings. While participants' performance and feedback expectations were comparable between the reward and punishment tasks, FM theta was more reliably amplified to negative vs. positive feedback in the reward vs. punishment task. Regressions with feedback valence, computationally derived, and self-reported expectations as predictors and FM theta as criterion further revealed that trial-by-trial variations in FM theta specifically relate to reward-related feedback-valence and not to threat-related feedback or to violated expectations/prediction errors. These findings suggest that FM theta as measured in reinforcement learning tasks may be less sensitive to the processing of events with direct relevance for fear and anxiety.
引用
收藏
页数:20
相关论文
共 129 条
  • [21] Single-trial regression elucidates the role of prefrontal theta oscillations in response conflict
    Cohen, Michael X.
    Cavanagh, James F.
    [J]. FRONTIERS IN PSYCHOLOGY, 2011, 2
  • [22] Cognitive Control Over Learning: Creating, Clustering, and Generalizing Task-Set Structure
    Collins, Anne G. E.
    Frank, Michael J.
    [J]. PSYCHOLOGICAL REVIEW, 2013, 120 (01) : 190 - 229
  • [23] Neural signature of hierarchically structured expectations predicts clustering and transfer of rule sets in reinforcement learning
    Collins, Anne Gabrielle Eva
    Frank, Michael Joshua
    [J]. COGNITION, 2016, 152 : 160 - 169
  • [24] Serotonin and Dopamine: Unifying Affective, Activational, and Decision Functions
    Cools, Roshan
    Nakamura, Kae
    Daw, Nathaniel D.
    [J]. NEUROPSYCHOPHARMACOLOGY, 2011, 36 (01) : 98 - 113
  • [25] Frontal theta predicts specific cognitive control-induced behavioural changes beyond general reaction time slowing
    Cooper, Patrick S.
    Karayanidis, Frini
    McKewen, Montana
    McLellan-Hall, Samuel
    Wong, Aaron S. W.
    Skippen, Patrick
    Cavanagh, James F.
    [J]. NEUROIMAGE, 2019, 189 : 130 - 140
  • [26] Corr PJ, 2008, REINFORCEMENT SENSITIVITY THEORY OF PERSONALITY, P1
  • [27] Neuroscience and approach/avoidance personality traits: A two stage (valuation-motivation) approach
    Corr, Philip J.
    McNaughton, Neil
    [J]. NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2012, 36 (10) : 2339 - 2354
  • [28] Post-error adjustments
    Danielmeier, Claudia
    Ullsperger, Markus
    [J]. FRONTIERS IN PSYCHOLOGY, 2011, 2
  • [29] Model-Based Influences on Humans' Choices and Striatal Prediction Errors
    Daw, Nathaniel D.
    Gershman, Samuel J.
    Seymour, Ben
    Dayan, Peter
    Dolan, Raymond J.
    [J]. NEURON, 2011, 69 (06) : 1204 - 1215
  • [30] Opponent interactions between serotonin and dopamine
    Daw, ND
    Kakade, S
    Dayan, P
    [J]. NEURAL NETWORKS, 2002, 15 (4-6) : 603 - 616