Dissociable feedback valence effects on frontal midline theta during reward gain versus threat avoidance learning

被引:2
作者
Stolz, Christopher [1 ,2 ,3 ,4 ]
Pickering, Alan D.
Mueller, Erik M. [1 ,3 ]
机构
[1] Univ Marburg, Dept Psychol, Marburg, Germany
[2] Leibniz Inst Neurobiol LIN, Magdeburg, Germany
[3] Goldsmiths Univ London, Dept Psychol, London, England
[4] Univ Marburg, Fac Psychol Differential & Personal Psychol, Gutenbergstr 18, D-35032 Marburg, Germany
关键词
computational model; EEG; prediction error; punishment avoidance; reinforcement learning; theta; PREDICTION ERROR; COGNITIVE CONTROL; OSCILLATORY ACTIVITY; PREFRONTAL CORTEX; NEGATIVITY FRN; DOPAMINE; SEROTONIN; ANTICIPATION; METAANALYSIS; EXPECTATION;
D O I
10.1111/psyp.14235
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
While frontal midline theta (FM theta) has been associated with threat processing, with cognitive control in the context of anxiety, and with reinforcement learning, most reinforcement learning studies on FM theta have used reward rather than threat-related stimuli as reinforcer. Accordingly, the role of FM theta in threat-related reinforcement learning is largely unknown. Here, n = 23 human participants underwent one reward-, and one punishment-, based reversal learning task, which differed only with regard to the kind of reinforcers that feedback was tied to (i.e., monetary gain vs. loud noise burst, respectively). In addition to single-trial EEG, we assessed single-trial feedback expectations based on both a reinforcement learning computational model and trial-by-trial subjective feedback expectation ratings. While participants' performance and feedback expectations were comparable between the reward and punishment tasks, FM theta was more reliably amplified to negative vs. positive feedback in the reward vs. punishment task. Regressions with feedback valence, computationally derived, and self-reported expectations as predictors and FM theta as criterion further revealed that trial-by-trial variations in FM theta specifically relate to reward-related feedback-valence and not to threat-related feedback or to violated expectations/prediction errors. These findings suggest that FM theta as measured in reinforcement learning tasks may be less sensitive to the processing of events with direct relevance for fear and anxiety.
引用
收藏
页数:20
相关论文
共 129 条
  • [1] What is dopamine doing in model-based reinforcement learning?
    Akam, Thomas
    Walton, Mark
    [J]. CURRENT OPINION IN BEHAVIORAL SCIENCES, 2021, 38 : 74 - 82
  • [2] The Role of the Anterior Cingulate Cortex in Prediction Error and Signaling Surprise
    Alexander, William H.
    Brown, Joshua W.
    [J]. TOPICS IN COGNITIVE SCIENCE, 2019, 11 (01) : 119 - 135
  • [3] Theta and high-beta networks for feedback processing: a simultaneous EEG-fMRI study in healthy male subjects
    Andreou, C.
    Frielinghaus, H.
    Rauh, J.
    Mussmann, M.
    Vauth, S.
    Braun, P.
    Leicht, G.
    Mulert, C.
    [J]. TRANSLATIONAL PSYCHIATRY, 2017, 7 : e1016 - e1016
  • [4] It's all about timing: An electrophysiological examination of feedback-based learning with immediate and delayed feedback
    Arbel, Yael
    Hong, Lucia
    Baker, Travis E.
    Holroyd, Clay B.
    [J]. NEUROPSYCHOLOGIA, 2017, 99 : 179 - 186
  • [5] Frontal Cortex and the Hierarchical Control of Behavior
    Badre, David
    Nee, Derek Evan
    [J]. TRENDS IN COGNITIVE SCIENCES, 2018, 22 (02) : 170 - 188
  • [6] Dual learning processes underlying human decision-making in reversal learning tasks: functional significance and evidence from the model fit to human behavior
    Bai, Yu .
    Katahira, Kentaro
    Ohira, Hideki
    [J]. FRONTIERS IN PSYCHOLOGY, 2014, 5
  • [7] Primary and Secondary Rewards Differentially Modulate Neural Activity Dynamics during Working Memory
    Beck, Stefanie M.
    Locke, Hannah S.
    Savine, Adam C.
    Jimura, Koji
    Braver, Todd S.
    [J]. PLOS ONE, 2010, 5 (02):
  • [8] Learning the value of information in an uncertain world
    Behrens, Timothy E. J.
    Woolrich, Mark W.
    Walton, Mark E.
    Rushworth, Matthew F. S.
    [J]. NATURE NEUROSCIENCE, 2007, 10 (09) : 1214 - 1221
  • [9] Time-frequency theta and delta measures index separable components of feedback processing in a gambling task
    Bernat, Edward M.
    Nelson, Lindsay D.
    Baskin-Sommers, Arielle R.
    [J]. PSYCHOPHYSIOLOGY, 2015, 52 (05) : 626 - 637
  • [10] Learning in anticipation of reward and punishment: perspectives across the human lifespan
    Betts, Matthew J.
    Richter, Anni
    de Boer, Lieke
    Tegelbeckers, Jana
    Perosa, Valentina
    Baumann, Valentin
    Chowdhury, Rumana
    Dolan, Ray J.
    Seidenbecher, Constanze
    Schott, Bjoern H.
    Duezel, Emrah
    Guitart-Masip, Marc
    Krauel, Kerstin
    [J]. NEUROBIOLOGY OF AGING, 2020, 96 : 49 - 57