Monetary feedback modulates performance and electrophysiological indices of belief updating in reward learning

被引:8
作者
Bennett, Daniel [1 ,2 ]
Sasmita, Karen [1 ,3 ]
Maloney, Ryan T. [1 ]
Murawski, Carsten [4 ]
Bode, Stefan [1 ,5 ]
机构
[1] Univ Melbourne, Melbourne Sch Psychol Sci, Parkville, Vic 3010, Australia
[2] Princeton Univ, Princeton Neurosci Inst, Princeton, NJ USA
[3] Cornell Univ, Dept Psychol, Ithaca, NY 14853 USA
[4] Univ Melbourne, Dept Finance, Parkville, Vic, Australia
[5] Univ Cologne, Dept Psychol, Cologne, Germany
基金
澳大利亚研究理事会;
关键词
Bayesian inference; belief updating; ERPs; motivation; reward learning; ERROR-RELATED NEGATIVITY; INTEGRATIVE THEORY; DECISION; REINFORCEMENT; UNCERTAINTY; INCENTIVES; MOTIVATION; BRAIN; POTENTIALS; COMPLEXITY;
D O I
10.1111/psyp.13431
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Belief updating entails the incorporation of new information about the environment into internal models of the world. Bayesian inference is the statistically optimal strategy for performing belief updating in the presence of uncertainty. An important open question is whether the use of cognitive strategies that implement Bayesian inference is dependent upon motivational state and, if so, how this is reflected in electrophysiological signatures of belief updating in the brain. Here, we recorded the EEG of participants performing a simple reward learning task with both monetary and nonmonetary instructive feedback conditions. Our aim was to distinguish the influence of the rewarding properties of feedback on belief updating from the information content of the feedback itself. A Bayesian updating model allowed us to quantify different aspects of belief updating across trials, including the size of belief updates and the uncertainty of beliefs. Faster learning rates were observed in the monetary feedback condition compared to the instructive feedback condition, while belief updates were generally larger, and belief uncertainty smaller, with monetary compared to instructive feedback. Larger amplitudes in the monetary feedback condition were found for three ERP components: the P3a, the feedback-related negativity, and the late positive potential. These findings suggest that motivational state influences inference strategies in reward learning, and this is reflected in the electrophysiological correlates of belief updating.
引用
收藏
页数:18
相关论文
共 71 条
[1]   Higher incentives can impair performance: neural evidence on reinforcement and rationality [J].
Achtziger, Anja ;
Alos-Ferrer, Carlos ;
Huegelschaefer, Sabine ;
Steinhauser, Marco .
SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE, 2015, 10 (11) :1477-1483
[2]   The neural basis of belief updating and rational decision making [J].
Achtziger, Anja ;
Alos-Ferrer, Carlos ;
Huegelschaefer, Sabine ;
Steinhauser, Marco .
SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE, 2014, 9 (01) :55-62
[3]  
AUSTERWEIL JL, 2015, OXFORD HDB COMPUTATI, DOI DOI 10.1073/PNAS.1104047108
[4]  
BAYS PM, 2009, J VISION, V9, DOI DOI 10.1167/9.10.7
[5]  
BENNETT D, 2015, ENEURO, V2, DOI DOI 10.1523/ENEURO.0076-15.2015
[6]   Distributed Patterns of Event-Related Potentials Predict Subsequent Ratings of Abstract Stimulus Attributes [J].
Bode, Stefan ;
Bennett, Daniel ;
Stahl, Jutta ;
Murawski, Carsten .
PLOS ONE, 2014, 9 (10)
[7]  
Bonner S.E., 2000, Journal of Managemnt Accounting Research, V12, P19, DOI [10.2308/jmar.2000.12.1.19, DOI 10.2308/JMAR.2000.12.1.19]
[8]   The effects of monetary incentives on effort and task performance: theories, evidence, and a framework for research [J].
Bonner, SE ;
Sprinkle, GB .
ACCOUNTING ORGANIZATIONS AND SOCIETY, 2002, 27 (4-5) :303-345
[9]   Computational Complexity and Human Decision-Making [J].
Bossaerts, Peter ;
Murawski, Carsten .
TRENDS IN COGNITIVE SCIENCES, 2017, 21 (12) :917-929
[10]   Deciding How To Decide: Self-Control and Meta-Decision Making [J].
Boureau, Y-Lan ;
Sokol-Hessner, Peter ;
Daw, Nathaniel D. .
TRENDS IN COGNITIVE SCIENCES, 2015, 19 (11) :700-710