Evidence for surprise minimization over value maximization in choice behavior

被引:49
作者
Schwartenbeck, Philipp [1 ,2 ,3 ,4 ]
FitzGerald, Thomas H. B. [1 ,4 ]
Mathys, Christoph [1 ,4 ]
Dolan, Ray [1 ,4 ]
Kronbichler, Martin [2 ,3 ]
Friston, Karl [1 ]
机构
[1] UCL, Wellcome Trust Ctr Neuroimaging, London WC1N 3BG, England
[2] Salzburg Univ, Ctr Cognit Neurosci, A-5020 Salzburg, Austria
[3] Paracelsus Med Univ Salzburg, Christian Doppler Klin, Inst Neurosci, Salzburg, Austria
[4] Max Planck Univ Coll, London Ctr Computat Psychiat & Ageing Res, London WC1B 5EH, England
基金
英国惠康基金;
关键词
ACTIVE INFERENCE; FUTURE; BRAINS;
D O I
10.1038/srep16575
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Classical economic models are predicated on the idea that the ultimate aim of choice is to maximize utility or reward. In contrast, an alternative perspective highlights the fact that adaptive behavior requires agents' to model their environment and minimize surprise about the states they frequent. We propose that choice behavior can be more accurately accounted for by surprise minimization compared to reward or utility maximization alone. Minimizing surprise makes a prediction at variance with expected utility models; namely, that in addition to attaining valuable states, agents attempt to maximize the entropy over outcomes and thus 'keep their options open'. We tested this prediction using a simple binary choice paradigm and show that human decision-making is better explained by surprise minimization compared to utility maximization. Furthermore, we replicated this entropy-seeking behavior in a control task with no explicit utilities. These findings highlight a limitation of purely economic motivations in explaining choice behavior and instead emphasize the importance of belief-based motivations.
引用
收藏
页数:14
相关论文
共 45 条
[21]   Dopamine: generalization and bonuses [J].
Kakade, S ;
Dayan, P .
NEURAL NETWORKS, 2002, 15 (4-6) :549-559
[22]   A Free Energy Principle for Biological Systems [J].
Karl, Friston .
ENTROPY, 2012, 14 (11) :2100-2121
[23]   Keep Your Options Open: An Information-Based Driving Principle for Sensorimotor Systems [J].
Klyubin, Alexander S. ;
Polani, Daniel ;
Nehaniv, Chrystopher L. .
PLOS ONE, 2008, 3 (12)
[24]   Modelling the stochastic component of behaviour in experiments: Some issues for the interpretation of data [J].
Loomes, G .
EXPERIMENTAL ECONOMICS, 2005, 8 (04) :301-323
[25]  
Mijovic-Prelec D., 2010, PHIL T R SOC B, V365
[26]   Computational psychiatry [J].
Montague, P. Read ;
Dolan, Raymond J. ;
Friston, Kari J. ;
Dayan, Peter .
TRENDS IN COGNITIVE SCIENCES, 2012, 16 (01) :72-80
[27]   A formal model of interpersonal inference [J].
Moutoussis, Michael ;
Trujillo-Barreto, Nelson J. ;
El-Deredy, Wael ;
Dolan, Raymond J. ;
Friston, Karl J. .
FRONTIERS IN HUMAN NEUROSCIENCE, 2014, 8
[28]   THE BARGAINING PROBLEM [J].
Nash, John F., Jr. .
ECONOMETRICA, 1950, 18 (02) :155-162
[29]  
Ortega P. A., 2010, 3 C ART GEN INT LUG
[30]  
Ortega P. A., 2011, 4 C GEN ART INT LUG