Evidence for surprise minimization over value maximization in choice behavior

被引:49
作者
Schwartenbeck, Philipp [1 ,2 ,3 ,4 ]
FitzGerald, Thomas H. B. [1 ,4 ]
Mathys, Christoph [1 ,4 ]
Dolan, Ray [1 ,4 ]
Kronbichler, Martin [2 ,3 ]
Friston, Karl [1 ]
机构
[1] UCL, Wellcome Trust Ctr Neuroimaging, London WC1N 3BG, England
[2] Salzburg Univ, Ctr Cognit Neurosci, A-5020 Salzburg, Austria
[3] Paracelsus Med Univ Salzburg, Christian Doppler Klin, Inst Neurosci, Salzburg, Austria
[4] Max Planck Univ Coll, London Ctr Computat Psychiat & Ageing Res, London WC1B 5EH, England
基金
英国惠康基金;
关键词
ACTIVE INFERENCE; FUTURE; BRAINS;
D O I
10.1038/srep16575
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Classical economic models are predicated on the idea that the ultimate aim of choice is to maximize utility or reward. In contrast, an alternative perspective highlights the fact that adaptive behavior requires agents' to model their environment and minimize surprise about the states they frequent. We propose that choice behavior can be more accurately accounted for by surprise minimization compared to reward or utility maximization alone. Minimizing surprise makes a prediction at variance with expected utility models; namely, that in addition to attaining valuable states, agents attempt to maximize the entropy over outcomes and thus 'keep their options open'. We tested this prediction using a simple binary choice paradigm and show that human decision-making is better explained by surprise minimization compared to utility maximization. Furthermore, we replicated this entropy-seeking behavior in a control task with no explicit utilities. These findings highlight a limitation of purely economic motivations in explaining choice behavior and instead emphasize the importance of belief-based motivations.
引用
收藏
页数:14
相关论文
共 45 条
[1]   Predictions not commands: active inference in the motor system [J].
Adams, Rick A. ;
Shipp, Stewart ;
Friston, Karl J. .
BRAIN STRUCTURE & FUNCTION, 2013, 218 (03) :611-643
[2]  
[Anonymous], 2009, Vision Res., DOI DOI 10.1016/J.VISRES.2008.09.007
[3]   Stochastic expected utility theory [J].
Blavatskyy, Pavlo R. .
JOURNAL OF RISK AND UNCERTAINTY, 2007, 34 (03) :259-286
[4]   Planning as inference [J].
Botvinick, Matthew ;
Toussaint, Marc .
TRENDS IN COGNITIVE SCIENCES, 2012, 16 (10) :485-488
[5]   Active inference, sensory attenuation and illusions [J].
Brown, Harriet ;
Adams, Rick A. ;
Parees, Isabel ;
Edwards, Mark ;
Friston, Karl J. .
COGNITIVE PROCESSING, 2013, 14 (04) :411-427
[6]   Whatever next? Predictive brains, situated agents, and the future of cognitive science [J].
Clark, Andy .
BEHAVIORAL AND BRAIN SCIENCES, 2013, 36 (03) :181-204
[7]   THE HELMHOLTZ MACHINE [J].
DAYAN, P ;
HINTON, GE ;
NEAL, RM ;
ZEMEL, RS .
NEURAL COMPUTATION, 1995, 7 (05) :889-904
[8]   Rationalizable Irrationalities of Choice [J].
Dayan, Peter .
TOPICS IN COGNITIVE SCIENCE, 2014, 6 (02) :204-228
[9]  
FitzGerald T. H. B., 2014, NEURAL COMPUT, V16, P1
[10]   Model averaging, optimal inference, and habit formation [J].
FitzGerald, Thomas H. B. ;
Dolan, Raymond J. ;
Friston, Karl J. .
FRONTIERS IN HUMAN NEUROSCIENCE, 2014, 8