Reconciling Novelty and Complexity Through a Rational Analysis of Curiosity

被引:99
作者
Dubey, Rachit [1 ]
Griffiths, Thomas L. [2 ]
机构
[1] Princeton Univ, Dept Comp Sci, 35 Olden St, Princeton, NJ 08540 USA
[2] Princeton Univ, Dept Psychol, Princeton, NJ 08544 USA
关键词
curiosity; exploration; rational analysis; computational model; EPISTEMIC CURIOSITY; PSYCHOLOGY; MOTIVATION; ANTICIPATION; HIPPOCAMPUS; EXPLORATION; CHOICE; REGRET;
D O I
10.1037/rev0000175
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Curiosity is considered to be the essence of science and an integral component of cognition. What prompts curiosity in a learner? Previous theoretical accounts of curiosity remain divided-novelty-based theories propose that new and highly uncertain stimuli pique curiosity, whereas complexity-based theories propose that stimuli with an intermediate degree of uncertainty stimulate curiosity. In this article, we present a rational analysis of curiosity by considering the computational problem underlying curiosity, which allows us to model these distinct accounts of curiosity in a common framework. Our approach posits that a rational agent should explore stimuli that maximally increase the usefulness of its knowledge and that curiosity is the mechanism by which humans approximate this rational behavior. Critically, our analysis show that the causal structure of the environment can determine whether curiosity is driven by either highly uncertain or moderately uncertain stimuli. This suggests that previous theories need not be in contention but are special cases of a more general account of curiosity. Experimental results confirm our predictions and demonstrate that our theory explains a wide range of findings about human curiosity, including its subjectivity and malleability.
引用
收藏
页码:455 / 476
页数:22
相关论文
共 80 条
[1]  
Anderson J. R., 1990, ADAPTIVE CHARACTER T
[2]   Finite-time analysis of the multiarmed bandit problem [J].
Auer, P ;
Cesa-Bianchi, N ;
Fischer, P .
MACHINE LEARNING, 2002, 47 (2-3) :235-256
[3]  
Baldacchino G, 2013, INT POLIT ECON SER, P1
[4]   Eye movements reveal epistemic curiosity in human observers [J].
Baranes, Adrien ;
Oudeyer, Pierre-Yves ;
Gottlieb, Jacqueline .
VISION RESEARCH, 2015, 117 :81-90
[5]   The effects of task difficulty, novelty and the size of the search space on intrinsically motivated exploration [J].
Baranes, Adrien F. ;
Oudeyer, Pierre-Yves ;
Gottlieb, Jacqueline .
FRONTIERS IN NEUROSCIENCE, 2014, 8
[6]   Intrinsic Valuation of Information in Decision Making under Uncertainty [J].
Bennett, Daniel ;
Bode, Stefan ;
Brydevall, Maja ;
Warren, Hayley ;
Murawski, Carsten .
PLOS COMPUTATIONAL BIOLOGY, 2016, 12 (07)
[7]   NOVELTY AND CURIOSITY AS DETERMINANTS OF EXPLORATORY BEHAVIOUR [J].
Berlyne, D. E. .
BRITISH JOURNAL OF PSYCHOLOGY-GENERAL SECTION, 1950, 41 :68-80
[8]  
Berlyne Daniel E, 1960, CONFLICT AROUSAL CUR, DOI DOI 10.1037/11164-000
[9]   CURIOSITY AND EXPLORATION [J].
BERLYNE, DE .
SCIENCE, 1966, 153 (3731) :25-&
[10]   Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems [J].
Bubeck, Sebastien ;
Cesa-Bianchi, Nicolo .
FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2012, 5 (01) :1-122