Information-seeking, curiosity, and attention: computational and neural mechanisms

被引:448
作者
Gottlieb, Jacqueline [1 ,2 ]
Oudeyer, Pierre-Yves [3 ,4 ]
Lopes, Manuel [3 ,4 ]
Baranes, Adrien [1 ]
机构
[1] Columbia Univ, Dept Neurosci, New York, NY 10027 USA
[2] Columbia Univ, Kavli Inst Brain Sci, New York, NY USA
[3] Inria, Bordeaux, France
[4] Ensta ParisTech, Paris, France
关键词
EYE-HAND COORDINATION; REINFORCEMENT; EXPLORATION; ROBOTICS; MOTIVATION; MOVEMENTS; SALIENCE;
D O I
10.1016/j.tics.2013.09.001
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Intelligent animals devote much time and energy to exploring and obtaining information, but the underlying mechanisms are poorly understood. We review recent developments on this topic that have emerged from the traditionally separate fields of machine learning, eye movements in natural behavior, and studies of curiosity in psychology and neuroscience. These studies show that exploration may be guided by a family of mechanisms that range from automatic biases toward novelty or surprise to systematic searches for learning progress and information gain in curiosity-driven behavior. In addition, eye movements reflect visual information searching in multiple conditions and are amenable for cellular-level investigations. This suggests that the oculomotor system is an excellent model system for understanding information-sampling mechanisms.
引用
收藏
页码:585 / 593
页数:9
相关论文
共 89 条
[1]  
[Anonymous], NEUROMORPHIC BRAIN B
[2]  
[Anonymous], 2012, INT JOINT C NEUR NET, DOI DOI 10.1109/IJCNN.2012.6252824
[3]  
[Anonymous], 2013, INTRINSICALLY MOTIVA, DOI DOI 10.1007/978-3-6
[4]  
[Anonymous], 2013, Intrinsically Motivated Learning in Natural and Artificial Systems, DOI DOI 10.1007/978-3-642-32375-1_13
[5]  
[Anonymous], 2009, Vision Res., DOI [DOI 10.1016/J.VISRES.2008.09.007, 10.1016/j.visres.2008.09.007]
[6]   Cognitive Developmental Robotics: A Survey [J].
Asada, Minoru ;
Hosoda, Koh ;
Kuniyoshi, Yasuo ;
Ishiguro, Hiroshi ;
Inui, Toshio ;
Yoshikawa, Yuichiro ;
Ogino, Masaki ;
Yoshida, Chisato .
IEEE TRANSACTIONS ON AUTONOMOUS MENTAL DEVELOPMENT, 2009, 1 (01) :12-34
[7]   Knowing how much you don't know: a neural organization of uncertainty estimates [J].
Bach, Dominik R. ;
Dolan, Raymond J. .
NATURE REVIEWS NEUROSCIENCE, 2012, 13 (08) :572-586
[8]  
Baldassarre G., 2013, INTRINSICALLY MOTIVA
[9]   Active learning of inverse models with intrinsically motivated goal exploration in robots [J].
Baranes, Adrien ;
Oudeyer, Pierre-Yves .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2013, 61 (01) :49-73
[10]  
Berlyne D. E., 1960, CONFLICT AROUSAL CUR, DOI DOI 10.1037/11164-000