Uncertainty and learning

被引:46
作者
Dayan, P [1 ]
Yu, AJ [1 ]
机构
[1] UCL, Gatsby Computat Neurosci Unit, London WC1N 3AR, England
基金
美国国家科学基金会;
关键词
learning; uncertainty; attention; Kalman filter; neuromodulation; acetylcholine; norepinephrine;
D O I
10.1080/03772063.2003.11416335
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
It is a commonplace in statistics that uncertainty about parameters drives learning. Indeed one of them most influential models of behavioural learning has uncertainty at its heart. However, many popular theoretical models of learning focus exclusively on error, and ignore uncertainty. Here we review the links between learning and uncertainty from three perspectives: statistical theories such as the Kalman filter, psychological models in which differential attention is paid to stimuli with an effect on the speed of learning associated with those stimuli, and neurobiological data on the influence of the neuromodulators; acetylcholine and norepinephrine on learning and inference.
引用
收藏
页码:171 / 181
页数:11
相关论文
共 57 条
[1]  
Anderson B., 1979, OPTIMAL FILTERING
[2]  
Anderson JR, 1990, ADAPTIVE CHARACTER T
[3]   Role of locus coeruleus in attention and behavioral flexibility [J].
Aston-Jones, G ;
Rajkowski, J ;
Cohen, J .
BIOLOGICAL PSYCHIATRY, 1999, 46 (09) :1309-1320
[4]  
Balleine B. W., 2002, LEARNING MOTIVATION, V3
[5]  
Bucci DJ, 1998, J NEUROSCI, V18, P8038
[6]  
Carpenter G., 1991, Pattern recognition by self-organizing neural networks
[7]   Opponent interactions between serotonin and dopamine [J].
Daw, ND ;
Kakade, S ;
Dayan, P .
NEURAL NETWORKS, 2002, 15 (4-6) :603-616
[8]  
Dayan P, 2001, ADV NEUR IN, V13, P451
[9]  
Dayan P, 1998, ADV NEUR IN, V10, P117
[10]  
DAYAN P, IN PRESS NEURON