Uncertainty and learning

被引:46
作者
Dayan, P [1 ]
Yu, AJ [1 ]
机构
[1] UCL, Gatsby Computat Neurosci Unit, London WC1N 3AR, England
基金
美国国家科学基金会;
关键词
learning; uncertainty; attention; Kalman filter; neuromodulation; acetylcholine; norepinephrine;
D O I
10.1080/03772063.2003.11416335
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
It is a commonplace in statistics that uncertainty about parameters drives learning. Indeed one of them most influential models of behavioural learning has uncertainty at its heart. However, many popular theoretical models of learning focus exclusively on error, and ignore uncertainty. Here we review the links between learning and uncertainty from three perspectives: statistical theories such as the Kalman filter, psychological models in which differential attention is paid to stimuli with an effect on the speed of learning associated with those stimuli, and neurobiological data on the influence of the neuromodulators; acetylcholine and norepinephrine on learning and inference.
引用
收藏
页码:171 / 181
页数:11
相关论文
共 57 条
[21]   Disconnection of the amygdala central nucleus and substantia innominata/nucleus basalis disrupts increments in conditioned stimulus processing in rats [J].
Han, JS ;
Holland, PC ;
Gallagher, M .
BEHAVIORAL NEUROSCIENCE, 1999, 113 (01) :143-151
[22]   Noradrenergic suppression of synaptic transmission may influence cortical signal-to-noise ratio [J].
Hasselmo, ME ;
Linster, C ;
Patil, M ;
Ma, D ;
Cekic, M .
JOURNAL OF NEUROPHYSIOLOGY, 1997, 77 (06) :3326-3339
[23]   Suppression of synaptic transmission may allow combination of associative feedback and self-organizing feedforward connections in the neocortex [J].
Hasselmo, ME ;
Cekic, M .
BEHAVIOURAL BRAIN RESEARCH, 1996, 79 (1-2) :153-161
[24]   NEUROMODULATION AND CORTICAL FUNCTION - MODELING THE PHYSIOLOGICAL-BASIS OF BEHAVIOR [J].
HASSELMO, ME .
BEHAVIOURAL BRAIN RESEARCH, 1995, 67 (01) :1-27
[25]  
Hinton G., 1999, FDN NEURAL COMPUTATI
[26]   Brain mechanisms for changes in processing of conditioned stimuli in Pavlovian conditioning: Implications for behavior theory [J].
Holland, PC .
ANIMAL LEARNING & BEHAVIOR, 1997, 25 (04) :373-399
[27]   Amygdala circuitry in attentional and representational processes [J].
Holland, PC ;
Gallagher, M .
TRENDS IN COGNITIVE SCIENCES, 1999, 3 (02) :65-73
[28]   EXCITATION AND INHIBITION IN UNBLOCKING [J].
HOLLAND, PC .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-ANIMAL BEHAVIOR PROCESSES, 1988, 14 (03) :261-279
[29]   Differential modulation of auditory thalamocortical and intracortical synaptic transmission by cholinergic agonist [J].
Hsieh, CY ;
Cruikshank, SJ ;
Metherate, R .
BRAIN RESEARCH, 2000, 880 (1-2) :51-64
[30]   Acquisition and extinction in autoshaping [J].
Kakade, S ;
Dayan, P .
PSYCHOLOGICAL REVIEW, 2002, 109 (03) :533-544