Behavioral theories and the neurophysiology of reward

被引:978
作者
Schultz, W [1 ]
机构
[1] Univ Cambridge, Dept Anat, Cambridge CB2 3DY, England
基金
英国医学研究理事会; 英国惠康基金;
关键词
learning theory; conditioning; microeconomics; utility theory; uncertainty;
D O I
10.1146/annurev.psych.56.091103.070229
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The functions of rewards are based primarily on their effects on behavior and are less directly governed by the physics and chemistry of input events as in sensory systems. Therefore, the investigation of neural mechanisms underlying reward functions requires behavioral theories that can conceptualize the different effects of rewards on behavior. The scientific investigation of behavioral processes by animal learning theory and economic utility theory has produced a theoretical framework that can help to elucidate the neural correlates for reward functions in learning, goal-directed approach behavior, and decision making under uncertainty. Individual neurons can be studied in the reward systems of the brain, including dopamine neurons, orbitofrontal cortex, and striatum. The neural activity can be related to basic theoretical terms of reward and uncertainty, such as contiguity, contingency, prediction error, magnitude, probability, expected value, and variance.
引用
收藏
页码:87 / 115
页数:37
相关论文
共 94 条
[1]   Reward-predicting and reward-detecting neuronal activity in the primate supplementary eye field [J].
Amador, N ;
Schlag-Rey, M ;
Schlag, J .
JOURNAL OF NEUROPHYSIOLOGY, 2000, 84 (04) :2166-2170
[2]  
AOSAKI T, 1994, J NEUROSCI, V14, P3969
[3]   NEURONAL-ACTIVITY IN MONKEY STRIATUM RELATED TO THE EXPECTATION OF PREDICTABLE ENVIRONMENTAL EVENTS [J].
APICELLA, P ;
SCARNATI, E ;
LJUNGBERG, T ;
SCHULTZ, W .
JOURNAL OF NEUROPHYSIOLOGY, 1992, 68 (03) :945-960
[4]  
APICELLA P, 1991, EXP BRAIN RES, V85, P491
[5]   Independent coding of movement direction and reward prediction by single pallidal neurons [J].
Arkadir, D ;
Morris, G ;
Vaadia, E ;
Bergman, H .
JOURNAL OF NEUROSCIENCE, 2004, 24 (45) :10047-10056
[6]   Goal-directed instrumental action: contingency and incentive learning and their cortical substrates [J].
Balleine, BW ;
Dickinson, A .
NEUROPHARMACOLOGY, 1998, 37 (4-5) :407-419
[7]   Prefrontal cortex and decision making in a mixed-strategy game [J].
Barraclough, DJ ;
Conroy, ML ;
Lee, D .
NATURE NEUROSCIENCE, 2004, 7 (04) :404-410
[8]   EXPOSITION OF A NEW THEORY ON THE MEASUREMENT OF RISK [J].
Bernoulli, Daniel .
ECONOMETRICA, 1954, 22 (01) :23-36
[9]   Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards [J].
Bowman, EM ;
Aigner, TG ;
Richmond, BJ .
JOURNAL OF NEUROPHYSIOLOGY, 1996, 75 (03) :1061-1073
[10]   Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex [J].
Critchley, HD ;
Rolls, ET .
JOURNAL OF NEUROPHYSIOLOGY, 1996, 75 (04) :1673-1686