Reward, motivation, and reinforcement learning

被引:542
作者
Dayan, P
Balleine, BW
机构
[1] UCL, Gatsby Computat Neurosci Unit, London WC1N 3AR, England
[2] Univ Calif Los Angeles, Dept Psychol, Los Angeles, CA 90095 USA
[3] Univ Calif Los Angeles, Inst Brain Res, Los Angeles, CA 90095 USA
关键词
D O I
10.1016/S0896-6273(02)00963-7
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
There is substantial evidence that dopamine is involved in reward learning and appetitive conditioning. However, the major reinforcement learning-based theoretical models of classical conditioning (crudely, prediction learning) are actually based on rules designed to explain instrumental conditioning (action learning). Extensive anatomical, pharmacological, and psychological data, particularly concerning the impact of motivational manipulations, show that these models are unreasonable. We review the data and consider the involvement of a rich collection of different neural systems in various aspects of these forms of conditioning. Dopamine plays a pivotal, but complicated, role.
引用
收藏
页码:285 / 298
页数:14
相关论文
共 119 条
[1]   FUNCTIONAL ARCHITECTURE OF BASAL GANGLIA CIRCUITS - NEURAL SUBSTRATES OF PARALLEL PROCESSING [J].
ALEXANDER, GE ;
CRUTCHER, MD .
TRENDS IN NEUROSCIENCES, 1990, 13 (07) :266-271
[2]  
[Anonymous], 1988, Dynamic Modeling in Behavioral Ecology. Monographs in Behavior and Ecology
[3]  
[Anonymous], 1967, INTEGRATIVE ACTIVITY
[4]  
BAIRD L, 1993, WLTR931146 WRIGHTP A
[5]  
BALLEINE B, 1991, Q J EXP PSYCHOL-B, V43, P279
[6]   EFFECTS OF IBOTENIC ACID LESIONS OF THE NUCLEUS-ACCUMBENS ON INSTRUMENTAL ACTION [J].
BALLEINE, B ;
KILLCROSS, S .
BEHAVIOURAL BRAIN RESEARCH, 1994, 65 (02) :181-193
[7]  
BALLEINE B, 1992, Q J EXP PSYCHOL-B, V45, P285
[8]   BENZODIAZEPINE-INDUCED OUTCOME REVALUATION AND THE MOTIVATIONAL CONTROL OF INSTRUMENTAL ACTION IN RATS [J].
BALLEINE, B ;
BALL, J ;
DICKINSON, A .
BEHAVIORAL NEUROSCIENCE, 1994, 108 (03) :573-589
[9]  
BALLEINE B, 1994, Q J EXP PSYCHOL-B, V47, P211
[10]   INSTRUMENTAL PERFORMANCE FOLLOWING A SHIFT IN PRIMARY MOTIVATION DEPENDS ON INCENTIVE LEARNING [J].
BALLEINE, B .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-ANIMAL BEHAVIOR PROCESSES, 1992, 18 (03) :236-250