Neural systems implicated in delayed and probabilistic reinforcement

被引：239

作者：

Cardinal, Rudolf N.

机构：

[1] Univ Cambridge, Dept Expt Psychol, Cambridge CB2 3EB, England

[2] Cambridge Univ Hosp NHS Fdn, Addenbrookes Hosp, Cambridge CB2 2QQ, England

来源：

NEURAL NETWORKS | 2006年 / 19卷 / 08期

基金：

英国惠康基金; 英国医学研究理事会;

关键词：

delay; uncertainty; risk; impulsivity; instrumental conditioning; rat;

D O I：

10.1016/j.neunet.2006.03.004

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

This review considers the theoretical problems facing agents that must learn and choose on the basis of reward or reinforcement that is uncertain or delayed, in implicit or procedural (stimulus-response) representational systems and in explicit or declarative (action-outcome-value) representational systems. Individual differences in sensitivity to delays and uncertainty may contribute to impulsivity and risk taking. Learning and choice with delayed and uncertain reinforcement are related but in some cases dissociable processes. The contributions to delay and uncertainty discounting of neuromodulators including serotonin, dopamine, and noradrenaline, and of specific neural structures including the nucleus accumbens core, nucleus accumbens shell, orbitofrontal cortex, basolateral amygdala, anterior cingulate cortex, medial prefrontal (prelimbic/infralimbic) cortex, insula, subthalamic nucleus, and hippocampus are examined. (c) 2006 Elsevier Ltd. All rights reserved.

引用

页码：1277 / 1301

页数：25

共 373 条

[1]

Aggleton J.P., 2000, AMYGDALA FUNCTIONAL, V2nd

[2] SPECIOUS REWARD - BEHAVIORAL THEORY OF IMPULSIVENESS AND IMPULSE CONTROL [J].