Representation of action-specific reward values in the striatum

被引:655
作者
Samejima, K
Ueda, Y
Doya, K
Kimura, M
机构
[1] ATR Computat Neurosci Labs, Dept Computat Neurobiol, Kyoto 6190288, Japan
[2] Kyoto Prefectural Univ Med, Dept Physiol, Kyoto 6028566, Japan
[3] Okinawa Inst Sci & Technol, Initial Res Project, Okinawa 9042234, Japan
关键词
D O I
10.1126/science.1115270
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The estimation of the reward an action will yield is critical in decision-making. To elucidate the role of the basal ganglia in this process, we recorded striatal neurons of monkeys who chose between left and right handle turns, based on the estimated reward probabilities of the actions. During a delay period before the choices, the activity of more than one-third of striatal projection neurons was selective to the values of one of the two actions. Fewer neurons were tuned to relative values or action choice. These results suggest representation of action values in the striatum, which can guide action selection in the basal ganglia circuit.
引用
收藏
页码:1337 / 1340
页数:4
相关论文
共 26 条
[1]   Independent coding of movement direction and reward prediction by single pallidal neurons [J].
Arkadir, D ;
Morris, G ;
Vaadia, E ;
Bergman, H .
JOURNAL OF NEUROSCIENCE, 2004, 24 (45) :10047-10056
[2]   Prefrontal cortex and decision making in a mixed-strategy game [J].
Barraclough, DJ ;
Conroy, ML ;
Lee, D .
NATURE NEUROSCIENCE, 2004, 7 (04) :404-410
[3]   The corticostriatal projection: From synaptic plasticity to dysfunctions of the basal ganglia [J].
Calabresi, P ;
Pisani, A ;
Mercuri, NB ;
Bernardi, G .
TRENDS IN NEUROSCIENCES, 1996, 19 (01) :19-24
[4]   Visual and anticipatory bias in three cortical eye fields of the monkey during an adaptive decision-making task [J].
Coe, B ;
Tomihara, K ;
Matsuzawa, M ;
Hikosaka, O .
JOURNAL OF NEUROSCIENCE, 2002, 22 (12) :5081-5090
[5]   Effects of expectations for different reward magnitudes on neuronal activity in primate striatum [J].
Cromwell, HC ;
Schultz, W .
JOURNAL OF NEUROPHYSIOLOGY, 2003, 89 (05) :2823-2838
[6]   Complementary roles of basal ganglia and cerebellum in learning and motor control [J].
Doya, K .
CURRENT OPINION IN NEUROBIOLOGY, 2000, 10 (06) :732-739
[7]   HIPPOCAMPUS AND CONTEXTUAL RETRIEVAL OF INFORMATION FROM MEMORY - THEORY [J].
HIRSH, R .
BEHAVIORAL BIOLOGY, 1974, 12 (04) :421-444
[8]   DISTRIBUTED MODULAR ARCHITECTURES LINKING BASAL GANGLIA, CEREBELLUM, AND CEREBRAL-CORTEX - THEIR ROLE IN PLANNING AND CONTROLLING ACTION [J].
HOUK, JC ;
WISE, SP .
CEREBRAL CORTEX, 1995, 5 (02) :95-110
[9]  
HOUK JC, 1995, MODELS INFORMATION P
[10]   Building neural representations of habits [J].
Jog, MS ;
Kubota, Y ;
Connolly, CI ;
Hillegaart, V ;
Graybiel, AM .
SCIENCE, 1999, 286 (5445) :1745-1749