Components and characteristics of the dopamine reward utility signal

被引:26
作者
Stauffer, William R. [1 ]
Lak, Armin [1 ]
Kobayashi, Shunsuke [1 ]
Schultz, Wolfram [1 ]
机构
[1] Univ Cambridge, Dept Physiol Dev & Neurosci, Cambridge CB2 3DY, England
基金
欧洲研究理事会; 英国惠康基金; 美国国家卫生研究院;
关键词
stimulus components; subjective value; temporal discounting; utility; risk; neuroeconomics; VENTRAL TEGMENTAL AREA; SUBSTANTIA-NIGRA; RECEPTOR ACTIVATION; TEMPORAL DYNAMICS; PREFRONTAL CORTEX; MONKEY MIDBRAIN; VISUAL-STIMULI; NEURONS; RESPONSES; DECISION;
D O I
10.1002/cne.23880
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Rewards are defined by their behavioral functions in learning (positive reinforcement), approach behavior, economic choices, and emotions. Dopamine neurons respond to rewards with two components, similar to higher order sensory and cognitive neurons. The initial, rapid, unselective dopamine detection component reports all salient environmental events irrespective of their reward association. It is highly sensitive to factors related to reward and thus detects a maximal number of potential rewards. It also senses aversive stimuli but reports their physical impact rather than their aversiveness. The second response component processes reward value accurately and starts early enough to prevent confusion with unrewarded stimuli and objects. It codes reward value as a numeric, quantitative utility prediction error, consistent with formal concepts of economic decision theory. Thus, the dopamine reward signal is fast, highly sensitive and appropriate for driving and updating economic decisions. J. Comp. Neurol. 524:1699-1711, 2016. (c) 2015 Wiley Periodicals, Inc.
引用
收藏
页码:1699 / 1711
页数:13
相关论文
共 94 条
  • [1] Basolateral amygdala neurons facilitate reward-seeking behavior by exciting nucleus accumbens neurons
    Ambroggi, Frederic
    Ishikawa, Alkinori
    Fields, Howard L.
    Nicola, Saleem M.
    [J]. NEURON, 2008, 59 (04) : 648 - 661
  • [2] [Anonymous], THEORY GAMES EC BEHA
  • [3] [Anonymous], P NATL ACAD SCI US
  • [4] Role of the Primate Ventral Tegmental Area in Reinforcement and Motivation
    Arsenault, John T.
    Rima, Samy
    Stemmann, Heiko
    Vanduffel, Wim
    [J]. CURRENT BIOLOGY, 2014, 24 (12) : 1347 - 1353
  • [5] EXPOSITION OF A NEW THEORY ON THE MEASUREMENT OF RISK
    Bernoulli, Daniel
    [J]. ECONOMETRICA, 1954, 22 (01) : 23 - 36
  • [6] AVERSIVE STIMULUS DIFFERENTIALLY TRIGGERS SUBSECOND DOPAMINE RELEASE IN REWARD REGIONS
    Budygin, E. A.
    Park, J.
    Bass, C. E.
    Grinevich, V. P.
    Bonin, K. D.
    Wightman, R. M.
    [J]. NEUROSCIENCE, 2012, 201 : 331 - 337
  • [7] BEHAVIORAL ENHANCEMENT OF VISUAL RESPONSES IN MONKEY CEREBRAL-CORTEX .1. MODULATION IN POSTERIOR PARIETAL CORTEX RELATED TO SELECTIVE VISUAL-ATTENTION
    BUSHNELL, MC
    GOLDBERG, ME
    ROBINSON, DL
    [J]. JOURNAL OF NEUROPHYSIOLOGY, 1981, 46 (04) : 755 - 772
  • [8] AN EMPIRICAL DEMONSTRATION OF RISK-SENSITIVE FORAGING PREFERENCES
    CARACO, T
    MARTINDALE, S
    WHITTAM, TS
    [J]. ANIMAL BEHAVIOUR, 1980, 28 (AUG) : 820 - 830
  • [9] Dopamine Neurons Control Striatal Cholinergic Neurons via Regionally Heterogeneous Dopamine and Glutamate Signaling
    Chuhma, Nao
    Mingote, Susana
    Moore, Holly
    Rayport, Stephen
    [J]. NEURON, 2014, 81 (04) : 901 - 912
  • [10] Neuron-type-specific signals for reward and punishment in the ventral tegmental area
    Cohen, Jeremiah Y.
    Haesler, Sebastian
    Vong, Linh
    Lowell, Bradford B.
    Uchida, Naoshige
    [J]. NATURE, 2012, 482 (7383) : 85 - U109