Learning from Action: Reconsidering Movement Signaling in Midbrain Dopamine Neuron Activity

被引:82
作者
Coddington, Luke T. [1 ]
Dudman, Joshua T. [1 ]
机构
[1] Howard Hughes Med Inst, Janelia Res Campus, Chevy Chase, MD 20815 USA
关键词
VENTRAL TEGMENTAL AREA; NUCLEUS-ACCUMBENS; BASAL GANGLIA; SUBSTANTIA-NIGRA; REWARD-SEEKING; ACETYLCHOLINE-RECEPTORS; SELF-STIMULATION; PREDICTION-ERROR; MONKEY MIDBRAIN; NMDA RECEPTORS;
D O I
10.1016/j.neuron.2019.08.036
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Animal infer when and where a reward is available from experience with informative sensory stimuli and their own actions. In vertebrates, this is thought to depend upon the release of dopamine from midbrain dopaminergic neurons. Studies of the role of dopamine have focused almost exclusively on their encoding of informative sensory stimuli; however, many dopaminergic neurons are active just prior to movement initiation, even in the absence of sensory stimuli. How should current frameworks for understanding the role of dopamine incorporate these observations? To address this question, we review recent anatomical and functional evidence for action-related dopamine signaling. We conclude by proposing a framework in which dopaminergic neurons encode subjective signals of action initiation to solve an internal credit assignment problem.
引用
收藏
页码:63 / 77
页数:15
相关论文
共 175 条
[61]  
Hughes R., 2019, BIORXIV, DOI [10.1101/678391, DOI 10.1101/678391]
[62]   Genetic inhibition of neurotransmission reveals role of glutamatergic input to dopamine neurons in high-effort behavior [J].
Hutchison, M. A. ;
Gu, X. ;
Adrover, M. F. ;
Lee, M. R. ;
Hnasko, T. S. ;
Alvarez, V. A. ;
Lu, W. .
MOLECULAR PSYCHIATRY, 2018, 23 (05) :1213-1225
[63]   Similar Roles of Substantia Nigra and Ventral Tegmental Dopamine Neurons in Reward and Aversion [J].
Ilango, Anton ;
Kesner, Andrew J. ;
Keller, Kristine L. ;
Stuber, Garret D. ;
Bonci, Antonello ;
Ikemoto, Satoshi .
JOURNAL OF NEUROSCIENCE, 2014, 34 (03) :817-822
[64]   Solving the distal reward problem through linkage of STDP and dopamine signaling [J].
Izhikevich, Eugene M. .
CEREBRAL CORTEX, 2007, 17 (10) :2443-2452
[65]   Visualizing Hypothalamic Network Dynamics for Appetitive and Consummatory Behaviors [J].
Jennings, Joshua H. ;
Ung, Randall L. ;
Resendez, Shanna L. ;
Stamatakis, Alice M. ;
Taylor, Johnathon G. ;
Huang, Jonathan ;
Veleta, Katie ;
Kantak, Pranish A. ;
Aita, Megumi ;
Shilling-Scrivo, Kelson ;
Ramakrishnan, Charu ;
Deisseroth, Karl ;
Otte, Stephani ;
Stuber, Garret D. .
CELL, 2015, 160 (03) :516-527
[66]   Start/stop signals emerge in nigrostriatal circuits during sequence learning [J].
Jin, Xin ;
Costa, Rui M. .
NATURE, 2010, 466 (7305) :457-462
[67]  
Kandel ER, 2012, PRINCIPLES NEURAL SC, V15th
[68]   Subsecond dopamine fluctuations in human striatum encode superposed error signals about actual and counterfactual reward [J].
Kishida, Kenneth T. ;
Saez, Ignacio ;
Lohrenz, Terry ;
Witcher, Mark R. ;
Laxton, Adrian W. ;
Tatter, Stephen B. ;
White, Jason P. ;
Ellis, Thomas L. ;
Phillips, Paul E. M. ;
Montague, P. Read .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2016, 113 (01) :200-205
[69]   The Subthalamic Nucleus Is One of Multiple Innervation Sites for Long-Range Corticofugal Axons: A Single-Axon Tracing Study in the Rat [J].
Kita, Takako ;
Kita, Hitoshi .
JOURNAL OF NEUROSCIENCE, 2012, 32 (17) :5990-5999
[70]   What, If, and When to Move: Basal Ganglia Circuits and Self-Paced Action Initiation [J].
Klaus, Andreas ;
da Silva, Joaquim Alves ;
Costa, Rui M. .
ANNUAL REVIEW OF NEUROSCIENCE, VOL 42, 2019, 42 :459-483