Neurocomputational models of basal ganglia function in learning, memory and choice

被引:155
|
作者
Cohen, Michael X. [1 ]
Frank, Michael J. [1 ]
机构
[1] Univ Arizona, Dept Psychol, Program Neurosci, Tucson, AZ 85721 USA
关键词
Basal ganglia; Computational model; Dopamine; Reinforcement learning; Decision making; LONG-TERM POTENTIATION; MEDIUM SPINY NEURONS; TEMPORAL DIFFERENCE MODELS; HIGH-FREQUENCY STIMULATION; DEEP BRAIN-STIMULATION; SUBTHALAMIC NUCLEUS; DECISION-MAKING; PARKINSONS-DISEASE; L-DOPA; FRONTAL-CORTEX;
D O I
10.1016/j.bbr.2008.09.029
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
The basal ganglia (BG) are critical for the coordination of several motor, cognitive, and emotional functions and become dysfunctional in several pathological states ranging from Parkinson's disease to Schizophrenia. Here we review principles developed within a neurocomputational framework of BG and related circuitry which provide insights into their functional roles in behavior. We focus on two classes of models: those that incorporate aspects of biological realism and constrained by functional principles, and more abstract mathematical models focusing on the higher level computational goals of the BG. While the former are arguably more "realistic", the latter have a complementary advantage in being able to describe functional principles of how the system works in a relatively simple set of equations, but are less suited to making specific hypotheses about the roles of specific nuclei and neurophysiological processes. We review the basic architecture and assumptions of these models, their relevance to our understanding of the neurobiological and cognitive functions of the BG, and provide an update on the potential roles of biological details not explicitly incorporated in existing models. Empirical studies ranging from those in transgenic mice to dopaminergic manipulation, deep brain stimulation, and genetics in humans largely support model predictions and provide the basis for further refinement. Finally, we discuss possible future directions and possible ways to integrate different types of models. (C) 2008 Elsevier B.V. All rights reserved.
引用
收藏
页码:141 / 156
页数:16
相关论文
共 50 条
  • [1] Basal Ganglia Models for Autonomous Behavior Learning
    Tsujino, Hiroshi
    Takeuchi, Johane
    Shouno, Osamu
    CREATING BRAIN-LIKE INTELLIGENCE: FROM BASIC PRINCIPLES TO COMPLEX INTELLIGENT SYSTEMS, 2009, 5436 : 328 - 350
  • [2] Reassessing Models of Basal Ganglia Function and Dysfunction
    Nelson, Alexandra B.
    Kreitzer, Anatol C.
    ANNUAL REVIEW OF NEUROSCIENCE, VOL 37, 2014, 37 : 117 - 135
  • [3] On the Role of Cortex-Basal Ganglia Interactions for Category Learning: A Neurocomputational Approach
    Villagrasa, Francesc
    Baladron, Javier
    Vitay, Julien
    Schroll, Henning
    Antzoulatos, Evan G.
    Miller, Earl K.
    Hamker, Fred H.
    JOURNAL OF NEUROSCIENCE, 2018, 38 (44) : 9551 - 9562
  • [4] Time representation in reinforcement learning models of the basal ganglia
    Gershman, Samuel J.
    Moustafa, Ahmed A.
    Ludvig, Elliot A.
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2014, 7
  • [5] A Biologically Plausible Action Selection System for Cognitive Architectures: Implications of Basal Ganglia Anatomy for Learning and Decision-Making Models
    Stocco, Andrea
    COGNITIVE SCIENCE, 2018, 42 (02) : 457 - 490
  • [6] Contributions of the basal ganglia to action sequence learning and performance
    Garr, Eric
    NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2019, 107 : 279 - 295
  • [7] Update on models of basal ganglia function and dysfunction
    DeLong, Mahlon
    Wichmann, Thomas
    PARKINSONISM & RELATED DISORDERS, 2009, 15 : S237 - S240
  • [8] Learning and memory functions of the basal ganglia
    Packard, MG
    Knowlton, BJ
    ANNUAL REVIEW OF NEUROSCIENCE, 2002, 25 : 563 - 593
  • [9] Computational models of the basal ganglia
    Gillies, A
    Arbuthnott, G
    MOVEMENT DISORDERS, 2000, 15 (05) : 762 - 770
  • [10] The role of the basal ganglia in learning and memory: Neuropsychological studies
    Grahn, Jessica A.
    Parkinson, John A.
    Owen, Adrian M.
    BEHAVIOURAL BRAIN RESEARCH, 2009, 199 (01) : 53 - 60