Neurocomputational models of basal ganglia function in learning, memory and choice

被引:155
|
作者
Cohen, Michael X. [1 ]
Frank, Michael J. [1 ]
机构
[1] Univ Arizona, Dept Psychol, Program Neurosci, Tucson, AZ 85721 USA
关键词
Basal ganglia; Computational model; Dopamine; Reinforcement learning; Decision making; LONG-TERM POTENTIATION; MEDIUM SPINY NEURONS; TEMPORAL DIFFERENCE MODELS; HIGH-FREQUENCY STIMULATION; DEEP BRAIN-STIMULATION; SUBTHALAMIC NUCLEUS; DECISION-MAKING; PARKINSONS-DISEASE; L-DOPA; FRONTAL-CORTEX;
D O I
10.1016/j.bbr.2008.09.029
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
The basal ganglia (BG) are critical for the coordination of several motor, cognitive, and emotional functions and become dysfunctional in several pathological states ranging from Parkinson's disease to Schizophrenia. Here we review principles developed within a neurocomputational framework of BG and related circuitry which provide insights into their functional roles in behavior. We focus on two classes of models: those that incorporate aspects of biological realism and constrained by functional principles, and more abstract mathematical models focusing on the higher level computational goals of the BG. While the former are arguably more "realistic", the latter have a complementary advantage in being able to describe functional principles of how the system works in a relatively simple set of equations, but are less suited to making specific hypotheses about the roles of specific nuclei and neurophysiological processes. We review the basic architecture and assumptions of these models, their relevance to our understanding of the neurobiological and cognitive functions of the BG, and provide an update on the potential roles of biological details not explicitly incorporated in existing models. Empirical studies ranging from those in transgenic mice to dopaminergic manipulation, deep brain stimulation, and genetics in humans largely support model predictions and provide the basis for further refinement. Finally, we discuss possible future directions and possible ways to integrate different types of models. (C) 2008 Elsevier B.V. All rights reserved.
引用
收藏
页码:141 / 156
页数:16
相关论文
共 50 条
  • [31] Brain substrates for automatic retrieval of value memory in the primate basal ganglia
    Hyoung F. Kim
    Molecular Brain, 14
  • [32] The Role of Basal Ganglia Reinforcement Learning in Lexical Ambiguity Resolution
    Ceballos, Jose M.
    Stocco, Andrea
    Prat, Chantel S.
    TOPICS IN COGNITIVE SCIENCE, 2020, 12 (01) : 402 - 416
  • [33] Glutamatergic Mediation of Procedural Skill Learning and Basal Ganglia Function
    Zangl, Maria
    Geiger, Lena
    Schaefer, Axel
    Zang, Zhenxiang
    Wolf, Isabella
    Ruf, Matthias
    Reis, Janine
    Meyer-Lindenberg, Andreas
    Ende, Gabriele
    Tost, Heike
    BIOLOGICAL PSYCHIATRY, 2014, 75 (09) : 105S - 105S
  • [34] A Motor Learning Model Based on the Basal Ganglia in Operant Conditioning
    Gao, Yuanyuan
    Song, Hongjun
    26TH CHINESE CONTROL AND DECISION CONFERENCE (2014 CCDC), 2014, : 5236 - 5241
  • [35] A computational model of basal ganglia and its role in memory retrieval in rewarded visual memory tasks
    Vitay, Julien
    Hamker, Fred H.
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2010, 4 : 1 - 38
  • [36] Downstream mechanisms triggered by mitochondrial dysfunction in the basal ganglia: From experimental models to neurodegenerative diseases
    Gubellini, Paolo
    Picconi, Barbara
    Di Filippo, Massimiliano
    Calabresi, Paolo
    BIOCHIMICA ET BIOPHYSICA ACTA-MOLECULAR BASIS OF DISEASE, 2010, 1802 (01): : 151 - 161
  • [37] Computing reward-prediction error: an integrated account of cortical timing and basal-ganglia pathways for appetitive and aversive learning
    Morita, Kenji
    Kawaguchi, Yasuo
    EUROPEAN JOURNAL OF NEUROSCIENCE, 2015, 42 (04) : 2003 - 2021
  • [38] Modeling choice and reaction time during arbitrary visuomotor learning through the coordination of adaptive working memory and reinforcement learning
    Viejo, Guillaume
    Khamassi, Mehdi
    Brovelli, Andrea
    Girard, Benoit
    FRONTIERS IN BEHAVIORAL NEUROSCIENCE, 2015, 9
  • [39] Function of basal ganglia in bridging cognitive and motor modules to perform an action
    Nagano-Saito, Atsuko
    Martinu, Kristina
    Monchi, Oury
    FRONTIERS IN NEUROSCIENCE, 2014, 8
  • [40] Imaging basal ganglia function
    Brooks, DJ
    JOURNAL OF ANATOMY, 2000, 196 : 543 - 554