A spiking neural network based on the basal ganglia functional anatomy

被引:21
作者
Baladron, Javier [1 ]
Hamker, Fred H. [1 ]
机构
[1] Tech Univ Chemnitz, Dept Comp Sci, D-09107 Chemnitz, Germany
关键词
Spiking neurons; Basal ganglia; Reinforcement learning; Cognitive modeling; Action selection; SPINY PROJECTION NEURONS; SUBTHALAMIC NUCLEUS; STRIATAL CONNECTIONS; SYNAPTIC PLASTICITY; RESPONSE-INHIBITION; COMPUTATIONAL MODEL; PARKINSONS-DISEASE; ACTION SELECTION; WORKING-MEMORY; RAT;
D O I
10.1016/j.neunet.2015.03.002
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce a splicing neural network of the basal ganglia capable of learning stimulus action associations. We model learning in the three major basal ganglia pathways, direct, indirect and hyperdirect, by spike time dependent learning and considering the amount of dopamine available (reward). Moreover, we allow to learn a cortico-thalamic pathway that bypasses the basal ganglia. As a result the system develops new functionalities for the different basal ganglia pathways: The direct pathway selects actions by disinhibiting the thalamus, the hyperdirect one suppresses alternatives and the indirect pathway learns to inhibit common mistakes. Numerical experiments show that the system is capable of learning sets of either deterministic or stochastic rules. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 54 条
[11]   Hold your horses: A dynamic computational role for the subthalamic nucleus in decision making [J].
Frank, Michael J. .
NEURAL NETWORKS, 2006, 19 (08) :1120-1136
[12]   Dynamic dopamine modulation in the basal ganglia: A neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism [J].
Frank, MJ .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2005, 17 (01) :51-72
[13]  
Fremaux N., 2013, PLOS COMPUTATIONAL B
[14]   Functional Requirements for Reward-Modulated Spike-Timing-Dependent Plasticity [J].
Fremaux, Nicolas ;
Sprekeler, Henning ;
Gerstner, Wulfram .
JOURNAL OF NEUROSCIENCE, 2010, 30 (40) :13326-13337
[15]   The Brian simulator [J].
Goodman, Dan F. M. ;
Brette, Romain .
FRONTIERS IN NEUROSCIENCE, 2009, 3 (02) :192-197
[16]   A computational model of action selection in the basal ganglia. I. A new functional anatomy [J].
Gurney, K ;
Prescott, TJ ;
Redgrave, P .
BIOLOGICAL CYBERNETICS, 2001, 84 (06) :401-410
[17]   The primate basal ganglia: parallel and integrative networks [J].
Haber, SN .
JOURNAL OF CHEMICAL NEUROANATOMY, 2003, 26 (04) :317-330
[18]   A physiologically plausible model of action selection and oscillatory activity in the basal ganglia [J].
Humphries, Mark D. ;
Stewart, Robert D. ;
Gurney, Kevin N. .
JOURNAL OF NEUROSCIENCE, 2006, 26 (50) :12921-12942
[19]   Solving the distal reward problem through linkage of STDP and dopamine signaling [J].
Izhikevich, Eugene M. .
CEREBRAL CORTEX, 2007, 17 (10) :2443-2452
[20]   Role of Striatum in Updating Values of Chosen Actions [J].
Kim, Hoseok ;
Sul, Jung Hoon ;
Huh, Namjung ;
Lee, Daeyeol ;
Jung, Min Whan .
JOURNAL OF NEUROSCIENCE, 2009, 29 (47) :14701-14712