A spiking neural network based on the basal ganglia functional anatomy

被引:21
作者
Baladron, Javier [1 ]
Hamker, Fred H. [1 ]
机构
[1] Tech Univ Chemnitz, Dept Comp Sci, D-09107 Chemnitz, Germany
关键词
Spiking neurons; Basal ganglia; Reinforcement learning; Cognitive modeling; Action selection; SPINY PROJECTION NEURONS; SUBTHALAMIC NUCLEUS; STRIATAL CONNECTIONS; SYNAPTIC PLASTICITY; RESPONSE-INHIBITION; COMPUTATIONAL MODEL; PARKINSONS-DISEASE; ACTION SELECTION; WORKING-MEMORY; RAT;
D O I
10.1016/j.neunet.2015.03.002
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce a splicing neural network of the basal ganglia capable of learning stimulus action associations. We model learning in the three major basal ganglia pathways, direct, indirect and hyperdirect, by spike time dependent learning and considering the amount of dopamine available (reward). Moreover, we allow to learn a cortico-thalamic pathway that bypasses the basal ganglia. As a result the system develops new functionalities for the different basal ganglia pathways: The direct pathway selects actions by disinhibiting the thalamus, the hyperdirect one suppresses alternatives and the indirect pathway learns to inhibit common mistakes. Numerical experiments show that the system is capable of learning sets of either deterministic or stochastic rules. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 54 条
[1]  
[Anonymous], FRONTIERS SYNAPTIC N
[2]  
[Anonymous], 1998, Reinforcement Learning: An Introduction
[3]   Cortical and subcortical contributions to stop signal response inhibition: Role of the subthalamic nucleus [J].
Aron, AR ;
Poldrack, RA .
JOURNAL OF NEUROSCIENCE, 2006, 26 (09) :2424-2433
[4]   Effects of STN lesions on simple vs choice reaction time tasks in the rat: preserved motor readiness, but impaired response selection [J].
Baunez, C ;
Humby, T ;
Eagle, DM ;
Ryan, LJ ;
Dunnett, SB ;
Robbins, TW .
EUROPEAN JOURNAL OF NEUROSCIENCE, 2001, 13 (08) :1609-1616
[5]   Cortico-basal ganglia-cortical circuitry in Parkinson's disease reconsidered [J].
Braak, Heiko ;
Del Tredici, Kelly .
EXPERIMENTAL NEUROLOGY, 2008, 212 (01) :226-229
[6]   Adaptive exponential integrate-and-fire model as an effective description of neuronal activity [J].
Brette, R ;
Gerstner, W .
JOURNAL OF NEUROPHYSIOLOGY, 2005, 94 (05) :3637-3642
[7]   Dopamine-mediated regulation of corticostriatal synaptic plasticity [J].
Calabresi, Paolo ;
Picconi, Barbara ;
Tozzi, Alessandro ;
Di Filippo, Massimiliano .
TRENDS IN NEUROSCIENCES, 2007, 30 (05) :211-219
[8]   A spiking neuron model of the cortico-basal ganglia circuits for goal-directed and habitual action learning [J].
Chersi, Fabian ;
Mirolli, Marco ;
Pezzulo, Giovanni ;
Baldassarre, Gianluca .
NEURAL NETWORKS, 2013, 41 :212-224
[9]   Fast synaptic transmission between striatal spiny projection neurons [J].
Czubayko, U ;
Plenz, D .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2002, 99 (24) :15764-15769
[10]   Premature responding following bilateral stimulation of the rat subthalamic nucleus is amplitude and frequency dependent [J].
Desbonnet, L ;
Temel, Y ;
Visser-Vandewalle, V ;
Blokland, A ;
Hornikx, V ;
Steinbusch, HWM .
BRAIN RESEARCH, 2004, 1008 (02) :198-204