Initial Experiments Evolving Spiking Neural Networks with Supervised Learning Capability

被引:2
作者
Schaffer, J. David [1 ]
机构
[1] SUNY Binghamton, Inst Multigenerat Studies, Binghamton, NY 13902 USA
来源
COMPLEX ADAPTIVE SYSTEMS CONFERENCE WITH THEME: ENGINEERING CYBER PHYSICAL SYSTEMS, CAS | 2017年 / 114卷
关键词
Spiking neural networks; evolutionary computation; supervised learning; ReSuMe; Hebbian learning; spike time dependent plasticity; tonic burster;
D O I
10.1016/j.procs.2017.09.034
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There is currently much research activity aimed at synaptic plasticity methods for spiking neural networks. While many methods have been proposed, there are few that provide for supervised learning. A fundamental premise of the work reported here is that the network topology is key to defining the network's capabilities: the topology IS the algorithm. Hence, learning at the level of the whole network is an emergent phenomenon of the learning mechanism operating on individual synapses and the topology. Therefore, the topology and the learning mechanism(s) must be designed together, and evolutionary computation (EC) is a suitable technology for this. We report on initial experiments on a relatively simple test problem, the tonic burster, using several types of learning including supervised. We see that EC can locate seemingly good solutions that actually do not solve the desired task; they "cheat" by simply exploiting the supervisory signals. A simple modification of the train-test protocol can solve this. We introduce an approach we call "artificial neurology" for systematically examining the behaviour of a SNN in order to understand how it achieves its performance. Experiments indicate that a combination of Hebbian and supervised learning works best for this task. (c) 2017 The Authors. Published by Elsevier B.V.
引用
收藏
页码:184 / 191
页数:8
相关论文
共 12 条
[1]  
Eshelman L.J., 1991, PROC FDN GENETIC ALG, V1, P265
[2]  
Hebb DO., 1949, ORG BEHAV NEUROPSYCH, P62
[3]   Spiking neural network for recognizing spatiotemporal sequences of spikes [J].
Jin, DZ .
PHYSICAL REVIEW E, 2004, 69 (02) :021905-1
[4]  
Kasinski A., 2006, International Journal of Applied Mathematics and Computer Science, V16, P101
[5]   Differential signaling via the same axon of neocortical pyramidal neurons [J].
Markram, H ;
Wang, Y ;
Tsodyks, M .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 1998, 95 (09) :5323-5328
[6]  
Ponulak F., 2009, NEURAL COMPUTATION
[7]  
Rowe J, 2004, EVOL COMPUT, V12, P47
[8]  
Schaffer J.D., 2009, GEN EV COMP C GECCO2, P2661
[9]  
Schaffer J.D., 2015, P IEEE CISDA C VER N
[10]  
Sichtig H., 2009, THESIS