Liquid computing of spiking neural network with multi-clustered and active-neuron-dominant structure

被引:8
作者
Li, Xiumin [1 ,2 ]
Liu, Hui [1 ,2 ]
Xue, Fangzheng [1 ,2 ]
Zhou, Hongjun [3 ]
Song, Yongduan [1 ,2 ]
机构
[1] Chongqing Univ, Minist Educ, Key Lab Dependable Serv Comp Cyber Phys Soc, Chongqing 400044, Peoples R China
[2] Chongqing Univ, Coll Automat, Chongqing 400044, Peoples R China
[3] Chongqing Univ, Sch Econ & Business Adm, Chongqing 400044, Peoples R China
基金
中国国家自然科学基金;
关键词
spiking neural network; liquid computing; multi-cluster; STDP; CORTICAL NETWORKS; STATE MACHINES; PERFORMANCE; PLASTICITY; SYNCHRONIZATION; CLASSIFICATION; CONNECTIVITY; COMPUTATION; PREDICTION; MODELS;
D O I
10.1016/j.neucom.2017.03.022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Liquid computing is an effective approach to intelligent computations of neural networks, especially for spiking neural networks. If the liquid network is embedded with a proper structure it can perform complex computational tasks. However, the modeling of self-organized neural networks with more biological characteristics is still an important open challenge, resulting in major constraints on improving the computational capability and dynamical diversity of the model. Here, we present a novel type of liquid computing model with both multi-clustered and active-neuron-dominant structure of spiking neural network, instead of the traditional random structure. The optimal parameter settings of the cluster number and time window size of clustering generation method had been considered. The synaptic weights in each cluster are further refined through the spike-timing-dependent plasticity rule to obtain an active neuron-dominant structure. The results show that this model has much better performance on liquid computing than the random model. The enhancement of information processing capability is achieved by improving two aspects, i.e. the activity synchrony and network sensitivity, based on the clustered structure and active-neuron-dominant structure, respectively. Statistical analysis demonstrates that both structure entropy and activity entropy of our proposed network are increased, indicating its high topological complexity and dynamical diversity. Therefore, the improvement in efficiency of signal transmission of this network is confirmed. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:155 / 165
页数:11
相关论文
共 39 条
[1]  
[Anonymous], 2001, GMD Report 148
[2]  
[Anonymous], 2002, SPIKING NEURON MODEL
[3]   Spike timing-dependent plasticity: A Hebbian learning rule [J].
Caporale, Natalia ;
Dan, Yang .
ANNUAL REVIEW OF NEUROSCIENCE, 2008, 31 :25-46
[4]  
Galla T., 2006, J PHYS A, V39, P3849
[5]  
Hausler S., 2003, Complexity, V8, P39, DOI 10.1002/cplx.10089
[6]   Topological constraints and robustness in liquid state machines [J].
Hazan, Hananel ;
Manevitz, Larry M. .
EXPERT SYSTEMS WITH APPLICATIONS, 2012, 39 (02) :1597-1606
[7]   Use of the separation property to derive Liquid State Machines with enhanced classification performance [J].
Hourdakis, Emmanouil ;
Trahanias, Panos .
NEUROCOMPUTING, 2013, 107 :40-48
[8]   Simple model of spiking neurons [J].
Izhikevich, EM .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2003, 14 (06) :1569-1572
[9]  
Jaeger H., 2014, CONTROLLING RECURREN
[10]   Effects of synaptic connectivity on liquid state machine performance [J].
Ju, Han ;
Xu, Jian-Xin ;
Chong, Edmund ;
VanDongen, Antonius M. J. .
NEURAL NETWORKS, 2013, 38 :39-51