Cooperative learning for radial basis function networks using particle swarm optimization

被引:51
作者
Alexandridis, Alex [1 ]
Chondrodima, Eva [1 ,2 ]
Sarimveis, Haralambos [2 ]
机构
[1] Technol Educ Inst Athens Agiou Spiridonos, Dept Elect Engn, Aigaleo 12210, Greece
[2] Natl Tech Univ Athens, Sch Chem Engn, 9 Heroon Polytechniou Str, Zografos 15780, Greece
关键词
Cooperative learning; Cooperative swarms; Neural networks; Particle swarm optimization; Radial basis function; FUNCTION NEURAL-NETWORKS; NONSYMMETRIC PARTITION; INPUT SPACE; ALGORITHM; MODEL; AID; CLASSIFICATION; DESIGN; PSO;
D O I
10.1016/j.asoc.2016.08.032
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a new evolutionary cooperative learning scheme, able to solve function approximation and classification problems with improved accuracy and generalization capabilities. The proposed method optimizes the construction of radial basis function (RBF) networks, based on a cooperative particle swarm optimization (CPSO) framework. It allows for using variable-width basis functions, which increase the flexibility of the produced models, while performing full network optimization by concurrently determining the rest of the RBF parameters, namely center locations, synaptic weights and network size. To avoid the excessive number of design variables, which hinders the optimization task, a compact representation scheme is introduced, using two distinct swarms. The first swarm applies the non-symmetric fuzzy means algorithm to calculate the network structure and RBF kernel center coordinates, while the second encodes the basis function widths by introducing a modified neighbor coverage heuristic. The two swarms work together in a cooperative way, by exchanging information towards discovering improved RBF network configurations, whereas a suitably tailored reset operation is incorporated to help avoid stagnation. The superiority of the proposed scheme is illustrated through implementation in a wide range of benchmark problems, and comparison with alternative approaches. (C) 2016 Elsevier B.V. All rights reserved.
引用
收藏
页码:485 / 497
页数:13
相关论文
共 44 条
[1]   Multiobjective PSO based adaption of neural network topology for pixel classification in satellite imagery [J].
Agrawal, Rajesh K. ;
Bawane, Narendra G. .
APPLIED SOFT COMPUTING, 2015, 28 :217-225
[2]   A new algorithm for online structure and parameter adaptation of RBF networks [J].
Alexandridis, A ;
Sarimveis, H ;
Bafas, G .
NEURAL NETWORKS, 2003, 16 (07) :1003-1017
[3]   Radial Basis Function Network Training Using a Nonsymmetric Partition of the Input Space and Particle Swarm Optimization [J].
Alexandridis, Alex ;
Chondrodima, Eva ;
Sarimveis, Haralambos .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2013, 24 (02) :219-230
[4]   A Radial Basis Function network training algorithm using a non-symmetric partition of the input space - Application to a Model Predictive Control configuration [J].
Alexandridis, Alex ;
Sarimveis, Haralambos ;
Ninos, Konstantinos .
ADVANCES IN ENGINEERING SOFTWARE, 2011, 42 (10) :830-837
[5]  
Asuncion A., 2007, Uci machine learning repository
[6]   A hybrid evolutionary dynamic neural network for stock market trend analysis and prediction using unscented Kalman filter [J].
Bisoi, Ranjeeta ;
Dash, P. K. .
APPLIED SOFT COMPUTING, 2014, 19 :41-56
[7]   Crossover-based local search in cooperative co-evolutionary feedforward neural networks [J].
Chandra, Rohitash ;
Frean, Marcus ;
Zhang, Mengjie .
APPLIED SOFT COMPUTING, 2012, 12 (09) :2924-2932
[8]   Cooperative coevolution of Elman recurrent neural networks for chaotic time series prediction [J].
Chandra, Rohitash ;
Zhang, Mengjie .
NEUROCOMPUTING, 2012, 86 :116-123
[9]  
Darken C., 1990, IJCNN International Joint Conference on Neural Networks (Cat. No.90CH2879-5), P233, DOI 10.1109/IJCNN.1990.137720
[10]   A cooperative coevolutionary algorithm for the Multi-Depot Vehicle Routing Problem [J].
de Oliveira, Fernando Bernardes ;
Enayatifar, Rasul ;
Sadaei, Hossein Javedani ;
Guimaraes, Frederico Gadelha ;
Potvin, Jean-Yves .
EXPERT SYSTEMS WITH APPLICATIONS, 2016, 43 :117-130