Polynomial-based radial basis function neural networks (P-RBF NNs) realized with the aid of particle swarm optimization

被引:60
作者
Oh, Sung-Kwun [1 ]
Kim, Wook-Dong [1 ]
Pedrycz, Witold [2 ,3 ]
Park, Byoung-Jun [4 ]
机构
[1] Univ Suwon, Dept Elect Engn, Hwaseong Si, Gyeonggi Do, South Korea
[2] Univ Alberta, Dept Elect & Comp Engn, Edmonton, AB T6R 2G7, Canada
[3] Polish Acad Sci, Inst Syst Sci, Warsaw, Poland
[4] ETRI, IT Convergence Technol Res Lab, Telemat & USN Res Dept, Spatial Informat Res Team, Taejon 305350, South Korea
关键词
Polynomial neural networks; Radial basis function neural networks; Pattern classification; Fuzzy clustering; Particle swarm optimization; FACE RECOGNITION; CLASSIFICATION; DESIGN;
D O I
10.1016/j.fss.2010.08.007
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this study, we design polynomial-based radial basis function neural networks (P-RBF NNs) based on a fuzzy inference mechanism. The essential design parameters (including learning rate. momentum coefficient and fuzzification coefficient of the underlying clustering method) are optimized by means of the particle swarm optimization. The proposed P-RBF NNs dwell upon structural findings about training data that are expressed in terms of a partition matrix resulting from fuzzy clustering in this case being the fuzzy C-means (FCM). The network is of functional nature as the weights between the hidden layer and the output are some polynomials. The use of the polynomial weights becomes essential in capturing the nonlinear nature of data encountered in regression or classification problems. From the perspective of linguistic interpretation, the proposed network can be expressed as a collection of "if-then" fuzzy rules. The architecture of the networks discussed here embraces three functional modules reflecting the three phases of input output mapping realized in rule-based architectures, namely condition formation, conclusion creation, and aggregation. The proposed classifier is applied to some synthetic and machine learning datasets, and its results are compared with those reported in the previous studies. (C) 2010 Elsevier B.V. All rights reserved.
引用
收藏
页码:54 / 77
页数:24
相关论文
共 36 条
[11]  
Er MJ, 2002, IEEE T NEURAL NETWOR, V13, P697, DOI 10.1109/TNN.2002.1000134
[12]   A particle swarm optimization approach for optimum design of PID controller in AVR system [J].
Gaing, ZL .
IEEE TRANSACTIONS ON ENERGY CONVERSION, 2004, 19 (02) :384-391
[13]  
Goncalves L. B., 2005, IEEE T SYSTEMS MAN C, V26
[14]  
Hassoun MH., 1995, FUNDAMENTALS ARTIFIC
[15]   Fuzzy partitioning with FID3.1 [J].
Janikow, CZ ;
Fajfer, M .
18TH INTERNATIONAL CONFERENCE OF THE NORTH AMERICAN FUZZY INFORMATION PROCESSING SOCIETY - NAFIPS, 1999, :467-471
[16]   Zero-order TSK-type fuzzy system learning using a two-phase swarm intelligence algorithm [J].
Juang, Chia-Feng ;
Lo, Chiang .
FUZZY SETS AND SYSTEMS, 2008, 159 (21) :2910-2926
[17]   The particle swarm: Social adaptation of knowledge [J].
Kennedy, J .
PROCEEDINGS OF 1997 IEEE INTERNATIONAL CONFERENCE ON EVOLUTIONARY COMPUTATION (ICEC '97), 1997, :303-308
[18]  
Kennedy J, 1995, 1995 IEEE INTERNATIONAL CONFERENCE ON NEURAL NETWORKS PROCEEDINGS, VOLS 1-6, P1942, DOI 10.1109/icnn.1995.488968
[19]  
KLAWONN F, 1995, P FUZZ NEUR SYST 95, P223
[20]  
Kotsiantis SB, 2005, INFORM-J COMPUT INFO, V29, P53