The design methodology of radial basis function neural networks based on fuzzy K-nearest neighbors approach

被引:20
作者
Roh, Seok-Beom [2 ]
Ahn, Tae-Chon [2 ]
Pedrycz, Witold [1 ,3 ]
机构
[1] Univ Alberta, Dept Elect & Comp Engn, Edmonton, AB T6G 2G7, Canada
[2] Wonkwang Univ, Dept Elect & Control Engn, Iksan 570749, Chon Buk, South Korea
[3] Polish Acad Sci, Syst Res Inst, PL-01447 Warsaw, Poland
关键词
Classification; Fuzzy K-NN; Auxiliary information granules; Supervised clustering; Cluster homogeneity; LEARNING ALGORITHM; LOGIC SYSTEMS; RBF NETWORKS; RULE-BASE; C-MEANS; INFERENCE; CLASSIFICATION; IDENTIFICATION; APPROXIMATION;
D O I
10.1016/j.fss.2009.10.014
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Various approaches to partitioning of high-dimensional input space have been studied with the intent of developing homogeneous clusters formed over input and output spaces of variables encountered in system modeling. In this study, we propose a new design methodology of a fuzzy model where the input space is partitioned by making use of sonic classification algorithm, especially, fuzzy K-nearest neighbors (K-NN) classifier being guided by some auxiliary information granules formed in the output space. This classifier being regarded in the context of this design as a supervision mechanism is used to capture the distribution of data over the output space. This type of supervision is beneficial when developing the structure in the input space. It is demonstrated that data involved in a partition constructed by the fuzzy K-NN method realized in the input space show a high level of homogeneity with regard to the data present in the output space. This enhances the performance of the fuzzy rule-based model whose premises in the rules involve partitions formed by the fuzzy K-NN. The design is illustrated with the aid of numeric examples that also provide a detailed insight into the performance of the fuzzy models and quantify several crucial design issues. (C) 2009 Elsevier B.V. All rights reserved.
引用
收藏
页码:1803 / 1822
页数:20
相关论文
共 36 条
[1]  
Bishop CM., 1995, NEURAL NETWORKS PATT
[2]   Extraction of fuzzy rules from support vector machines [J].
Castro, J. L. ;
Flores-Hidalgo, L. D. ;
Mantas, C. J. ;
Puche, J. M. .
FUZZY SETS AND SYSTEMS, 2007, 158 (18) :2057-2077
[3]   NEAREST NEIGHBOR PATTERN CLASSIFICATION [J].
COVER, TM ;
HART, PE .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1967, 13 (01) :21-+
[4]   ESTIMATION BY NEAREST NEIGHBOR RULE [J].
COVER, TM .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1968, 14 (01) :50-+
[5]   Building an interpretable fuzzy rule base from data using orthogonal least squares - Application to a depollution problem [J].
Destercke, Sebastien ;
Guillaume, Serge ;
Charnomordic, Brigitte .
FUZZY SETS AND SYSTEMS, 2007, 158 (18) :2078-2094
[6]   Fuzzy function approximation with ellipsoidal rules [J].
Dickerson, JA ;
Kosko, B .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 1996, 26 (04) :542-560
[7]   RADIAL BASIS FUNCTION NEURAL-NETWORK FOR APPROXIMATION AND ESTIMATION OF NONLINEAR STOCHASTIC DYNAMIC-SYSTEMS [J].
ELANAYAR, S ;
SHIN, YC .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (04) :594-603
[8]  
Hastie T., 2001, ELEMENTS STAT LEARNI
[9]   An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks [J].
Huang, GB ;
Saratchandran, P ;
Sundararajan, N .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2004, 34 (06) :2284-2292
[10]   FUNCTIONAL EQUIVALENCE BETWEEN RADIAL BASIS FUNCTION NETWORKS AND FUZZY INFERENCE SYSTEMS [J].
JANG, JSR ;
SUN, CT .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1993, 4 (01) :156-159