Improved Structure Optimization for Fuzzy-Neural Networks

被引:27
作者
Pizzileo, Barbara [1 ]
Li, Kang [2 ]
Irwin, George W. [2 ]
Zhao, Wanqing [2 ]
机构
[1] Open Univ, Dept Environm Earth & Ecosyst, Milton Keynes MK7 6AA, Bucks, England
[2] Queens Univ Belfast, Sch Elect Elect Engn & Comp Sci, Belfast BT9 5AH, Antrim, North Ireland
关键词
Akaike's information criteria; curse of dimensionality; fuzzy-neural networks (FNNs); input selection; rule selection; SUPPORT-VECTOR REGRESSION; RULE BASE; KNOWLEDGE EXTRACTION; COGNITIVE MAPS; ALGORITHM; SYSTEM; CLASSIFICATION; IDENTIFICATION; APPROXIMATION; REDUCTION;
D O I
10.1109/TFUZZ.2012.2193587
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Fuzzy-neural-network-based inference systems are well-known universal approximators which can produce linguistically interpretable results. Unfortunately, their dimensionality can be extremely high due to an excessive number of inputs and rules, which raises the need for overall structure optimization. In the literature, various input selection methods are available, but they are applied separately from rule selection, often without considering the fuzzy structure. This paper proposes an integrated framework to optimize the number of inputs and the number of rules simultaneously. First, a method is developed to select the most significant rules, along with a refinement stage to remove unnecessary correlations. An improved information criterion is then proposed to find an appropriate number of inputs and rules to include in the model, leading to a balanced tradeoff between interpretability and accuracy. Simulation results confirm the efficacy of the proposed method.
引用
收藏
页码:1076 / 1089
页数:14
相关论文
共 43 条
[1]   Inverse fuzzy-process-model based direct adaptive control [J].
Abonyi, J ;
Andersen, H ;
Nagy, L ;
Szeifert, F .
MATHEMATICS AND COMPUTERS IN SIMULATION, 1999, 51 (1-2) :119-132
[2]  
Abonyi J, 2001, 10TH IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS, VOLS 1-3, P1420, DOI 10.1109/FUZZ.2001.1008925
[3]   NEW LOOK AT STATISTICAL-MODEL IDENTIFICATION [J].
AKAIKE, H .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1974, AC19 (06) :716-723
[4]  
[Anonymous], 1994, Journal of intelligent and Fuzzy systems
[5]   SVD-based reduction to MISO TS models [J].
Baranyi, P ;
Yam, Y ;
Vákonyi-Kóczy, AR ;
Patton, RJ .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2003, 50 (01) :232-242
[6]   FSVM-CIL: Fuzzy Support Vector Machines for Class Imbalance Learning [J].
Batuwita, Rukshan ;
Palade, Vasile .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2010, 18 (03) :558-571
[7]   ADAPTIVE-CONTROL OF A CLASS OF NONLINEAR DISCRETE-TIME-SYSTEMS USING NEURAL NETWORKS [J].
CHEN, FC ;
KHALIL, HK .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1995, 40 (05) :791-801
[8]   ORTHOGONAL LEAST-SQUARES METHODS AND THEIR APPLICATION TO NON-LINEAR SYSTEM-IDENTIFICATION [J].
CHEN, S ;
BILLINGS, SA ;
LUO, W .
INTERNATIONAL JOURNAL OF CONTROL, 1989, 50 (05) :1873-1896
[9]   ORTHOGONAL LEAST-SQUARES LEARNING ALGORITHM FOR RADIAL BASIS FUNCTION NETWORKS [J].
CHEN, S ;
COWAN, CFN ;
GRANT, PM .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1991, 2 (02) :302-309
[10]   Support vector learning mechanism for fuzzy rule-based modeling: A new approach [J].
Chiang, JH ;
Hao, PY .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2004, 12 (01) :1-12