Sensitivity analysis of Takagi-Sugeno fuzzy neural network

被引:18
作者
Wang, Jian [1 ]
Chang, Qin [1 ]
Gao, Tao [2 ]
Zhang, Kai [3 ]
Pal, Nikhil R. [4 ]
机构
[1] China Univ Petr East China, Coll Sci, Qingdao 266580, Peoples R China
[2] Beihang Univ, Sch Comp Sci & Engn, Beijing 100191, Peoples R China
[3] China Univ Petr East China, Sch Petr Engn, Qingdao 266580, Peoples R China
[4] Indian Stat Inst, Elect & Commun Sci Unit, Kolkata 700108, W Bengal, India
基金
中国国家自然科学基金;
关键词
Takagi-Sugeno; Consequent part; Sensitivity; Statistical; Regularization; MULTILAYER PERCEPTRON; SYSTEM-IDENTIFICATION; SELECTION;
D O I
10.1016/j.ins.2021.10.037
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we first define a measure of statistical sensitivity of a zero-order Takagi- Sugeno (TS) fuzzy neural network (FNN) with respect to perturbation of weights and parameters of the system. Then we derive measures of sensitivity of the system with respect to additive and multiplicative noises to the consequent parameters. For this we consider a multiple-input multiple-output (MIMO) FNN. The derivation can be easily extended to sensitivity with respect to other parameters as well. These measures of sensi-tivity are then used as regularizers to the loss function while training the system. Finally, to validate the sensitivity-based learning method, another definition of statistical sensitivity measure, based on absolute output error, is proposed, and its corresponding expression for additive/multiplicative perturbations of the consequent parameters is derived as well. Using simulation results on one classification problem and two regression problems, the effectiveness of the sensitivity measures is demonstrated. (c) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页码:725 / 749
页数:25
相关论文
共 50 条
[1]   Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Survey [J].
Akhtar, Naveed ;
Mian, Ajmal .
IEEE ACCESS, 2018, 6 :14410-14430
[2]  
[Anonymous], 2010, UCI Machine Learning Repository
[3]   A new method for sensitivity analysis of fuzzy transportation problems [J].
Bhatia, Neha ;
Kumar, Amit .
JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2013, 25 (01) :167-175
[4]   Integrated feature analysis and fuzzy rule-based system identification in a neuro-fuzzy paradigm [J].
Chakraborty, D ;
Pal, NR .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2001, 31 (03) :391-400
[5]   An Integrated Mechanism for Feature Selection and Fuzzy Rule Extraction for Classification [J].
Chen, Yi-Cheng ;
Pal, Nikhil R. ;
Chung, I-Fang .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2012, 20 (04) :683-698
[6]   Sensitivity analysis of neocognitron [J].
Cheng, AY ;
Yeung, DS .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 1999, 29 (02) :238-249
[7]   Regularizing Multilayer Perceptron for Robustness [J].
Dey, Prasenjit ;
Nag, Kaustuv ;
Pal, Tandra ;
Pal, Nikhil R. .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2018, 48 (08) :1255-1266
[8]   A new pruning heuristic based on variance analysis of sensitivity information [J].
Engelbrecht, AP .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2001, 12 (06) :1386-1399
[9]   The Robustness of Deep Networks A geometrical perspective [J].
Fawzi, Alhussein ;
Moosavi-Dezfooli, Seyed-Mohsen ;
Frossard, Pascal .
IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (06) :50-62
[10]   Autostructuration of fuzzy systems by rules sensitivity analysis [J].
Fiordaliso, A .
FUZZY SETS AND SYSTEMS, 2001, 118 (02) :281-296