Interactive Transfer Learning-Assisted Fuzzy Neural Network

被引:15
作者
Han, Honggui [1 ,2 ]
Liu, Hongxu [1 ,2 ]
Liu, Zheng [1 ,2 ]
Qiao, Junfei [1 ,2 ]
机构
[1] Beijing Univ Technol, Fac Informat Technol, Engn Res Ctr Digital Community,Minist Educ,Beijin, Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China
[2] Beijing Univ Technol, Beijing Lab Urban Mass Transit, Beijing 100124, Peoples R China
基金
北京市自然科学基金; 美国国家科学基金会;
关键词
Fuzzy neural networks; Neurons; Transfer learning; Uncertainty; Neural networks; Learning systems; Knowledge engineering; Fuzzy neural network (FNN); generalization performance; interactive transfer learning (ITL); negative transfer; HETEROGENEOUS DOMAIN ADAPTATION; KNOWLEDGE; CLASSIFICATION; REFINEMENT; PREDICTION; SYSTEMS; MODEL; REGRESSION; ALGORITHM; FRAMEWORK;
D O I
10.1109/TFUZZ.2021.3070156
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Transfer learning algorithm can provide a framework to utilize the previous knowledge to train fuzzy neural network (FNN). However, the performance of TL-based FNN will be destroyed by the knowledge over-fitting problem in the learning process. To solve this problem, an interactive transfer learning (ITL) algorithm, which can alleviate the negative transfer among different domains to improve the learning performance of FNN, is designed and analyzed in this article. This ITL-assisted FNN (ITL-FNN) contains the following advantages. First, a knowledge filter algorithm is developed to reconstruct the knowledge in source scene by balancing the matching accuracy and diversity. Then, the knowledge from source scene can fit the instance of target scene with suitable accuracy. Second, a self-balancing mechanism is designed to balance the driven information between the source and target scenes. Then, the knowledge can be refitted to reduce the useless information. Third, a structural competition algorithm is proposed to adjust the knowledge of FNN. Then, the proposed ITL-FNN can achieve compact structure to improve the generalization performance. Finally, some benchmark problems and industrial applications are provided to demonstrate the merits of ITL-FNN.
引用
收藏
页码:1900 / 1913
页数:14
相关论文
共 51 条
[1]   A Deep Transfer Learning Approach to Reducing the Effect of Electrode Shift in EMG Pattern Recognition-Based Control [J].
Ameri, Ali ;
Akhaee, Mohammad Ali ;
Scheme, Erik ;
Englehart, Kevin .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (02) :370-379
[2]   Multistep Fuzzy Bridged Refinement Domain Adaptation Algorithm and Its Application to Bank Failure Prediction [J].
Behbood, Vahid ;
Lu, Jie ;
Zhang, Guangquan ;
Pedrycz, Witold .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2015, 23 (06) :1917-1935
[3]   Fuzzy Refinement Domain Adaptation for Long Term Prediction in Banking Ecosystem [J].
Behbood, Vahid ;
Lu, Jie ;
Zhang, Guangquan .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2014, 10 (02) :1637-1646
[4]   Transferring knowledge as heuristics in reinforcement learning: A case-based approach [J].
Bianchi, Reinaldo A. C. ;
Celiberto, Luiz A., Jr. ;
Santos, Paulo E. ;
Matsuura, Jackson P. ;
Lopez de Mantaras, Ramon .
ARTIFICIAL INTELLIGENCE, 2015, 226 :102-121
[5]   The development of a weighted evolving fuzzy neural network for PCB sales forecasting [J].
Chang, Pei-Chann ;
Wang, Yen-Wen ;
Liu, Chen-Hao .
EXPERT SYSTEMS WITH APPLICATIONS, 2007, 32 (01) :86-96
[6]   A Hierarchical Fused Fuzzy Deep Neural Network for Data Classification [J].
Deng, Yue ;
Ren, Zhiquan ;
Kong, Youyong ;
Bao, Feng ;
Dai, Qionghai .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2017, 25 (04) :1006-1012
[7]   Transfer Prototype-Based Fuzzy Clustering [J].
Deng, Zhaohong ;
Jiang, Yizhang ;
Chung, Fu-Lai ;
Ishibuchi, Hisao ;
Choi, Kup-Sze ;
Wang, Shitong .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2016, 24 (05) :1210-1232
[8]   Generalized Hidden-Mapping Ridge Regression, Knowledge-Leveraged Inductive Transfer Learning for Neural Networks, Fuzzy Systems and Kernel Methods [J].
Deng, Zhaohong ;
Choi, Kup-Sze ;
Jiang, Yizhang ;
Wang, Shitong .
IEEE TRANSACTIONS ON CYBERNETICS, 2014, 44 (12) :2585-2599
[9]   Knowledge-Leverage-Based Fuzzy System and Its Modeling [J].
Deng, Zhaohong ;
Jiang, Yizhang ;
Chung, Fu-Lai ;
Ishibuchi, Hisao ;
Wang, Shitong .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2013, 21 (04) :597-609
[10]   Rough set and fuzzy wavelet neural network integrated with least square weighted fusion algorithm based fault diagnosis research for power transformers [J].
Dong, L. ;
Xiao, D. ;
Liang, Y. ;
Liu, Y. .
ELECTRIC POWER SYSTEMS RESEARCH, 2008, 78 (01) :129-136