Interactive Transfer Learning-Assisted Fuzzy Neural Network

被引:15
作者
Han, Honggui [1 ,2 ]
Liu, Hongxu [1 ,2 ]
Liu, Zheng [1 ,2 ]
Qiao, Junfei [1 ,2 ]
机构
[1] Beijing Univ Technol, Fac Informat Technol, Engn Res Ctr Digital Community,Minist Educ,Beijin, Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China
[2] Beijing Univ Technol, Beijing Lab Urban Mass Transit, Beijing 100124, Peoples R China
基金
北京市自然科学基金; 美国国家科学基金会;
关键词
Fuzzy neural networks; Neurons; Transfer learning; Uncertainty; Neural networks; Learning systems; Knowledge engineering; Fuzzy neural network (FNN); generalization performance; interactive transfer learning (ITL); negative transfer; HETEROGENEOUS DOMAIN ADAPTATION; KNOWLEDGE; CLASSIFICATION; REFINEMENT; PREDICTION; SYSTEMS; MODEL; REGRESSION; ALGORITHM; FRAMEWORK;
D O I
10.1109/TFUZZ.2021.3070156
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Transfer learning algorithm can provide a framework to utilize the previous knowledge to train fuzzy neural network (FNN). However, the performance of TL-based FNN will be destroyed by the knowledge over-fitting problem in the learning process. To solve this problem, an interactive transfer learning (ITL) algorithm, which can alleviate the negative transfer among different domains to improve the learning performance of FNN, is designed and analyzed in this article. This ITL-assisted FNN (ITL-FNN) contains the following advantages. First, a knowledge filter algorithm is developed to reconstruct the knowledge in source scene by balancing the matching accuracy and diversity. Then, the knowledge from source scene can fit the instance of target scene with suitable accuracy. Second, a self-balancing mechanism is designed to balance the driven information between the source and target scenes. Then, the knowledge can be refitted to reduce the useless information. Third, a structural competition algorithm is proposed to adjust the knowledge of FNN. Then, the proposed ITL-FNN can achieve compact structure to improve the generalization performance. Finally, some benchmark problems and industrial applications are provided to demonstrate the merits of ITL-FNN.
引用
收藏
页码:1900 / 1913
页数:14
相关论文
共 51 条
[11]   Domain Transfer Multiple Kernel Learning [J].
Duan, Lixin ;
Tsang, Ivor W. ;
Xu, Dong .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (03) :465-479
[12]   Design of Self-Organizing Intelligent Controller Using Fuzzy Neural Network [J].
Han, Hong-Gui ;
Wu, Xiao-Long ;
Liu, Zheng ;
Qiao, Jun-Fei .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2018, 26 (05) :3097-3111
[13]   An Efficient Optimization Method for Improving Generalization Performance of Fuzzy Neural Networks [J].
Han, Honggui ;
Wu, Xiaolong ;
Liu, Hongxu ;
Qiao, Junfei .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2019, 27 (07) :1347-1361
[14]   Prediction of sludge bulking using the knowledge-leverage-based fuzzy neural network [J].
Han, Honggui ;
Liu, Zheng ;
Ge, Luming ;
Qiao, Junfei .
WATER SCIENCE AND TECHNOLOGY, 2018, 77 (03) :617-627
[15]   Nonlinear Systems Modeling Based on Self-Organizing Fuzzy-Neural-Network With Adaptive Computation Algorithm [J].
Han, Honggui ;
Wu, Xiao-Long ;
Qiao, Jun-Fei .
IEEE TRANSACTIONS ON CYBERNETICS, 2014, 44 (04) :554-564
[16]   A Self-Organizing Fuzzy Neural Network Based on a Growing-and-Pruning Algorithm [J].
Han, Honggui ;
Qiao, Junfei .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2010, 18 (06) :1129-1143
[17]  
Jammalamadaka SR., 2019, Int. J. Artificial Intelligence, V17, P81
[18]   Transfer Learning-Based Dynamic Multiobjective Optimization Algorithms [J].
Jiang, Min ;
Huang, Zhongqiang ;
Qiu, Liming ;
Huang, Wenzhen ;
Yen, Gary G. .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2018, 22 (04) :501-514
[19]   Seizure Classification From EEG Signals Using Transfer Learning, Semi-Supervised Learning and TSK Fuzzy System [J].
Jiang, Yizhang ;
Wu, Dongrui ;
Deng, Zhaohong ;
Qian, Pengjiang ;
Wang, Jun ;
Wang, Guanjin ;
Chung, Fu-Lai ;
Choi, Kup-Sze ;
Wang, Shitong .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2017, 25 (12) :2270-2284
[20]   Multi-task TSK fuzzy system modeling using inter-task correlation information [J].
Jiang, Yizhang ;
Deng, Zhaohong ;
Chung, Fu-Lai ;
Wang, Shitong .
INFORMATION SCIENCES, 2015, 298 :512-533