On the Accuracy-Complexity Tradeoff of Fuzzy Broad Learning System

被引:47
作者
Feng, Shuang [1 ]
Chen, C. L. Philip [2 ,3 ]
Xu, Lili [1 ,3 ]
Liu, Zhulin [2 ]
机构
[1] Beijing Normal Univ, Sch Appl Math, Zhuhai 519087, Peoples R China
[2] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510641, Peoples R China
[3] Univ Macau, Fac Sci & Technol, Macau 999078, Peoples R China
基金
中国国家自然科学基金;
关键词
Fuzzy systems; Neural networks; Fuzzy sets; Computational modeling; Complexity theory; Takagi-Sugeno model; Training; Accuracy-complexity; classification; fuzzy broad learning system (FBLS); Takagi-Sugeno-Kang (TSK) fuzzy system; RESTRICTED BOLTZMANN MACHINE; NEURAL-NETWORKS; IDENTIFICATION; CLASSIFIER; ALGORITHM; MODEL; INTEGRATION; DESIGN;
D O I
10.1109/TFUZZ.2020.3009757
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The fuzzy broad learning system (FBLS) is a recently proposed neuro-fuzzy model that shares the similar structure of a broad learning system (BLS). It shows high accuracy in both classification and regression tasks and inherits the fast computational nature of a BLS. However, the ensemble of several fuzzy subsystems in an FBLS decreases the possibility of understanding the fuzzy model since the fuzzy rules from different fuzzy systems are difficult to combine together while keeping the consistence. To balance the model accuracy and complexity, a synthetically simplified FBLS with better interpretability, named compact FBLS (CFBLS), is developed in this article, which can generate much fewer and more explainable fuzzy rules for understanding. In such a way, only one traditional Takagi-Sugeno-Kang fuzzy system is employed in the feature layer of a CFBLS, and the input universe of discourse is equally partitioned to obtain the fuzzy sets with proper linguistic labels accordingly. The random feature selection matrix and rule combination matrix are employed to reduce the total number of fuzzy rules and to avoid the "curse of dimensionality." The enhancement layer is kept in the CFBLS that helps to add a nonlinear transformation of input features to the traditional first-order polynomial used in the consequent part of a fuzzy rule. The pseudoinverse is also used to determine the parameters of CFBLS guaranteeing its fast computational nature. The experiments on the popular UCI and KEEL datasets indicate that the CFBLS can generate a smaller set of comprehensible fuzzy rules and achieve much higher accuracy than some state-of-the-art neuro-fuzzy models. Moreover, the advantage of CFBLS is also verified in a real-world application.
引用
收藏
页码:2963 / 2974
页数:12
相关论文
共 55 条
  • [1] Alcalá-Fdez J, 2011, J MULT-VALUED LOG S, V17, P255
  • [2] Stock trading using RSPOP: A novel rough set-based neuro-fuzzy approach
    Ang, Kai Keng
    Quek, Chai
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2006, 17 (05): : 1301 - 1315
  • [3] [Anonymous], 2020, IEEE T CYBERN
  • [4] [Anonymous], 2017, P IEEE INT C SYST MA
  • [5] [Anonymous], 2013, ser. Studies in Fuzziness and Soft Computing
  • [6] Blake C. L., 1998, REPOSITORY LEARNING, V55
  • [7] A Novel Approach to Implement Takagi-Sugeno Fuzzy Models
    Chang, Chia-Wen
    Tao, Chin-Wang
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2017, 47 (09) : 2353 - 2361
  • [8] LIBSVM: A Library for Support Vector Machines
    Chang, Chih-Chung
    Lin, Chih-Jen
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
  • [9] Broad Learning System: An Effective and Efficient Incremental Learning System Without the Need for Deep Architecture
    Chen, C. L. Philip
    Liu, Zhulin
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (01) : 10 - 24
  • [10] Fuzzy Restricted Boltzmann Machine for the Enhancement of Deep Learning
    Chen, C. L. Philip
    Zhang, Chun-Yang
    Chen, Long
    Gan, Min
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2015, 23 (06) : 2163 - 2173