Self-adaptive fuzzy learning ensemble systems with dimensionality compression from data streams

被引:8
作者
Gu, Xiaowei [1 ]
机构
[1] Univ Kent, Sch Comp, Canterbury CT2 7NZ, England
关键词
Data stream; Dimensionality compression; Ensemble learning; Evolving fuzzy system; Prediction; INFERENCE SYSTEM; ONLINE; IDENTIFICATION; CLASSIFIERS;
D O I
10.1016/j.ins.2023.03.123
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Ensemble learning is a widely used methodology to build powerful predictors from multiple in-dividual weaker ones. However, the vast majority of ensemble learning models are designed for offline application scenarios, the use of evolving fuzzy systems in ensemble learning for online learning from data streams has not been sufficiently explored, yet. In this paper, a novel self -adaptive fuzzy learning ensemble system is introduced for data stream prediction. The pro-posed ensemble system employs the very sparse random projection technique to compress the consequent parts of the learned fuzzy rules by individual base models to a more compressed form, thereby reducing redundant information and improving computational efficiency. To improve the overall prediction performance, a dynamical base model pruning scheme is introduced to the proposed ensemble system together with a novel inferencing scheme, such that less accurate base models will be removed from the ensemble structure at each learning cycle automatically and only these more accurate ones will be involved in joint decision-making. Numerical examples based on a wide range of benchmark datasets demonstrate the stronger prediction performance of the proposed ensemble system over the state-of-the-art alternatives.
引用
收藏
页码:382 / 399
页数:18
相关论文
共 50 条
[1]  
Rusu AA, 2016, Arxiv, DOI [arXiv:1606.04671, 10.48550/arXiv.1606.04671, DOI 10.48550/ARXIV.1606.04671, DOI 10.43550/ARXIV:1606.04671]
[2]  
Alves E., 2019, IEEE INT C FUZZY SYS, P1
[3]   Evolving Fuzzy-Rule-Based Classifiers From Data Streams [J].
Angelov, Plamen P. ;
Zhou, Xiaowei .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2008, 16 (06) :1462-1475
[4]   An approach to Online identification of Takagi-Suigeno fuzzy models [J].
Angelov, PP ;
Filev, DP .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2004, 34 (01) :484-498
[5]  
Iglesias JA, 2013, IEEE CONF EVOL ADAPT, P56, DOI 10.1109/EAIS.2013.6604105
[6]  
Ashfahani A, 2019, Data Min, P666
[7]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[8]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[9]   XGBoost: A Scalable Tree Boosting System [J].
Chen, Tianqi ;
Guestrin, Carlos .
KDD'16: PROCEEDINGS OF THE 22ND ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2016, :785-794
[10]  
Cristianini N., 2000, An Introduction To Support Vector Machines and Other Kernel-based Learning Methods