RCBLS: An Outlier-Robust Broad Learning Framework with Compact Structure

被引:2
作者
Guo, Wei [1 ,2 ]
Yu, Jianjiang [2 ]
Zhou, Caigen [2 ]
Yuan, Xiaofeng [2 ]
Wang, Zhanxiu [2 ]
机构
[1] Yancheng Teachers Univ, Jiangsu Prov Key Constructive Lab Big Data Psychol, Yancheng 224002, Peoples R China
[2] Yancheng Teachers Univ, Coll Informat Engn, Yancheng 224002, Peoples R China
基金
中国国家自然科学基金;
关键词
broad learning system; robustness; compactness; M-estimator; sparsity regularization; SYSTEM; APPROXIMATION; CAPABILITY; FEATURES;
D O I
10.3390/electronics12143118
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, the broad learning system (BLS) has been widely developed in virtue of its excellent performance and high-computational efficiency. However, two deficiencies still exist in BLS and preclude its deployment in real applications. First, the standard BLS performs poorly in outlier environments because the least squares loss function it uses to train the network is sensitive to outliers. Second, the model structure of BLS is likely to be redundant since the hidden nodes in it are randomly generated. To address the above two issues, a new robust and compact BLS (RCBLS), based on M-estimator and sparsity regularization, is proposed in this paper. The RCBLS develops from the BLS model and maintains its excellent characteristics, but replaces the conventional least squares learning criterion with an M-estimator-based loss function that is less sensitive to outliers, in order to suppress the incorrect feedback of the model to outlier samples, and hence enhance its robustness in the presence of outliers. Meanwhile, the RCBLS imposes the sparsity-promoting l2,1 -norm regularization instead of the common l2-norm regularization for model reduction. With the help of the row sparsity of l2,1-norm regularization, the unnecessary hidden nodes in RCBLS can be effectively picked out and removed from the network, thereby resulting in a more compact network. The theoretical analyses on outlier robustness, structural compactness and computational complexity of the proposed RCBLS model are provided. Finally, the validity of the RCBLS is verified by regression, time series prediction and image classification tasks. The experimental results demonstrate that the proposed RCBLS has stronger anti-outlier ability and more compact network structure than BLS and other representative algorithms.
引用
收藏
页数:23
相关论文
共 60 条
[41]   An improvised nature-inspired algorithm enfolded broad learning system for disease classification [J].
Parhi, Pournamasi ;
Bisoi, Ranjeeta ;
Dash, Pradipta Kishore .
EGYPTIAN INFORMATICS JOURNAL, 2023, 24 (02) :241-255
[42]   LINPE-BL: A Local Descriptor and Broad Learning for Identification of Abnormal Breast Thermograms [J].
Pramanik, Sourav ;
Bhattacharjee, Debotosh ;
Nasipuri, Mita ;
Krejcar, Ondrej .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (12) :3919-3931
[43]   Multi-Attn BLS: Multi-head attention mechanism with broad learning system for chaotic time series prediction [J].
Su, Liyun ;
Xiong, Lang ;
Yang, Jialing .
APPLIED SOFT COMPUTING, 2023, 132
[44]  
Tyler DavidE., 2008, Journal of the American Statistical Association, V103, P888, DOI DOI 10.1198/JASA.2008.S239
[45]   Tropical Cyclogenesis Detection From Remotely Sensed Sea Surface Winds Using Graphical and Statistical Features-Based Broad Learning System [J].
Wang, Sheng ;
Yuen, Ka-Veng ;
Yang, Xiaofeng ;
Zhang, Yang .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
[46]   Ensemble Strategy Utilizing a Broad Learning System for Indoor Fingerprint Localization [J].
Wu, Chen ;
Qiu, Tie ;
Zhang, Chaokun ;
Qu, Wenyu ;
Wu, Dapeng Oliver .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (04) :3011-3022
[47]   BLCov: A novel collaborative-competitive broad learning system for COVID-19 detection from radiology images [J].
Wu, Guangheng ;
Duan, Junwei .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 115
[48]   Stacked One-Class Broad Learning System for Intrusion Detection in Industry 4.0 [J].
Yang, Kaixiang ;
Shi, Yifan ;
Yu, Zhiwen ;
Yang, Qinmin ;
Sangaiah, Arun Kumar ;
Zeng, Huanqiang .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (01) :251-260
[49]   Incremental Weighted Ensemble Broad Learning System for Imbalanced Data [J].
Yang, Kaixiang ;
Yu, Zhiwen ;
Chen, C. L. Philip ;
Cao, Wenming ;
You, Jane ;
Wong, Hau-San .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (12) :5809-5824
[50]   Online prediction and correction control of static voltage stability index based on Broad Learning System [J].
Yang, Yude ;
Huang, Qin ;
Li, Peijie .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 199