Pattern Classification With Corrupted Labeling via Robust Broad Learning System

被引:46
作者
Jin, Junwei [1 ,2 ]
Li, Yanting [3 ]
Chen, C. L. Philip [4 ]
机构
[1] Henan Univ Technol, Key Lab Grain Informat Proc & Control, Henan Prov Key Lab Grain Photoelect Detect & Cont, Minist Educ, Zhengzhou 450052, Peoples R China
[2] Henan Univ Technol, Sch Artificial Intelligence & Big Data, Zhengzhou 450001, Henan, Peoples R China
[3] Zhengzhou Univ Light Ind, Sch Comp & Commun Engn, Zhengzhou 450001, Peoples R China
[4] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510641, Peoples R China
基金
中国国家自然科学基金;
关键词
Robustness; Noise measurement; Standards; Probabilistic logic; Labeling; Manifolds; Manifold learning; Broad learning system; classification; corrupted labels; robustness; maximum likelihood estimation; manifold regularization; NOISE; MACHINE; SERIES;
D O I
10.1109/TKDE.2021.3049540
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most of the existing classification systems assume that the data used is high-quality labeled. However, the labeling process in real-world may inevitably introduce corruptions into labels which can confuse the performances of classifiers. In this paper, based on Broad Learning System (BLS), we propose a novel label noise tolerant method to classify the pattern with corrupted labels. The standard BLS has shown promising efficiency and accuracy in general classification, but its learning process is prone to be affected by the noisy labels. Here, by detailed probabilistic analysis, we first give the reason for lacks of robustness in standard BLS. Then a maximum likelihood estimation-based objective function is derived for robust classification. In addition, a manifold regularization term is integrated to preserve the local geometry of data, which makes the model to be more robust and flexible to learn the output weights. Given some basic assumptions on the approximation errors, the obtained model can be transformed to a graph regularized reweighted BLS problem. The negative effects of noisy labels in data can be inhibited adaptively by assigning reasonable weights. Theoretical analysis and extensive experiments are provided to demonstrate the robustness and effectiveness of the proposed robust BLS model, especially for the case of large amounts of noisy labels.
引用
收藏
页码:4959 / 4971
页数:13
相关论文
共 35 条
  • [1] FITTING OF POWER-SERIES, MEANING POLYNOMIALS, ILLUSTRATED ON BAND-SPECTROSCOPIC DATA
    BEATON, AE
    TUKEY, JW
    [J]. TECHNOMETRICS, 1974, 16 (02) : 147 - 185
  • [2] Biggio B., 2011, P AS C MACH LEARN, P97
  • [3] Universal Approximation Capability of Broad Learning System and Its Structural Variations
    Chen, C. L. Philip
    Liu, Zhulin
    Feng, Shuang
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (04) : 1191 - 1204
  • [4] Broad Learning System: An Effective and Efficient Incremental Learning System Without the Need for Deep Architecture
    Chen, C. L. Philip
    Liu, Zhulin
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (01) : 10 - 24
  • [5] De Brabanter J., 2002, Least squares support vector machines
  • [6] Regularized Extreme Learning Machine
    Deng, Wanyu
    Zheng, Qinghua
    Chen, Lin
    [J]. 2009 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DATA MINING, 2009, : 389 - 395
  • [7] Novel Efficient RNN and LSTM-Like Architectures: Recurrent and Gated Broad Learning Systems and Their Applications for Text Classification
    Du, Jie
    Vong, Chi-Man
    Chen, C. L. Philip
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (03) : 1586 - 1597
  • [8] Regularized Label Relaxation Linear Regression
    Fang, Xiaozhao
    Xu, Yong
    Li, Xuelong
    Lai, Zhihui
    Wong, Wai Keung
    Fang, Bingwu
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (04) : 1006 - 1018
  • [9] Robust manifold broad learning system for large-scale noisy chaotic time series prediction: A perturbation perspective
    Feng, Shoubo
    Ren, Weijie
    Han, Min
    Chen, Yen Wei
    [J]. NEURAL NETWORKS, 2019, 117 : 179 - 190
  • [10] Fuzzy Broad Learning System: A Novel Neuro-Fuzzy Model for Regression and Classification
    Feng, Shuang
    Chen, C. L. Philip
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (02) : 414 - 424