Label-Weighted Graph-Based Learning for Semi-Supervised Classification Under Label Noise

被引:5
作者
Liang, Naiyao [1 ]
Yang, Zuyuan [1 ]
Chen, Junhang [1 ]
Li, Zhenni [1 ,2 ]
Xie, Shengli [1 ,3 ]
机构
[1] Guangdong Univ Technol, Sch Automat, Guangdong Key Lab IoT Informat Technol, Guangzhou 510006, Peoples R China
[2] Minist Educ, Key Lab iDetectin & Mfg IoT, Guangzhou 510006, Peoples R China
[3] Guangdong Hong Kong Macao Joint Lab Smart Discrete, Guangzhou 510006, Peoples R China
关键词
Noise measurement; Synthetic data; Robustness; Big Data; Adaptation models; Optimization; Deep learning; Graph-based learning; semi-supervised classification; label noise; adaptive label weight;
D O I
10.1109/TBDATA.2023.3319249
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Graph-based semi-supervised learning (GSSL) is a quite important technology due to its effectiveness in practice. Existing GSSL works often treat the given labels equally and ignore the unbalance importance of labels. In some inaccurate systems, the collected labels usually contain noise (noisy labels) and the methods treating labels equally suffer from the label noise. In this article, we propose a novel label-weighted learning method on graph for semi-supervised classification under label noise, which allows considering the contribution differences of labels. In particular, the label dependency of data is revealed by graph constraints. With the help of this label dependency, the proposed method develops the strategy of adaptive label weight, where label weights are assigned to labels adaptively. Accordingly, an efficient algorithm is developed to solve the proposed optimization objective, where each subproblem has a closed-form solution. Experimental results on a synthetic dataset and several real-world datasets show the advantage of the proposed method, compared to the state-of-the-art methods.
引用
收藏
页码:55 / 65
页数:11
相关论文
共 43 条
  • [1] Bylander T., 1994, Proceedings of the Seventh Annual ACM Conference on Computational Learning Theory, COLT 94, P340, DOI 10.1145/180139.181176
  • [2] Correlated Input-Dependent Label Noise in Large-Scale Image Classification
    Collier, Mark
    Mustafa, Basil
    Kokiopoulou, Efi
    Jenatton, Rodolphe
    Berent, Jesse
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 1551 - 1560
  • [3] Gao W, 2016, AAAI CONF ARTIF INTE, P1575
  • [4] Han B., 2018, Proc. Adv. Neural Inf. Process. Syst., P5841
  • [5] Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labels
    Han, Bo
    Yao, Quanming
    Yu, Xingrui
    Niu, Gang
    Xu, Miao
    Hu, Weihua
    Tsang, Ivor W.
    Sugiyama, Masashi
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [6] Jia L, 2016, IEEE DATA MINING, P201, DOI [10.1109/ICDM.2016.26, 10.1109/ICDM.2016.0031]
  • [7] Hyperspectral Image Classification in the Presence of Noisy Labels
    Jiang, Junjun
    Ma, Jiayi
    Wang, Zheng
    Chen, Chen
    Liu, Xianming
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (02): : 851 - 865
  • [8] Multilayer Spectral-Spatial Graphs for Label Noisy Robust Hyperspectral Image Classification
    Jiang, Junjun
    Ma, Jiayi
    Liu, Xianming
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (02) : 839 - 852
  • [9] Multiple Graph Label Propagation by Sparse Integration
    Karasuyama, Masayuki
    Mamitsuka, Hiroshi
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2013, 24 (12) : 1999 - 2012
  • [10] Bipartite Graph Based Multi-View Clustering
    Li, Lusi
    He, Haibo
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (07) : 3111 - 3125