3LPR: A three-stage label propagation and reassignment framework for class-imbalanced semi-supervised learning

被引:12
作者
Kong, Xiangyuan [1 ]
Wei, Xiang [1 ]
Liu, Xiaoyu [1 ]
Wang, Jingjie [1 ]
Lu, Siyang [2 ]
Xing, Weiwei [1 ]
Lu, Wei [1 ]
机构
[1] Beijing Jiaotong Univ, Sch Software Engn, Beijing, Peoples R China
[2] Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Semi-supervised learning; Class-imbalanced learning; Graph network; Label propagation; Mixed data augmentation;
D O I
10.1016/j.knosys.2022.109561
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Semi-supervised learning (SSL) has been studied widely in standard benchmark datasets; however, real-world data often exhibit class-imbalanced distributions, which pose significant challenges for deep semi-supervised models. To address this issue, we design a three-stage learning framework, 3LPR, by combining unsupervised feature extraction, graph-based Label Propagation, and mixed data augmentation (MDA)-based label Reassignment. Specifically, we first explore the performance of supervised and unsupervised learning for feature extraction of class-imbalanced data and then establish our first stage of feature extraction through unsupervised learning. Then, we adopt graph network-based offline label propagation and sieving to effectively expand the labeled set to overcome the excessive label bias in the classifier during the training process. Finally, we propose a label reassignment (LRA) algorithm for class-imbalanced semi-supervised learning (CISSL) to train the expanded dataset, where the MDA strategy is adopted but with the label reassigned. The experimental results demonstrate that the proposed 3LPR framework for CISSL outperforms other state-of-the-art methods on various datasets. (C) 2022 The Author(s). Published by Elsevier B.V.
引用
收藏
页数:12
相关论文
共 62 条
[1]  
Albert P., 2020, ARXIV
[2]  
[Anonymous], 2009, CIFAR-100 Dataset
[3]  
[Anonymous], 2020, IEEE IJCNN
[4]  
[Anonymous], 2018, INT C LEARN REPR
[5]  
Berthelot D., 2019, arXiv
[6]  
Berthelot D, 2019, ADV NEUR IN, V32
[7]   A systematic study of the class imbalance problem in convolutional neural networks [J].
Buda, Mateusz ;
Maki, Atsuto ;
Mazurowski, Maciej A. .
NEURAL NETWORKS, 2018, 106 :249-259
[8]  
Byrd J, 2019, PR MACH LEARN RES, V97
[9]  
Cao KD, 2019, Arxiv, DOI arXiv:1906.07413
[10]   Semi-supervised Dual-Branch Network for image classification [J].
Chen, Jiaming ;
Yang, Meng ;
Gao, Guangwei .
KNOWLEDGE-BASED SYSTEMS, 2020, 197