DualMatch: Robust Semi-supervised Learning with Dual-Level Interaction

被引:1
作者
Wang, Cong [1 ]
Cao, Xiaofeng [1 ]
Guo, Lanzhe [2 ]
Shi, Zenglin [3 ]
机构
[1] Jilin Univ, Sch Artificial Intelligence, Changchun 130012, Peoples R China
[2] Nanjing Univ, Natl Key Lab Novel Software Technol, Nanjing 210023, Peoples R China
[3] ASTAR, I2R, Singapore, Singapore
来源
MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, ECML PKDD 2023, PT V | 2023年 / 14173卷
基金
中国国家自然科学基金;
关键词
Semi-supervised learning; Dual-Level interaction; Data augmentation; Feature embeddings;
D O I
10.1007/978-3-031-43424-2_7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Semi-supervised learning provides an expressive framework for exploiting unlabeled data when labels are insufficient. Previous semi-supervised learning methods typically match model predictions of different data-augmented views in a single-level interaction manner, which highly relies on the quality of pseudo-labels and results in semi-supervised learning not robust. In this paper, we propose a novel SSL method called Dual-Match, in which the class prediction jointly invokes feature embedding in a dual-level interaction manner. Dual-Match requires consistent regularizations for data augmentation, specifically, 1) ensuring that different augmented views are regulated with consistent class predictions, and 2) ensuring that different data of one class are regulated with similar feature embeddings. Extensive experiments demonstrate the effectiveness of DualMatch. In the standard SSL setting, the proposal achieves 9% error reduction compared with SOTA methods, even in a more challenging class-imbalanced setting, the proposal can still achieve 6% error reduction. Code is available at https://github.com/CWangAI/DualMatch.
引用
收藏
页码:102 / 119
页数:18
相关论文
共 28 条
[1]   Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learning [J].
Arazo, Eric ;
Ortego, Diego ;
Albert, Paul ;
O'Connor, Noel E. ;
McGuinness, Kevin .
2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
[2]  
Berthelot D, 2019, INT C LEARNING REPRE
[3]  
Berthelot D, 2019, ADV NEUR IN, V32
[4]  
Chapelle O., 2009, Semi-supervised Learning, V20, P542
[5]  
Chen T, 2020, PR MACH LEARN RES, V119
[6]  
Chen Ting, 2020, ADV NEUR IN
[7]   Randaugment: Practical automated data augmentation with a reduced search space [J].
Cubuk, Ekin D. ;
Zoph, Barret ;
Shlens, Jonathon ;
Le, Quoc, V .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :3008-3017
[8]   Momentum Contrast for Unsupervised Visual Representation Learning [J].
He, Kaiming ;
Fan, Haoqi ;
Wu, Yuxin ;
Xie, Saining ;
Girshick, Ross .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :9726-9735
[9]  
Khosla P., 2020, Advances in neural information processing systems, V33, P18661
[10]  
Kim J., 2020, Advances in neural information processing systems, V33