Semi-Supervised Few-Shot Classification With Multitask Learning and Iterative Label Correction

被引:1
作者
Ji, Hong [1 ]
Gao, Zhi [1 ]
Lu, Yao [2 ]
Li, Ziyao [1 ]
Chen, Boan [1 ]
Li, Yanzhang [3 ]
Zhu, Jun [3 ]
Wang, Chao [3 ]
Shi, Zhicheng [4 ]
机构
[1] Wuhan Univ, Sch Remote Sensing Informat Engn, Wuhan 430079, Peoples R China
[2] Beijing Inst Remote Sensing, Beijing 100011, Peoples R China
[3] DFH Satellite Co Ltd, Beijing 100081, Peoples R China
[4] Beijing Inst Space Mech & Elect, Beijing 100094, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Task analysis; Training; Remote sensing; Metalearning; Modulation; Feature extraction; Multitasking; Few-shot learning; modulation aggregation layer (MAL); modulation selection network (MSN); multitask learning; semi-supervised learning;
D O I
10.1109/TGRS.2024.3401071
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Few-shot learning enables rapid generalization from extremely limited training examples. While previous efforts have utilized meta-learning or data augmentation methods to mitigate the problem of data scarcity, such approaches may struggle to maintain robustness and generalize effectively due to overfitting and noise sensitivity. In this article, we propose a novel approach, the semi-supervised label correction method for few-shot learning (SSLC-FSL), which leverages the data distribution of readily available and easily obtainable unlabeled data. SSLC-FSL iteratively corrects the labels of testing samples with alternating steps of pseudo-labeling and sample selection. The objective of pseudo-labeling is to repurpose graph-based semi-supervised learning for joint prediction of the entire testing set. We then introduce a modulation selection network (MSN) to rank testing samples by learning with noisy labels. The training set is expanded by selecting confident pseudo-labeled samples. In the MSN, a modulation aggregation layer is designed to encode support class information into each testing sample, thereby highlighting target category features and mitigating the negative impact of incorrect labels. The iterative label correction process is repeated until all testing samples are recalled to the expanded support set. To boost the SSLC-FSL algorithm, we pretrain a feature extractor to produce general-purpose representations. Particularly, we investigate two types of auxiliary tasks and their collaborative learning to acquire transferable visual information via an end-to-end multitask learning model. Our SSLC-FSL outperforms current state-of-the-art methods in any shot and all data settings, with up to +27.74% on standard remote sensing benchmarks and +5.70% on standard natural scene benchmarks.
引用
收藏
页码:1 / 15
页数:15
相关论文
共 71 条
[1]  
Belkin M, 2006, J MACH LEARN RES, V7, P2399
[2]  
Bertinetto Luca, 2018, INT C LEARNING REPRE
[3]   Learning to Compare Relation: Semantic Alignment for Few-Shot Learning [J].
Cao, Congqi ;
Zhang, Yanning .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :1462-1474
[4]  
Chen T., 2020, PMLR, ppp 1597
[5]  
Chen W.-Y., 2019, INT C LEARN REPR, P1, DOI DOI 10.1109/MSR.2015.54
[6]  
Chen ZT, 2019, AAAI CONF ARTIF INTE, P3379
[7]   SPNet: Siamese-Prototype Network for Few-Shot Remote Sensing Image Scene Classification [J].
Cheng, Gong ;
Cai, Liming ;
Lang, Chunbo ;
Yao, Xiwen ;
Chen, Jinyong ;
Guo, Lei ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[8]   Remote Sensing Image Scene Classification: Benchmark and State of the Art [J].
Cheng, Gong ;
Han, Junwei ;
Lu, Xiaoqiang .
PROCEEDINGS OF THE IEEE, 2017, 105 (10) :1865-1883
[9]   Satellite Image Classification via Two-Layer Sparse Coding With Biased Image Representation [J].
Dai, Dengxin ;
Yang, Wen .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2011, 8 (01) :173-176
[10]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848