Task-aware prototype refinement for improved few-shot learning

被引:1
作者
Zhang, Wei [1 ]
Gu, Xiaodong [1 ]
机构
[1] Fudan Univ, Dept Elect Engn, Shanghai 200438, Peoples R China
基金
中国国家自然科学基金;
关键词
Few-shot learning; Task embedding; Prototype rectification; Metric learning;
D O I
10.1007/s00521-023-08645-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In realistic scenarios, few-shot classification aims to generalize from common classes to novel classes with limited labeled samples. Most of existing transductive methods concentrate on probing into instance-prototype relations in a fixed way, without considering task-relevant information. In this paper, we perform task-aware prototype refinement (TAPR) explicitly for metric-based few-shot learning. Instead of utilizing fixed prior of queries, we adaptively estimate the query distribution, which can accommodate to both balanced and imbalanced situations. Concretely, on the basis of discriminative features from a holistic pre-training and pre-processing stage, we make novel attempts to make the best of task-aware and instance-aware knowledge to conduct selecting and denoising of samples for prototype generation and iterative rectification, which are complementary to each other. Extensive experimental results on four popular benchmark datasets (CUB, CIFAR-FS, miniImageNet and tieredImageNet) demonstrate that our TAPR outperforms most methods in inductive and balanced transductive settings. Besides, it achieves good generalization while maintaining high accuracy in the imbalanced and cross-domain setting.
引用
收藏
页码:17899 / 17913
页数:15
相关论文
共 68 条
[1]  
Bertinetto L., 2018, ARXIV
[2]   ECKPN: Explicit Class Knowledge Propagation Network for Transductive Few-shot Learning [J].
Chen, Chaofan ;
Yang, Xiaoshan ;
Xu, Changsheng ;
Huang, Xuhui ;
Ma, Zhe .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :6592-6601
[3]  
Chen J, 2022, P AAAI C ART INT
[4]  
Cheng J, 2023, IEEE T MULTIMEDIA, V25, P191, DOI [10.1109/TMM.2021.3123813, 10.1007/978-3-031-23661-7_6]
[5]   Imposing Semantic Consistency of Local Descriptors for Few-Shot Learning [J].
Cheng, Jun ;
Hao, Fusheng ;
Liu, Liu ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :1587-1600
[6]   CAD: Co-Adapting Discriminative Features for Improved Few-Shot Classification [J].
Chikontwe, Philip ;
Kim, Soopil ;
Park, Sang Hyun .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :14534-14543
[7]  
Das Debasmit, 2020, Advances in Visual Computing. 15th International Symposium, ISVC 2020. Proceedings. Lecture Notes in Computer Science (LNCS 12510), P3, DOI 10.1007/978-3-030-64559-5_1
[8]   A Two-Stage Approach to Few-Shot Learning for Image Recognition [J].
Das, Debasmit ;
Lee, C. S. George .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :3336-3350
[9]  
Fei N., 2020, INT C LEARNING REPRE
[10]  
Finn C, 2017, PR MACH LEARN RES, V70