Relation fusion propagation network for transductive few-shot learning

被引:8
作者
Huang, Yixiang [1 ]
Hao, Hongyu [2 ]
Ge, Weichao [2 ]
Cao, Yang [2 ]
Wu, Ming [1 ]
Zhang, Chuang [1 ]
Guo, Jun [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Pattern Recognit & Intelligent Syst Lab, Beijing, Peoples R China
[2] Megvii Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Few-shot learning; Image classification; Graph neural network;
D O I
10.1016/j.patcog.2024.110367
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Previous graph -based meta -learning approaches have explored pairwise feature similarity to learn instancelevel relations of samples, however, the gap between the sample relations in feature and label spaces is often ignored. It is empirically observed that instances with different labels may display considerable similarity in visual characteristics, making it challenging to distinguish between them in the feature space. To this end, we propose a dual -branch Relation Fusion Propagation Network (RFPN) for transductive few -shot learning, which explicitly models both feature and label relations across support -query pairs. Specifically, we design a Relation Fusion Block (RFB) to fuse instance -level and class -level relations, thus obtaining more robust fusionlevel relations to guide feature propagation. In addition to the feature propagation branch, we encode the label relations and construct a label shortcut branch for label propagation. To alleviate the error accumulation during propagation, which is caused by uncertain pseudo -labels for query samples, we propose a Label Shortcut Mechanism (LSM) to progressively update the sample relations with the initial labels. Our full method is plug -and -play and can be easily applied in existing graph -based approaches for transductive few -shot learning. Extensive experiments demonstrate that our proposed RFPN yields significant improvements over the baselines and achieves promising performance on four popular few -shot classification benchmarks.
引用
收藏
页数:10
相关论文
共 48 条
[1]  
Rusu AA, 2019, Arxiv, DOI arXiv:1807.05960
[2]  
Bertinetto L, 2019, Arxiv, DOI arXiv:1805.08136
[3]  
Defferrard M, 2016, ADV NEUR IN, V29
[4]  
Finn C, 2017, Arxiv, DOI [arXiv:1703.03400, DOI 10.5555/3305381.3305498]
[5]  
Garcia V., 2017, arXiv
[6]   Dynamic Few-Shot Visual Learning without Forgetting [J].
Gidaris, Spyros ;
Komodakis, Nikos .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :4367-4375
[7]  
Hamilton WL, 2017, ADV NEUR IN, V30
[8]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[9]  
Hu H., 2018, Few-Shot Learning
[10]   SAPENet: Self-Attention based Prototype Enhancement Network for Few-shot Learning [J].
Huang, Xilang ;
Choi, Seon Han .
PATTERN RECOGNITION, 2023, 135