A transductive learning method to leverage graph structure for few-shot learning

被引:4
作者
Wang, Yaning [1 ]
Liu, Zijian [1 ]
Luo, Yang [1 ]
Luo, Chunbo [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 611731, Peoples R China
关键词
few-shot learning; clustering; semi-supervised learning; graph neural networks;
D O I
10.1016/j.patrec.2022.05.013
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot learning has attracted extensive research attention given its capability to classify unseen data from limited samples, potentially addressing the key issue of data scarcity commonly existing in many machine learning tasks. This paper proposes a new transductive learning method that integrates information propagation and prototype rectification in few-shot learning, which achieves state-of-the-art classification performance on four popular datasets. We use first-order information propagation instead of infinite order method to avoid the over-smoothing caused by iterations of information aggregation and node updating in graph neural networks. We further reveal that current transductive few-shot learning models often assume the datasets have balanced classes, which cannot be guaranteed in practice. We thus propose to estimate the distribution of task samples to optimize the number of iterations so as to enhance the robustness of the model. Extensive experiments validate the proposed model and reveal the confirmation bias that could be effectively addressed by the optimization strategy. (C) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:189 / 195
页数:7
相关论文
共 31 条
[1]  
[Anonymous], 2016, OPTIMIZATION MODEL F
[2]  
[Anonymous], 2009, Rep. TR-2009
[3]  
Bertinetto Luca, 2018, INT C LEARNING REPRE
[4]  
Chen W.-Y., 2018, INT C LEARNING REPRE
[5]  
Finn C, 2017, PR MACH LEARN RES, V70
[6]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448
[7]  
He K., 2017, P IEEE INT C COMPUTE, P2980, DOI [DOI 10.1109/ICCV.2017.322, 10.1109/ICCV.2017.322]
[8]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[9]  
Hou RB, 2019, ADV NEUR IN, V32
[10]   Densely Connected Convolutional Networks [J].
Huang, Gao ;
Liu, Zhuang ;
van der Maaten, Laurens ;
Weinberger, Kilian Q. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2261-2269