Leveraging the Feature Distribution in Transfer-Based Few-Shot Learning

被引:92
作者
Hu, Yuqing [1 ,2 ]
Gripon, Vincent [1 ]
Pateux, Stephane [2 ]
机构
[1] IMT Atlantique, Elect Dept, Brest, France
[2] Orange Labs, Cesson Sevigne, France
来源
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT II | 2021年 / 12892卷
关键词
Few-shot classification; Transfer learning; Semi-supervised learning;
D O I
10.1007/978-3-030-86340-1_39
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot classification is a challenging problem due to the uncertainty caused by using few labelled samples. In the past few years, methods have been proposed to solve few-shot classification, among which transfer-based methods have consistently proved to achieve the best performance. Following this vein, in this paper we propose a novel transfer-based method that builds on two successive steps: 1) preprocessing the feature vectors so that they become closer to Gaussian-like distributions, and 2) leveraging this preprocessing using an optimal-transport inspired algorithm. Using standardized vision benchmarks, we prove the ability of the proposed methodology to achieve state-of-the-art accuracy with various datasets, backbone architectures and few-shot settings.
引用
收藏
页码:487 / 499
页数:13
相关论文
共 31 条
[1]  
[Anonymous], 2018, INT C LEARN REPR ICL
[2]  
Bertinetto L., 2019, INT C LEARN REPR
[3]  
Chapelle O., 2009, IEEE Transactions on Neural Networks, V20, P542, DOI [DOI 10.1109/TNN.2009.2015974, 10.1109/TNN.2009.2015974]
[4]  
Chen Wei-Yu, 2019, A closer look at few-shot classification
[5]   Image Deformation Meta-Networks for One-Shot Learning [J].
Chen, Zitian ;
Fu, Yanwei ;
Wang, Yu-Xiong ;
Ma, Lin ;
Liu, Wei ;
Hebert, Martial .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :8672-8681
[6]  
Cuturi M., 2013, ADV NEURAL INF PROCE, V26
[7]   A Two-Stage Approach to Few-Shot Learning for Image Recognition [J].
Das, Debasmit ;
Lee, C. S. George .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :3336-3350
[8]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[9]  
Finn C, 2017, PR MACH LEARN RES, V70
[10]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778