Multi-Scale Metric Learning for Few-Shot Learning

被引:206
作者
Jiang, Wen [1 ]
Huang, Kai [1 ]
Geng, Jie [1 ]
Deng, Xinyang [1 ]
机构
[1] Northwestern Polytech Univ, Sch Elect & Informat, Xian 710129, Peoples R China
基金
中国国家自然科学基金;
关键词
Measurement; Feature extraction; Task analysis; Training; Semantics; Neural networks; Learning systems; Few-shot learning; multi-scale feature maps; metric learning; DEEP; ADAPTATION; NETWORKS;
D O I
10.1109/TCSVT.2020.2995754
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Few-shot learning in image classification is developed to learn a model that aims to identify unseen classes with only few training samples for each class. Fewer training samples and new tasks of classification make many traditional classification models no longer applicable. In this paper, a novel few-shot learning method named multi-scale metric learning (MSML) is proposed to extract multi-scale features and learn the multi-scale relations between samples for the classification of few-shot learning. In the proposed method, a feature pyramid structure is introduced for multi-scale feature embedding, which aims to combine high-level strong semantic features with low-level but abundant visual features. Then a multi-scale relation generation network (MRGN) is developed for hierarchical metric learning, in which high-level features are corresponding to deeper metric learning while low-level features are corresponding to lighter metric learning. Moreover, a novel loss function named intra-class and inter-class relation loss (IIRL) is proposed to optimize the proposed deep network, which aims to strengthen the correlation between homogeneous groups of samples and weaken the correlation between heterogeneous groups of samples. Experimental results on mini ImageNet and tiered ImageNet demonstrate that the proposed method achieves superior performance in few-shot learning problem.
引用
收藏
页码:1091 / 1102
页数:12
相关论文
共 56 条
[1]  
[Anonymous], 2015, TETRAHEDRON
[2]   PRESCHOOL-CHILDREN CAN LEARN TO TRANSFER - LEARNING TO LEARN AND LEARNING FROM EXAMPLE [J].
BROWN, AL ;
KANE, MJ .
COGNITIVE PSYCHOLOGY, 1988, 20 (04) :493-523
[3]   Multi-Level Semantic Feature Augmentation for One-Shot Learning [J].
Chen, Zitian ;
Fu, Yanwei ;
Zhang, Yinda ;
Jiang, Yu-Gang ;
Xue, Xiangyang ;
Sigal, Leonid .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (09) :4594-4605
[4]   Deep Adversarial Metric Learning [J].
Duan, Yueqi ;
Zheng, Wenzhao ;
Lin, Xudong ;
Lu, Jiwen ;
Zhou, Jie .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2780-2789
[5]  
Finn C, 2018, ADV NEUR IN, V31
[6]  
Finn C, 2017, PR MACH LEARN RES, V70
[7]  
Finn Chelsea, 2017, P MACHINE LEARNING R, V78
[8]   Transfer Learning for SAR Image Classification via Deep Joint Distribution Adaptation Networks [J].
Geng, Jie ;
Deng, Xinyang ;
Ma, Xiaorui ;
Jiang, Wen .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (08) :5377-5392
[9]  
Ghafoorian Mohsen, 2017, Medical Image Computing and Computer Assisted Intervention MICCAI 2017. 20th International Conference. Proceedings: LNCS 10435, P516, DOI 10.1007/978-3-319-66179-7_59
[10]   Negative transfer detection in transductive transfer learning [J].
Gui, Lin ;
Xu, Ruifeng ;
Lu, Qin ;
Du, Jiachen ;
Zhou, Yu .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2018, 9 (02) :185-197