TAAN: Task-Aware Attention Network for Few-shot Classification

被引:7
作者
Wang, Zhe [1 ]
Liu, Li [1 ]
Li, FanZhang [1 ]
机构
[1] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215006, Peoples R China
来源
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR) | 2021年
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
few-shot classification; metric learning; task-aware; task-relevant channel attention;
D O I
10.1109/ICPR48806.2021.9411967
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot classification aims to recognize unlabeled samples from unseen classes given only a few labeled samples. Current approaches of few-shot learning usually employ a metric-learning framework to learn a feature similarity comparison between a query (test) example and the few support (training) examples. However, these approaches all extract features from samples independently without looking at the entire task as a whole, and so fail to provide an enough discrimination to features. Moreover, the existing approaches lack the ability to select the most relevant features for the task at hand. In this work, we propose a novel algorithm called Task-Aware Attention Network (TAAN) to address the above problems in few-shot classification. By inserting a Task-Relevant Channel Attention Module into metric-based few-shot learners, TAAN generates channel attentions for each sample by aggregating the context of the entire support set and identifies the most relevant features for similarity comparison. The experiment demonstrates that TAAN is competitive in overall performance comparing to the recent state-of-the-art systems and improves the performance considerably over baseline systems on both mini-ImageNet and tiered-ImageNet benchmarks.
引用
收藏
页码:9130 / 9136
页数:7
相关论文
共 34 条
[21]  
Ren M., 2018, ICLR
[22]   ImageNet Large Scale Visual Recognition Challenge [J].
Russakovsky, Olga ;
Deng, Jia ;
Su, Hao ;
Krause, Jonathan ;
Satheesh, Sanjeev ;
Ma, Sean ;
Huang, Zhiheng ;
Karpathy, Andrej ;
Khosla, Aditya ;
Bernstein, Michael ;
Berg, Alexander C. ;
Fei-Fei, Li .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 115 (03) :211-252
[23]  
Santoro A, 2016, PR MACH LEARN RES, V48
[24]  
Satorras V. G., 2018, 6 INT C LEARN REPR I
[25]  
Selvaraju RR, 2020, INT J COMPUT VISION, V128, P336, DOI [10.1109/ICCV.2017.74, 10.1007/s11263-019-01228-7]
[26]  
Snell J, 2017, ADV NEUR IN, V30
[27]   Meta-Transfer Learning for Few-Shot Learning [J].
Sun, Qianru ;
Liu, Yaoyao ;
Chua, Tat-Seng ;
Schiele, Bernt .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :403-412
[28]   Learning to Compare: Relation Network for Few-Shot Learning [J].
Sung, Flood ;
Yang, Yongxin ;
Zhang, Li ;
Xiang, Tao ;
Torr, Philip H. S. ;
Hospedales, Timothy M. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1199-1208
[29]  
Vanschoren J., 2018, ARXIV181003548
[30]  
Vaswani A, 2017, ADV NEUR IN, V30