An Adversarial Meta-Training Framework for Cross-Domain Few-Shot Learning

被引:14
作者
Tian, Pinzhuo [1 ]
Xie, Shaorong [1 ]
机构
[1] Shanghai Univ, Sch Comp Engn & Sci, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Meta-learning; adversarial training; cross-domain few-shot Learning; NETWORKS;
D O I
10.1109/TMM.2022.3215310
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Meta-learning provides a promising way for deep learning models to efficiently learn in few-shot learning. With this capacity, many deep learning systems can be applied in many real applications. However, many existing meta-learning based few-shot learning systems suffer from vulnerable generalization when new tasks are from unseen domains (a.k.a, cross-domain few-shot learning). In this work, we consider this problem from the perspective of designing a model-agnostic meta-training framework to improve the generalization of existing meta-learning methods in cross-domain few-shot learning. In this way, compared with focusing on elaborately designing modules for a specific meta-learning model, our method is endowed with the ability to be compatible with different meta-learning models in various few-shot problems. To achieve this goal, a novel adversarial meta-training framework is proposed. The proposed framework utilizes max-min episodic iteration. In the episode of maximization, our framework focuses on how to dynamically generate appropriate pseudo tasks which benefit learning cross-domain knowledge. In the episode of minimization, our method aims to solve how to help meta-learning model learn cross-task and robust meta-knowledge. To comprehensively evaluate our framework, experiments are conducted on two few-shot learning settings, three meta-learning models, and eight datasets. These results demonstrate that our method is applicable to various meta-learning models in different few-shot learning problems. The superiority of our method is verified compared with existing state-of-the-art methods.
引用
收藏
页码:6881 / 6891
页数:11
相关论文
共 62 条
[1]   IFSS-Net: Interactive Few-Shot Siamese Network for Faster Muscle Segmentation and Propagation in Volumetric Ultrasound [J].
Al Chanti, Dawood ;
Duque, Vanessa Gonzalez ;
Crouzier, Marion ;
Nordez, Antoine ;
Lacourpaille, Lilian ;
Mateus, Diana .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (10) :2615-2628
[2]  
[Anonymous], 2017, INT C LEARN REPR
[3]  
Antoniou A., 2019, P 9 BALK C INF SOF B, DOI DOI 10.1145/3351556.3351574
[4]   Improved Few-Shot Visual Classification [J].
Bateni, Peyman ;
Goyal, Raghav ;
Masrani, Vaden ;
Wood, Frank ;
Sigal, Leonid .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :14481-14490
[5]   Image Deformation Meta-Networks for One-Shot Learning [J].
Chen, Zitian ;
Fu, Yanwei ;
Wang, Yu-Xiong ;
Ma, Lin ;
Liu, Wei ;
Hebert, Martial .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :8672-8681
[6]  
Codella N, 2019, Arxiv, DOI arXiv:1902.03368
[7]   An overview of bilevel optimization [J].
Colson, Benoit ;
Marcotte, Patrice ;
Savard, Gilles .
ANNALS OF OPERATIONS RESEARCH, 2007, 153 (01) :235-256
[8]   SUPPORT-VECTOR NETWORKS [J].
CORTES, C ;
VAPNIK, V .
MACHINE LEARNING, 1995, 20 (03) :273-297
[9]   Generative Adversarial Networks An overview [J].
Creswell, Antonia ;
White, Tom ;
Dumoulin, Vincent ;
Arulkumaran, Kai ;
Sengupta, Biswa ;
Bharath, Anil A. .
IEEE SIGNAL PROCESSING MAGAZINE, 2018, 35 (01) :53-65
[10]  
Finn C., 2018, P INT C LEARN REPR