An Adversarial Meta-Training Framework for Cross-Domain Few-Shot Learning

被引:14
作者
Tian, Pinzhuo [1 ]
Xie, Shaorong [1 ]
机构
[1] Shanghai Univ, Sch Comp Engn & Sci, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Meta-learning; adversarial training; cross-domain few-shot Learning; NETWORKS;
D O I
10.1109/TMM.2022.3215310
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Meta-learning provides a promising way for deep learning models to efficiently learn in few-shot learning. With this capacity, many deep learning systems can be applied in many real applications. However, many existing meta-learning based few-shot learning systems suffer from vulnerable generalization when new tasks are from unseen domains (a.k.a, cross-domain few-shot learning). In this work, we consider this problem from the perspective of designing a model-agnostic meta-training framework to improve the generalization of existing meta-learning methods in cross-domain few-shot learning. In this way, compared with focusing on elaborately designing modules for a specific meta-learning model, our method is endowed with the ability to be compatible with different meta-learning models in various few-shot problems. To achieve this goal, a novel adversarial meta-training framework is proposed. The proposed framework utilizes max-min episodic iteration. In the episode of maximization, our framework focuses on how to dynamically generate appropriate pseudo tasks which benefit learning cross-domain knowledge. In the episode of minimization, our method aims to solve how to help meta-learning model learn cross-task and robust meta-knowledge. To comprehensively evaluate our framework, experiments are conducted on two few-shot learning settings, three meta-learning models, and eight datasets. These results demonstrate that our method is applicable to various meta-learning models in different few-shot learning problems. The superiority of our method is verified compared with existing state-of-the-art methods.
引用
收藏
页码:6881 / 6891
页数:11
相关论文
共 62 条
[21]   3D Object Representations for Fine-Grained Categorization [J].
Krause, Jonathan ;
Stark, Michael ;
Deng, Jia ;
Li Fei-Fei .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2013, :554-561
[22]   Meta-Learning with Differentiable Convex Optimization [J].
Lee, Kwonjoon ;
Maji, Subhransu ;
Ravichandran, Avinash ;
Soatto, Stefano .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :10649-10657
[23]   Universal Representation Learning from Multiple Domains for Few-shot Classification [J].
Li, Wei-Hong ;
Liu, Xialei ;
Bilen, Hakan .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :9506-9515
[24]   Learning multi-level weight-centric features for few-shot learning [J].
Liang, Mingjiang ;
Huang, Shaoli ;
Pan, Shirui ;
Gong, Mingming ;
Liu, Wei .
PATTERN RECOGNITION, 2022, 128
[25]  
Liu L., 2020, P INT C LEARN REPR
[26]   A Multi-Mode Modulator for Multi-Domain Few-Shot Classification [J].
Liu, Yanbin ;
Lee, Juho ;
Zhu, Linchao ;
Chen, Ling ;
Shi, Humphrey ;
Yang, Yi .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :8433-8442
[27]  
Maji S, 2013, Arxiv, DOI arXiv:1306.5151
[28]  
Mishra N, 2018, Arxiv, DOI arXiv:1707.03141
[29]   Using Deep Learning for Image-Based Plant Disease Detection [J].
Mohanty, Sharada P. ;
Hughes, David P. ;
Salathe, Marcel .
FRONTIERS IN PLANT SCIENCE, 2016, 7
[30]  
Munkhdalai T, 2017, PR MACH LEARN RES, V70