Adversarial open set domain adaptation via progressive selection of transferable target samples

被引:14
作者
Gao, Yuan [1 ]
Ma, Andy J. [1 ,3 ]
Gao, Yue [1 ]
Wang, Jinpeng [2 ]
Pan, YoungSun [1 ]
机构
[1] Sun Yat Sen Univ, Sch Data & Comp Sci, Guangzhou, Peoples R China
[2] Sun Yat Sen Univ, Sch Elect & Informat Technol, Guangzhou, Peoples R China
[3] Minist Educ, Key Lab Machine Intelligence & Adv Comp, Guangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
Open set domain adaptation; Adversarial learning; Progressive selection;
D O I
10.1016/j.neucom.2020.05.032
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, many Unsupervised Domain Adaptation (UDA) methods have been proposed to tackle the domain shift problem. Most existing UDA methods are derived for Close Set Domain Adaptation (CSDA) in which source and target domains are assumed to share the same label space. However, target domain may contain unknown class different from the known ones in the source domain in practice, i.e., Open Set Domain Adaptation (OSDA). Due to the presence of unknown class, aligning the whole distribution of the source and target domain for OSDA as in the previous methods will lead to negative transfer. Existing methods developed for OSDA attempt to assign smaller weights to target samples of unknown class. Despite promising performance achieved by existing methods, the samples of the unknown class are still used for distribution alignment, which makes the model suffer from the risk of negative transfer. Instead of reweighting, this paper presents a novel method namely Thresholded Domain Adversarial Network (ThDAN), which progressively selects transferable target samples for distribution alignment. Based on the fact that samples from the known classes must be more transferable than target samples of the unknown one, we derive a criterion to quantify the transferability by constructing classifiers to categorize known classes and to discriminate unknown class. In ThDAN, an adaptive threshold is calculated by averaging transferability scores of source domain samples to select target samples for training. The threshold is tweaked progressively during the training process so that more and more target samples from the known classes can be correctly selected for adversarial training. Extensive experiments show that the proposed method outperforms state-of-the-art domain adaptation and open set recognition approaches on benchmarks. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:174 / 184
页数:11
相关论文
共 47 条
  • [1] [Anonymous], ARXIV14123474
  • [2] [Anonymous], 2017, P INT C LEARN REPR
  • [3] Baktashmotlagh M., 2019, P INT C LEARN REPR
  • [4] A theory of learning from different domains
    Ben-David, Shai
    Blitzer, John
    Crammer, Koby
    Kulesza, Alex
    Pereira, Fernando
    Vaughan, Jennifer Wortman
    [J]. MACHINE LEARNING, 2010, 79 (1-2) : 151 - 175
  • [5] Towards Open Set Deep Networks
    Bendale, Abhijit
    Boult, Terrance E.
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 1563 - 1572
  • [6] Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networks
    Bousmalis, Konstantinos
    Silberman, Nathan
    Dohan, David
    Erhan, Dumitru
    Krishnan, Dilip
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 95 - 104
  • [7] Open Set Domain Adaptation
    Busto, Pau Panareda
    Gall, Juergen
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 754 - 763
  • [8] Learning to Transfer Examples for Partial Domain Adaptation
    Cao, Zhangjie
    You, Kaichao
    Long, Mingsheng
    Wang, Jianmin
    Yang, Qiang
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 2980 - 2989
  • [9] Partial Transfer Learning with Selective Adversarial Networks
    Cao, Zhangjie
    Long, Mingsheng
    Wang, Jianmin
    Jordan, Michael I.
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 2724 - 2732
  • [10] AutoDIAL: Automatic DomaIn Alignment Layers
    Carlucci, Fabio Maria
    Porzi, Lorenzo
    Caputo, Barbara
    Ricci, Elisa
    Bulo, Samuel Rota
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 5077 - 5085