Adversarial open set domain adaptation via progressive selection of transferable target samples

被引:14
作者
Gao, Yuan [1 ]
Ma, Andy J. [1 ,3 ]
Gao, Yue [1 ]
Wang, Jinpeng [2 ]
Pan, YoungSun [1 ]
机构
[1] Sun Yat Sen Univ, Sch Data & Comp Sci, Guangzhou, Peoples R China
[2] Sun Yat Sen Univ, Sch Elect & Informat Technol, Guangzhou, Peoples R China
[3] Minist Educ, Key Lab Machine Intelligence & Adv Comp, Guangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
Open set domain adaptation; Adversarial learning; Progressive selection;
D O I
10.1016/j.neucom.2020.05.032
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, many Unsupervised Domain Adaptation (UDA) methods have been proposed to tackle the domain shift problem. Most existing UDA methods are derived for Close Set Domain Adaptation (CSDA) in which source and target domains are assumed to share the same label space. However, target domain may contain unknown class different from the known ones in the source domain in practice, i.e., Open Set Domain Adaptation (OSDA). Due to the presence of unknown class, aligning the whole distribution of the source and target domain for OSDA as in the previous methods will lead to negative transfer. Existing methods developed for OSDA attempt to assign smaller weights to target samples of unknown class. Despite promising performance achieved by existing methods, the samples of the unknown class are still used for distribution alignment, which makes the model suffer from the risk of negative transfer. Instead of reweighting, this paper presents a novel method namely Thresholded Domain Adversarial Network (ThDAN), which progressively selects transferable target samples for distribution alignment. Based on the fact that samples from the known classes must be more transferable than target samples of the unknown one, we derive a criterion to quantify the transferability by constructing classifiers to categorize known classes and to discriminate unknown class. In ThDAN, an adaptive threshold is calculated by averaging transferability scores of source domain samples to select target samples for training. The threshold is tweaked progressively during the training process so that more and more target samples from the known classes can be correctly selected for adversarial training. Extensive experiments show that the proposed method outperforms state-of-the-art domain adaptation and open set recognition approaches on benchmarks. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:174 / 184
页数:11
相关论文
共 47 条
  • [31] Domain adaptation via Multi-Layer Transfer Learning
    Pan, Jianhan
    Hu, Xuegang
    Li, Peipei
    Li, Huizong
    He, Wei
    Zhang, Yuhong
    Lin, Yaojin
    [J]. NEUROCOMPUTING, 2016, 190 : 10 - 24
  • [32] A Survey on Transfer Learning
    Pan, Sinno Jialin
    Yang, Qiang
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2010, 22 (10) : 1345 - 1359
  • [33] Peng X., ARXIV171006924
  • [34] On the momentum term in gradient descent learning algorithms
    Qian, N
    [J]. NEURAL NETWORKS, 1999, 12 (01) : 145 - 151
  • [35] From source to target and back: Symmetric Bi-Directional Adaptive GAN
    Russo, Paolo
    Carlucci, Fabio M.
    Tommasi, Tatiana
    Caputo, Barbara
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8099 - 8108
  • [36] Adapting Visual Category Models to New Domains
    Saenko, Kate
    Kulis, Brian
    Fritz, Mario
    Darrell, Trevor
    [J]. COMPUTER VISION-ECCV 2010, PT IV, 2010, 6314 : 213 - +
  • [37] Open Set Domain Adaptation by Backpropagation
    Saito, Kuniaki
    Yamamoto, Shohei
    Ushiku, Yoshitaka
    Harada, Tatsuya
    [J]. COMPUTER VISION - ECCV 2018, PT V, 2018, 11209 : 156 - 171
  • [38] Toward Open Set Recognition
    Scheirer, Walter J.
    Rocha, Anderson de Rezende
    Sapkota, Archana
    Boult, Terrance E.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (07) : 1757 - 1772
  • [39] Simonyan K, 2015, Arxiv, DOI [arXiv:1409.1556, DOI 10.48550/ARXIV.1409.1556]
  • [40] Deep CORAL: Correlation Alignment for Deep Domain Adaptation
    Sun, Baochen
    Saenko, Kate
    [J]. COMPUTER VISION - ECCV 2016 WORKSHOPS, PT III, 2016, 9915 : 443 - 450