Duplex adversarial networks for multiple-source domain adaptation

被引:7
作者
Zhou, Qiang [1 ]
Zhou, Wen'an [1 ]
Wang, Shirui [1 ]
Xing, Ying [2 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Comp Sci, Beijing 100876, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Automat, Beijing 100876, Peoples R China
关键词
Multiple source domain adaptation; Image classification; Adversarial learning;
D O I
10.1016/j.knosys.2020.106569
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Domain adaptation is a powerful tool for transferring the knowledge of the source domain with sufficient annotations for target tasks. However, most existing domain adaptation methods focus on the single-source-single-target adaptation setting, which ignore that existing different but related multiple source domains are available for target tasks. In this paper, we propose a novel theoretical generalization bound for multiple source domain adaptation, which averages the multiple source hypothesis risks by using HH-distance with an assumption that the target hypothesis is the combination of all the source hypotheses. Following this theoretical result, we propose a new algorithm called Duplex Adversarial Networks for Multi-source Adaptation (DAN_MA): one adversarial network is utilized for feature generator to learn domain invariant representations between source and target domains with a domain classifier for each pair of source and target; the other is utilized to eliminate the domain characteristics among different sources by making target samples close to each source task-specific decision boundaries. The shared feature generator aims to learn target representations which are invariant to the multiple domain shifts while still close to the source decision boundaries. Extensive experiments show that our method outperforms other domain adaptation methods on three public datasets. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 43 条
  • [1] [Anonymous], 2009, 22 C LEARN THEOR COL
  • [2] [Anonymous], 2016, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2016.90
  • [3] [Anonymous], 2011, P IEEECVF C COMPUTER
  • [4] [Anonymous], 2016, ECCV WORKSH
  • [5] A theory of learning from different domains
    Ben-David, Shai
    Blitzer, John
    Crammer, Koby
    Kulesza, Alex
    Pereira, Fernando
    Vaughan, Jennifer Wortman
    [J]. MACHINE LEARNING, 2010, 79 (1-2) : 151 - 175
  • [6] Blitzer J., 2008, P INT C NEUR INF PRO, P129
  • [7] Bousmalis K, 2016, ADV NEUR IN, V29
  • [8] Multiple-source domain adaptation with generative adversarial nets
    Chen, Chaoqi
    Xie, Weiping
    Wen, Yi
    Huang, Yue
    Ding, Xinghao
    [J]. KNOWLEDGE-BASED SYSTEMS, 2020, 199 (199)
  • [9] Cortes C, 2019, J MACH LEARN RES, V20
  • [10] Image-Image Domain Adaptation with Preserved Self-Similarity and Domain-Dissimilarity for Person Re-identification
    Deng, Weijian
    Zheng, Liang
    Ye, Qixiang
    Kang, Guoliang
    Yang, Yi
    Jiao, Jianbin
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 994 - 1003