Learning a Domain-Invariant Embedding for Unsupervised Domain Adaptation Using Class-Conditioned Distribution Alignment

被引:0
|
作者
Gabourie, Alexander J. [1 ]
Rostami, Mohammad [2 ]
Pope, Philip E. [3 ]
Kolouri, Soheil [3 ]
Kim, Kyungnam [3 ]
机构
[1] Stanford Univ, Dept Elect Engn, Stanford, CA 94305 USA
[2] Univ Penn, Dept Elect & Syst Engn, Philadelphia, PA 19104 USA
[3] HRL Labs LLC, Informat & Syst Lab, Malibu, CA USA
关键词
D O I
10.1109/allerton.2019.8919960
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We address the problem of unsupervised domain adaptation (UDA) by learning a cross-domain agnostic embedding space, where the distance between the probability distributions of the two source and target visual domains is minimized. We use the output space of a shared cross-domain deep encoder to model the embedding space and use the Sliced-Wasserstein Distance (SWD) to measure and minimize the distance between the embedded distributions of two source and target domains to enforce the embedding to be domain-agnostic. Additionally, we use the source domain labeled data to train a deep classifier from the embedding space to the label space to enforce the embedding space to be discriminative. As a result of this training scheme, we provide an effective solution to train the deep classification network on the source domain such that it will generalize well on the target domain, where only unlabeled training data is accessible. To mitigate the challenge of class matching, we also align corresponding classes in the embedding space by using high confidence pseudo-labels for the target domain, i.e. assigning the class for which the source classifier has a high prediction probability. We provide experimental results on UDA benchmark tasks to demonstrate that our method is effective and leads to state-of-the-art performance.
引用
收藏
页码:352 / 359
页数:8
相关论文
共 50 条
  • [41] ATTENTIVE ADVERSARIAL LEARNING FOR DOMAIN-INVARIANT TRAINING
    Meng, Zhong
    Li, Jinyu
    Gong, Yifan
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 6740 - 6744
  • [42] Prompt-Based Distribution Alignment for Unsupervised Domain Adaptation
    Bai, Shuanghao
    Zhang, Min
    Zhou, Wanqi
    Huang, Siteng
    Luan, Zhirong
    Wang, Donglin
    Chen, Badong
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2, 2024, : 729 - 737
  • [43] LEARNING DOMAIN-INVARIANT TRANSFORMATION FOR SPEAKER VERIFICATION
    Zhang, Hanyi
    Wang, Longbiao
    Lee, Kong Aik
    Liu, Meng
    Dang, Jianwu
    Chen, Hui
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 7177 - 7181
  • [44] Class Discriminative Adversarial Learning for Unsupervised Domain Adaptation
    Zhou, Lihua
    Ye, Mao
    Zhu, Xiatian
    Li, Shuaifeng
    Liu, Yiguang
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 4318 - 4326
  • [45] Homeomorphism Alignment for Unsupervised Domain Adaptation
    Zhou, Lihua
    Ye, Mao
    Zhu, Xiatian
    Xiao, Siying
    Fan, Xu-Qian
    Neri, Ferrante
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 18653 - 18664
  • [46] Gradient-aware domain-invariant learning for domain generalizationGradient-Aware Domain-Invariant Learning for Domain GeneralizationF. Hou et al.
    Feng Hou
    Yao Zhang
    Yang Liu
    Jin Yuan
    Cheng Zhong
    Yang Zhang
    Zhongchao Shi
    Jianping Fan
    Zhiqiang He
    Multimedia Systems, 2025, 31 (1)
  • [47] Learning Domain-Invariant Representations of Histological Images
    Lafarge, Maxime W.
    Pluim, Josien P. W.
    Eppenhof, Koen A. J.
    Veta, Mitko
    FRONTIERS IN MEDICINE, 2019, 6
  • [48] Exploiting Variational Domain-Invariant User Embedding for Partially Overlapped Cross Domain Recommendation
    Liu, Weiming
    Zheng, Xiaolin
    Su, Jiajie
    Hu, Mengling
    Tan, Yanchao
    Chen, Chaochao
    PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 312 - 321
  • [49] Task-Discriminative Domain Alignment for Unsupervised Domain Adaptation
    Gholami, Behnam
    Sahu, Pritish
    Kim, Minyoung
    Pavlovic, Vladimir
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 1327 - 1336
  • [50] MultiDIAL: Domain Alignment Layers for (Multisource) Unsupervised Domain Adaptation
    Carlucci, Fabio Maria
    Porzi, Lorenzo
    Caputo, Barbara
    Ricci, Elisa
    Bulo, Samuel Rota
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (12) : 4441 - 4452