Learning a Domain-Invariant Embedding for Unsupervised Domain Adaptation Using Class-Conditioned Distribution Alignment

被引:0
|
作者
Gabourie, Alexander J. [1 ]
Rostami, Mohammad [2 ]
Pope, Philip E. [3 ]
Kolouri, Soheil [3 ]
Kim, Kyungnam [3 ]
机构
[1] Stanford Univ, Dept Elect Engn, Stanford, CA 94305 USA
[2] Univ Penn, Dept Elect & Syst Engn, Philadelphia, PA 19104 USA
[3] HRL Labs LLC, Informat & Syst Lab, Malibu, CA USA
关键词
D O I
10.1109/allerton.2019.8919960
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We address the problem of unsupervised domain adaptation (UDA) by learning a cross-domain agnostic embedding space, where the distance between the probability distributions of the two source and target visual domains is minimized. We use the output space of a shared cross-domain deep encoder to model the embedding space and use the Sliced-Wasserstein Distance (SWD) to measure and minimize the distance between the embedded distributions of two source and target domains to enforce the embedding to be domain-agnostic. Additionally, we use the source domain labeled data to train a deep classifier from the embedding space to the label space to enforce the embedding space to be discriminative. As a result of this training scheme, we provide an effective solution to train the deep classification network on the source domain such that it will generalize well on the target domain, where only unlabeled training data is accessible. To mitigate the challenge of class matching, we also align corresponding classes in the embedding space by using high confidence pseudo-labels for the target domain, i.e. assigning the class for which the source classifier has a high prediction probability. We provide experimental results on UDA benchmark tasks to demonstrate that our method is effective and leads to state-of-the-art performance.
引用
收藏
页码:352 / 359
页数:8
相关论文
共 50 条
  • [21] Exploring Domain-Invariant Parameters for Source Free Domain Adaptation
    Wang, Fan
    Han, Zhongyi
    Gong, Yongshun
    Yin, Yilong
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 7141 - 7150
  • [22] Unsupervised Domain Adaptation by Domain Invariant Projection
    Baktashmotlagh, Mahsa
    Harandi, Mehrtash T.
    Lovell, Brian C.
    Salzmann, Mathieu
    2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 769 - 776
  • [23] Unsupervised Domain Adaptation with Unified Joint Distribution Alignment
    Du, Yuntao
    Tan, Zhiwen
    Zhang, Xiaowen
    Yao, Yirong
    Yu, Hualei
    Wang, Chongjun
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2021), PT II, 2021, 12682 : 449 - 464
  • [24] Geodesic Kernel embedding Distribution Alignment for domain adaptation
    Pan, Deng
    Yang, Hyunho
    JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2020, 20 (04) : 1325 - 1338
  • [25] Unsupervised Domain Adaptation Method Based on Domain-Invariant Features Evaluation and Knowledge Distillation for Bearing Fault Diagnosis
    Sun, Kong
    Bo, Lin
    Ran, Haoting
    Tang, Zhi
    Bi, Yuanliang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [26] Class conditional distribution alignment for domain adaptation
    Kai Cao
    Zhipeng Tu
    Yang Ming
    Control Theory and Technology, 2020, 18 : 72 - 80
  • [27] Class conditional distribution alignment for domain adaptation
    Cao, Kai
    Tu, Zhipeng
    Ming, Yang
    CONTROL THEORY AND TECHNOLOGY, 2020, 18 (01) : 72 - 80
  • [28] Inter-class distribution alienation and inter-domain distribution alignment based on manifold embedding for domain adaptation
    Li, Ping
    Ni, Zhiwei
    Zhu, Xuhui
    Song, Juan
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2020, 39 (06) : 8149 - 8159
  • [29] Unsupervised Domain-Invariant Feature Learning for Cloud Detection of Remote Sensing Images
    Guo, Jianhua
    Yang, Jingyu
    Yue, Huanjing
    Liu, Xin
    Li, Kun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [30] Class-Aware Distribution Alignment based Unsupervised Domain Adaptation for Speaker Verification
    Hu, Hang-Rui
    Song, Yan
    Dai, Li-Rong
    McLoughlin, Ian
    Liu, Lin
    INTERSPEECH 2022, 2022, : 3689 - 3693