ATPL: Mutually enhanced adversarial training and pseudo labeling for unsupervised domain adaptation

被引:5
作者
Yi, Chang'an [1 ]
Chen, Haotian [1 ]
Xu, Yonghui [2 ]
Liu, Yong [3 ]
Jiang, Lei [4 ]
Tan, Haishu [1 ]
机构
[1] Foshan Univ, Sch Elect & Informat Engn, Sch Mechatron Engn & Automat, Sch Phys & Optoelect, Foshan 528225, Peoples R China
[2] Shandong Univ, Joint SDU NTU Ctr Artificial Intelligence Res C FA, Jinan 250100, Peoples R China
[3] Nanyang Technol Univ, Joint NTU UBC Res Ctr Excellence Act Living Elderl, Singapore 639798, Singapore
[4] Alibaba Grp, Hangzhou 310099, Peoples R China
基金
国家重点研发计划;
关键词
Adversarial training; Pseudo labeling; Domain adaptation;
D O I
10.1016/j.knosys.2022.108831
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised domain adaptation aims to transfer knowledge from a labeled source domain to a related but unlabeled target domain. Most existing approaches either adversarially reduce the domain shift or use pseudo-labels to provide category information during adaptation. However, an adversarial training method may sacrifice the discriminability of the target data, since no category information is available. Moreover, a pseudo labeling method is difficult to produce high-confidence samples, since the classifier is often source-trained and there exists the domain discrepancy. Thus, it may have a negative influence on learning target representations. A potential solution is to make them compensate each other to simultaneously guarantee the feature transferability and discriminability, which are the two key criteria of feature representations in domain adaptation. In this paper, we propose a novel method named ATPL, which mutually promotes Adversarial Training and Pseudo Labeling for unsupervised domain adaptation. ATPL can produce high-confidence pseudo-labels by adversarial training. Accordingly, ATPL will use the pseudo-labeled information to improve the adversarial training process, which can guarantee the feature transferability by generating adversarial data to fill in the domain gap. Those pseudo-labels can also boost the feature discriminability. Extensive experiments on real datasets demonstrate that the proposed ATPL method outperforms state-of-the-art unsupervised domain adaptation methods. (C) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:10
相关论文
共 52 条
[1]  
Anirban C., 2018, ARXIV PREPRINT ARXIV
[2]  
Bascol K, 2019, IEEE IMAGE PROC, P3043, DOI [10.1109/ICIP.2019.8803325, 10.1109/icip.2019.8803325]
[3]   A theory of learning from different domains [J].
Ben-David, Shai ;
Blitzer, John ;
Crammer, Koby ;
Kulesza, Alex ;
Pereira, Fernando ;
Vaughan, Jennifer Wortman .
MACHINE LEARNING, 2010, 79 (1-2) :151-175
[4]   Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networks [J].
Bousmalis, Konstantinos ;
Silberman, Nathan ;
Dohan, David ;
Erhan, Dumitru ;
Krishnan, Dilip .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :95-104
[5]  
Chen XY, 2019, PR MACH LEARN RES, V97
[6]   Domain Adaptive Faster R-CNN for Object Detection in the Wild [J].
Chen, Yuhua ;
Li, Wen ;
Sakaridis, Christos ;
Dai, Dengxin ;
Van Gool, Luc .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3339-3348
[7]  
Choi Jaehoon, 2019, ARXIV PREPRINT ARXIV
[8]  
Eric T., 2014, ARXIV PREPRINT ARXIV
[9]  
Ganin Y, 2016, J MACH LEARN RES, V17
[10]  
Ge Y., ARXIV PREPRINT ARXIV