Model Adaptation: Unsupervised Domain Adaptation without Source Data

被引:401
作者
Li, Rui [1 ]
Jiao, Qianfen [1 ]
Cao, Wenming [3 ]
Wong, Hau-San [1 ]
Wu, Si [2 ]
机构
[1] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[2] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Peoples R China
[3] Univ Hong Kong, Dept Stat & Actuarial Sci, Hong Kong, Peoples R China
来源
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020) | 2020年
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR42600.2020.00966
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we investigate a challenging unsupervised domain adaptation setting - unsupervised model adaptation. We aim to explore how to rely only on unlabeled target data to improve performance of an existing source prediction model on the target domain, since labeled source data may not be available in some real-world scenarios due to data privacy issues. For this purpose, we propose a new framework, which is referred to as collaborative class conditional generative adversarial net to bypass the dependence on the source data. Specifically, the prediction model is to be improved through generated target-style data, which provides more accurate guidance for the generator. As a result, the generator and the prediction model can collaborate with each other without source data. Furthermore, due to the lack of supervision from source data, we propose a weight constraint that encourages similarity to the source model. A clustering-based regularization is also introduced to produce more discriminative features in the target domain. Compared to conventional domain adaptation methods, our model achieves superior performance on multiple adaptation tasks with only unlabeled target data, which verifies its effectiveness in this challenging setting.
引用
收藏
页码:9638 / 9647
页数:10
相关论文
共 66 条
[31]  
Liu MY, 2017, ADV NEUR IN, V30
[32]  
Long M, 2016, PROCEEDINGS OF SYMPOSIUM OF POLICING DIPLOMACY AND THE BELT & ROAD INITIATIVE, 2016, P136
[33]  
Long MS, 2017, PR MACH LEARN RES, V70
[34]  
Long MS, 2015, PR MACH LEARN RES, V37, P97
[35]  
Long Mingsheng, 2018, Advances in Neural Information Processing Systems, V31
[36]  
Luo ZL, 2017, ADV NEUR IN, V30
[37]  
Mirza M., 2014, CONDITIONAL GENERATI
[38]   Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learning [J].
Miyato, Takeru ;
Maeda, Shin-Ichi ;
Koyama, Masanori ;
Ishii, Shin .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (08) :1979-1993
[39]  
Moiseev B, 2013, LECT NOTES COMPUT SC, V8192, P576, DOI 10.1007/978-3-319-02895-8_52
[40]  
Netzer Y, 2011, P NIPS WORKSH DEEP L