Learning smooth representations with generalized softmax for unsupervised domain adaptation

被引:22
作者
Han, Chao [1 ]
Lei, Yu [1 ]
Xie, Yu [2 ]
Zhou, Deyun [1 ]
Gong, Maoguo [2 ]
机构
[1] Northwestern Polytech Univ, Sch Elect & Informat, 127 West Youyi Rd, Xian 710072, Shaanxi, Peoples R China
[2] Xidian Univ, Minist Educ, Key Lab Intelligent Percept & Image Understanding, Sch Elect Engn, 2 South TaiBai Rd, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain adaptation; Generalized softmax; Smoothness regularization;
D O I
10.1016/j.ins.2020.08.075
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Domain adaptation aims at training accurate classifiers in a target domain by utilizing the data in a different but related source domain, which has made great progress in many aspects. Most of existing methods try to match the moments of data by mapping them to feature space, either first or second moment, so as to match the distribution. Despite their appeal, such models often fail to guarantee the obtained features can be well-classified. In this paper, we propose generalized softmax and smooth regularization to extract features and adapt classifiers simultaneously. Considering label matrix as special features, generalized softmax has more tolerance to the diversity of samples belonging to the same class. Smoothness regularization guarantees stronger robustness between target features and decision boundary. Finally, we evaluate our method on several standard benchmark datasets. Empirical evidence shows that the proposed method is comparable or superior to existing methods, and the same results based on two classification schemes indicate that the smoothness regularization is effective. (C) 2020 Elsevier Inc. All rights reserved.
引用
收藏
页码:415 / 426
页数:12
相关论文
共 41 条
[1]  
[Anonymous], 2017, P 34 INT C MACH LEAR
[2]  
[Anonymous], 2017, P IEEE C COMP VIS PA
[3]  
[Anonymous], 2017, IEEE INT C COMP VIS
[4]   A theory of learning from different domains [J].
Ben-David, Shai ;
Blitzer, John ;
Crammer, Koby ;
Kulesza, Alex ;
Pereira, Fernando ;
Vaughan, Jennifer Wortman .
MACHINE LEARNING, 2010, 79 (1-2) :151-175
[5]  
Blitzer J., 2007, P NIPS, P129
[6]  
Chen C, 2019, AAAI CONF ARTIF INTE, P3296
[7]  
Coates Adam, 2012, Neural Networks: Tricks of the Trade. Second Edition: LNCS 7700, P561, DOI 10.1007/978-3-642-35289-8_30
[8]  
Crammer K., 2007, NEURIPS, P137, DOI 10.7551/mitpress/7503.003.0022
[9]   Robust Transfer Metric Learning for Image Classification [J].
Ding, Zhengming ;
Fu, Yun .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (02) :660-670
[10]  
Ganin Y, 2016, J MACH LEARN RES, V17