Maximum Mean and Covariance Discrepancy for Unsupervised Domain Adaptation

被引:1
作者
Wenju Zhang
Xiang Zhang
Long Lan
Zhigang Luo
机构
[1] National University of Defense Technology,Science and Technology on Parallel and Distributed Laboratory
[2] National University of Defense Technology,State Key Laboratory of High Performance Computing
[3] National University of Defense Technology,College of Computer
来源
Neural Processing Letters | 2020年 / 51卷
关键词
Domain adaptation; Image classification; Dimensionality reduction; Transfer learning;
D O I
暂无
中图分类号
学科分类号
摘要
A fundamental research topic in domain adaptation is how best to evaluate the distribution discrepancy across domains. The maximum mean discrepancy (MMD) is one of the most commonly used statistical distances in this field. However, information about distributions could be lost when adopting non-characteristic kernels by MMD. To address this issue, we devise a new distribution metric named maximum mean and covariance discrepancy (MMCD) by combining MMD and the proposed maximum covariance discrepancy (MCD). MCD probes the second-order statistics in reproducing kernel Hilbert space, which equips MMCD to capture more information compared to MMD alone. To verify the efficacy of MMCD, an unsupervised learning model based on MMCD abbreviated as McDA was proposed and efficiently optimized to resolve the domain adaptation problem. Experiments on image classification conducted on two benchmark datasets show that McDA outperforms other representative domain adaptation methods, which implies the effectiveness of MMCD in domain adaptation.
引用
收藏
页码:347 / 366
页数:19
相关论文
共 45 条
[1]  
Baktashmotlagh M(2016)Distribution-matching embedding for visual domain adaptation J Mach Learn Res 17 3760-3789
[2]  
Harandi M(2006)Integrating structured biological data by kernel maximum mean discrepancy Bioinformatics 22 e49-e57
[3]  
Salzmann M(2010)Domain adaptation problems: a DASVM classification technique and a circular validation strategy IEEE Trans Pattern Anal Mach Intell 32 770-787
[4]  
Borgwardt KM(2012)A kernel two-sample test J Mach Learn Res 13 723-773
[5]  
Gretton A(2017)Kernel mean embedding of distributions: a review and beyond Found Trends Mach Learn 10 1-141
[6]  
Rasch MJ(1997)Integral probability metrics and their generating classes of functions Adv Appl Probab 29 429-443
[7]  
Kriegel HP(2011)Domain adaptation via transfer component analysis IEEE Trans Neural Netw 22 199-210
[8]  
Schölkopf B(2010)A survey on transfer learning IEEE Trans Knowl Data Eng 22 1345-1359
[9]  
Smola AJ(2015)Visual domain adaptation: a survey of recent advances IEEE Signal Process Mag 32 53-69
[10]  
Bruzzone L(2010)Bregman divergence-based regularization for transfer subspace learning IEEE Trans Knowl Data Eng 22 929-942