Multi-representation adaptation network for cross-domain image classification

被引:186
作者
Zhu, Yongchun [1 ,2 ]
Zhuang, Fuzhen [1 ,2 ]
Wang, Jindong [3 ]
Chen, Jingwu [1 ,2 ]
Shi, Zhiping [4 ]
Wu, Wenjuan [5 ]
He, Qing [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Microsoft Res, Beijing, Peoples R China
[4] Capital Normal Univ, Beijing, Peoples R China
[5] Renmin Univ China, Sch Informat, Beijing 100872, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain adaptation; Multi-representation; KERNEL; ALIGNMENT;
D O I
10.1016/j.neunet.2019.07.010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In image classification, it is often expensive and time-consuming to acquire sufficient labels. To solve this problem, domain adaptation often provides an attractive option given a large amount of labeled data from a similar nature but different domains. Existing approaches mainly align the distributions of representations extracted by a single structure and the representations may only contain partial information, e.g., only contain part of the saturation, brightness, and hue information. Along this line, we propose Multi-Representation Adaptation which can dramatically improve the classification accuracy for cross-domain image classification and specially aims to align the distributions of multiple representations extracted by a hybrid structure named Inception Adaptation Module (IAM). Based on this, we present Multi-Representation Adaptation Network (MRAN) to accomplish the cross-domain image classification task via multi-representation alignment which can capture the information from different aspects. In addition, we extend Maximum Mean Discrepancy (MMD) to compute the adaptation loss. Our approach can be easily implemented by extending most feed-forward models with IAM, and the network can be trained efficiently via back-propagation. Experiments conducted on three benchmark image datasets demonstrate the effectiveness of MRAN. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:214 / 221
页数:8
相关论文
共 52 条
  • [11] Ganin Y, 2015, PR MACH LEARN RES, V37, P1180
  • [12] Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation
    Ghifary, Muhammad
    Kleijn, W. Bastiaan
    Zhang, Mengjie
    Balduzzi, David
    Li, Wen
    [J]. COMPUTER VISION - ECCV 2016, PT IV, 2016, 9908 : 597 - 613
  • [13] Glorot X., 2011, Proceedings of the 28th international conference on machine learning, P513
  • [14] Gönen M, 2011, J MACH LEARN RES, V12, P2211
  • [15] Gong BQ, 2012, PROC CVPR IEEE, P2066, DOI 10.1109/CVPR.2012.6247911
  • [16] Gretton A, 2012, J MACH LEARN RES, V13, P723
  • [17] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [18] Hoffman J., 2018, ICML
  • [19] Densely Connected Convolutional Networks
    Huang, Gao
    Liu, Zhuang
    van der Maaten, Laurens
    Weinberger, Kilian Q.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2261 - 2269
  • [20] Jiang J., 2007, P ACL, P264