Joint distribution adaptation via feature and model Matching

被引:0
作者
Mardani M. [1 ]
Tahmoresnezhad J. [1 ]
机构
[1] Faculty of It and Computer Engineering, Urmia University of Technology, Urmia
来源
Scientia Iranica | 2019年 / 26卷 / 06期
关键词
Domain adaptation; Feature transformation; Model matching; Pattern recognition; Transfer learning;
D O I
10.24200/sci.2018.5487.1304
中图分类号
学科分类号
摘要
It is usually supposed that the training (source domain) and test (target domain) data follow similar distributions and feature spaces in most pattern recognition tasks. However, in many real-world applications, particularly in visual recognition, this hypothesis has frequently been violated. Thus, the trained classifier for the source domain performs poorly in the target domain. This problem is known as domain shift problem. Domain adaptation and transfer learning are promising techniques towards an effective and robust classifier to tackle the shift problem. In this paper, a novel scheme is proposed for domain adaptation, named Joint Distribution Adaptation via Feature and Model Matching (JDAFMM), in which feature transform and model matching are jointly optimized. By introducing regularization performed between the marginal and conditional distribution shifts across the domains, data drift can be successfully adapted as much as possible along with empirical risk minimization and rate of consistency maximization between manifold and prediction functions. Extensive experiments were conducted to evaluate the performance of the proposed model against other machine learning and domain adaptation methods in three types of visual benchmark datasets. Our experiments illustrated that our JDAFMM significantly outperformed other baseline and state-of-the-art methods. © 2019 Sharif University of Technology. All rights reserved.
引用
收藏
页码:3515 / 3539
页数:24
相关论文
共 38 条
  • [1] Shi Y., Sha F., Information-theoretical learning of discriminative clusters for unsupervised domain adaptation, (2012)
  • [2] Huang J., Gretton A., Borgwardt K., Scholkopf B., Smola A., Correcting sample selection bias by unlabeled data, Neural Information Processing Systems (NIPS), pp. 601-608, (2007)
  • [3] Pan S.J., Tsang I.W., Kwok J.T., Yang Q., Domain adaptation via transfer component analysis, IEEE Transactions on Neural Network, 22, 2, pp. 199-210, (2011)
  • [4] Blitzer J., Dredze M., Pereira F., Biographies, bollywood, boom-boxes and blenders: Domain adaptation for sentiment classification, ACL, 7, pp. 440-447, (2007)
  • [5] Blitzer J., McDonald R., Pereira F., Domain adaptation with structural correspondence learning, Conf. on Emp. Meth. in Natu. Lang. Proc, pp. 120-128, (2006)
  • [6] Duan L., Xu D., Tsang I.W., Luo J., Visual event recognition in videos by learning from web data, IEEE Trans. Pattern Anal. Mach. Intell, 34, 9, pp. 1667-1680, (2012)
  • [7] Jain V., Learned-Miller E., Online domain adaptation of a pre-trained cascade of classifiers, IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 577-584, (2011)
  • [8] Tahmoresnezhad J., Hashemi S., Visual domain adaptation via transfer feature learning, Knowledge and Information Systems (KAIS), 50, 2, pp. 588-605, (2017)
  • [9] Gong B., Shi Y., Sha F., Grauman K., Geodesic ow kernel for unsupervised domain adaptation, IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 2066-2073, (2012)
  • [10] Tahmoresnezhad J., Hashemi S., Transductive transfer learning via maximum margin criterion, Scientia Iranica (SCI), 23, 3, (2016)