Deep Domain Adaptation Using Cascaded Learning Networks and Metric Learning

被引:1
作者
Zeng, Zhiyong [1 ]
Li, Dawei
Yang, Xiujuan
机构
[1] Fujian Normal Univ, Coll Comp & Cyber Secur, Fuzhou 350117, Peoples R China
基金
中国国家自然科学基金;
关键词
Adaptation models; Deep learning; Manifolds; Feature extraction; Learning systems; Neural networks; Covariance matrices; Cascaded learning networks; transfer learning; pca filters; metric learning; domain adaptation; symmetric positive definite covariance matrices; geodesic distance; KERNEL;
D O I
10.1109/ACCESS.2023.3235205
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
How can we bridge efficiently distribution difference between the source and target domains in an isomorphic latent feature space by using metric learning. This study introduces metric learning on manifolds which combine a cascaded learning network and a metric learning model to form a Unified Domain Adaptation Model. Our approach is based on formulating a transfer from the source to the target as a geometric mean metric learning problem on manifolds. The solution of symmetric positive definite covariance matrices not only reduces the statistical differences between the source and target domains, but also the underlying geometry of the source and target domains using diffusions on the underlying source and target manifolds. By retaining both the nonlinear structure of the Riemannian geometry of the open cone of symmetric positive definite matrices and cascaded learning networks, we improve the state-of-the-art results on the Amazon (A), Caltech256 (C), DSLR (D), Webcam (W) and VisDA benchmark datasets by knowledge transfer, while achieving comparable performances to competing methods on domain adaptation modeling.
引用
收藏
页码:3564 / 3572
页数:9
相关论文
共 51 条
[1]  
Arjovsky M, 2017, PR MACH LEARN RES, V70
[2]  
Belkin M., 2007, Advances in neural information processing systems, P129, DOI DOI 10.7551/MITPRESS/7503.003.0021
[3]   Representation Learning: A Review and New Perspectives [J].
Bengio, Yoshua ;
Courville, Aaron ;
Vincent, Pascal .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (08) :1798-1828
[4]   Integrating structured biological data by Kernel Maximum Mean Discrepancy [J].
Borgwardt, Karsten M. ;
Gretton, Arthur ;
Rasch, Malte J. ;
Kriegel, Hans-Peter ;
Schoelkopf, Bernhard ;
Smola, Alex J. .
BIOINFORMATICS, 2006, 22 (14) :E49-E57
[5]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[6]  
Chen XY, 2021, INT C MACHINE LEARNI, V139
[7]  
Chollet F, 2017, Arxiv, DOI [arXiv:1610.02357, DOI 10.48550/ARXIV.1610.02357]
[8]   Fine-grained Categorization and Dataset Bootstrapping using Deep Metric Learning with Humans in the Loop [J].
Cui, Yin ;
Zhou, Feng ;
Lin, Yuanqing ;
Belongie, Serge .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1153-1162
[9]  
Donahue J, 2013, Arxiv, DOI [arXiv:1310.1531, 10.48550/arXiv.1310.1531]
[10]  
French G, 2018, Arxiv, DOI arXiv:1706.05208