Entropy minimization and domain adversarial training guided by label distribution similarity for domain adaptation

被引:5
作者
Xu, Fangzheng [1 ]
Bao, Yu [2 ]
Li, Bingye [1 ]
Hou, Zhining [1 ]
Wang, Lekang [1 ]
机构
[1] China Univ Min & Technol, Dept Comp Sci & Technol, Xuzhou, Jiangsu, Peoples R China
[2] China Univ Min & Technol, Mine Digitizat Engn Res Ctr, Minist Educ Peoples Republ China, Xuzhou, Jiangsu, Peoples R China
关键词
Domain adaptation; Entropy minimization; Domain adversarial training;
D O I
10.1007/s00530-023-01106-w
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In domain adaptation, entropy minimization is widely used. However, entropy minimization will bring negative transfer when the pseudo-labels are inconsistent with the real labels. We hope to increase pseudo-label accuracy to counter negative transfer in entropy minimization. To this end, we introduce domain adversarial training into entropy minimization. Furthermore, we consider the misalignment caused by domain adversarial training under severe label shift. Therefore, we propose method called entropy minimization and domain adversarial training guided by label distribution similarity (EMALDS). Through domain adversarial training which focus more on class-aligned divergence, our method improves pseudo-label accuracy and reduce negative transfer in entropy minimization. Extensive experiments demonstrate the effectiveness and robustness of our proposed method.
引用
收藏
页码:2281 / 2292
页数:12
相关论文
共 52 条
[1]  
Arjovsky M, 2017, PR MACH LEARN RES, V70
[2]  
Ben-David Shai, 2006, PROC C NEURAL INF PR
[3]   ITERATIVE BREGMAN PROJECTIONS FOR REGULARIZED TRANSPORTATION PROBLEMS [J].
Benamou, Jean-David ;
Carlier, Guillaume ;
Cuturi, Marco ;
Nenna, Luca ;
Peyre, Gabriel .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2015, 37 (02) :A1111-A1138
[4]   Application of Deep Learning Techniques in Diagnosis of Covid-19 (Coronavirus): A Systematic Review [J].
Bhosale, Yogesh H. ;
Patnaik, K. Sridhar .
NEURAL PROCESSING LETTERS, 2023, 55 (03) :3551-3603
[5]  
Bickel S, 2009, J MACH LEARN RES, V10, P2137
[6]   Partial Adversarial Domain Adaptation [J].
Cao, Zhangjie ;
Ma, Lijia ;
Long, Mingsheng ;
Wang, Jianmin .
COMPUTER VISION - ECCV 2018, PT VIII, 2018, 11212 :139-155
[7]   Learning to Transfer Examples for Partial Domain Adaptation [J].
Cao, Zhangjie ;
You, Kaichao ;
Long, Mingsheng ;
Wang, Jianmin ;
Yang, Qiang .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :2980-2989
[8]   Partial Transfer Learning with Selective Adversarial Networks [J].
Cao, Zhangjie ;
Long, Mingsheng ;
Wang, Jianmin ;
Jordan, Michael I. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2724-2732
[9]   A novel fusion approach of deep convolution neural network with auto-encoder and its application in planetary gearbox fault diagnosis [J].
Chen, Fafa ;
Liu, Lili ;
Tang, Baoping ;
Chen, Baojia ;
Xiao, Wenrong ;
Zhang, Fajun .
PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART O-JOURNAL OF RISK AND RELIABILITY, 2021, 235 (01) :3-16
[10]  
Chen XY, 2019, PR MACH LEARN RES, V97