Entropy minimization and domain adversarial training guided by label distribution similarity for domain adaptation

被引:0
作者
Fangzheng Xu
Yu Bao
Bingye Li
Zhining Hou
Lekang Wang
机构
[1] China University of Mining and Technology,Department of Computer Science and Technology
[2] China University of Mining and Technology,Mine Digitization Engineering Research Center of Ministry of Education of the People’s Republic of China
来源
Multimedia Systems | 2023年 / 29卷
关键词
Domain adaptation; Entropy minimization; Domain adversarial training;
D O I
暂无
中图分类号
学科分类号
摘要
In domain adaptation, entropy minimization is widely used. However, entropy minimization will bring negative transfer when the pseudo-labels are inconsistent with the real labels. We hope to increase pseudo-label accuracy to counter negative transfer in entropy minimization. To this end, we introduce domain adversarial training into entropy minimization. Furthermore, we consider the misalignment caused by domain adversarial training under severe label shift. Therefore, we propose method called entropy minimization and domain adversarial training guided by label distribution similarity (EMALDS). Through domain adversarial training which focus more on class-aligned divergence, our method improves pseudo-label accuracy and reduce negative transfer in entropy minimization. Extensive experiments demonstrate the effectiveness and robustness of our proposed method.
引用
收藏
页码:2281 / 2292
页数:11
相关论文
共 82 条
[1]  
Garcia GR(2022)Temporal signals to images: monitoring the condition of industrial assets with deep learning image processing algorithms J. Risk Reliab. 236 617-27
[2]  
Michau G(2022)Application of deep learning techniques in diagnosis of COVID-19 (coronavirus): a systematic review Neural Process. Lett. 235 3-16
[3]  
Ducoffe M(2021)A novel fusion approach of deep convolution neural network with auto-encoder and its application in planetary gearbox fault diagnosis J. Risk Reliab. 52 993-1003
[4]  
Gupta JS(2020)Hierarchical temporal fusion of multi-grained attention features for video question answering Neural Process. Lett. 63 1-36
[5]  
Fink O(2020)Sentiment analysis using deep learning approaches: an overview Sci. China Inf. Sci. 14 3283-3299
[6]  
Bhosale YH(2020)Deep visual unsupervised domain adaptation for classification tasks: a survey IET Image Proc. 33 6263-6274
[7]  
Patnaik KS(2021)Adversarial entropy optimization for unsupervised domain adaptation IEEE Trans. Neural Netw. Learn. Syst. 17 2030-2096
[8]  
Chen F(2021)Entropy minimization versus diversity maximization for domain adaptation IEEE Trans. Neural Netw. Learn. Syst. 14 16878132221088647-144
[9]  
Liu L(2016)Domain-adversarial training of neural networks J. Mach. Learn. Res. 63 139-A1138
[10]  
Tang B(2022)Unsupervised adversarial domain adaptive for fault detection based on minimum domain spacing Adv. Mech. Eng. 37 A1111-45