DCL: Dipolar Confidence Learning for Source-Free Unsupervised Domain Adaptation

被引:0
|
作者
Tian, Qing [1 ,2 ,3 ]
Sun, Heyang [4 ,5 ]
Peng, Shun [6 ]
Zheng, Yuhui [7 ]
Wan, Jun [8 ]
Lei, Zhen [6 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Software, Wuxi 214000, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Wuxi Inst Technol, Wuxi 214000, Peoples R China
[3] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210023, Peoples R China
[4] Nanjing Univ Informat Sci & Technol, Sch Software, Nanjing 210044, Peoples R China
[5] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 210016, Peoples R China
[6] Nanjing Univ Informat Sci & Technol, Sch Software, Nanjing 210044, Peoples R China
[7] Qinghai Normal Univ, Coll Comp, Xining 810016, Peoples R China
[8] Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Adaptation models; Data models; Task analysis; Predictive models; Generators; Feature extraction; Training; Source-free unsupervised domain adaptation (SFUDA); dipolar confidence learning (DCL); fuzzy mixup; rotation-based self-supervised learning;
D O I
10.1109/TCSVT.2023.3332353
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Source-free unsupervised domain adaptation (SFUDA) aims to conduct prediction on the target domain by leveraging knowledge from the well-trained source model. Due to the absence of source data in the SFUDA setting, the existing methods mainly build the target classifier by fine-tuning the source model incorporated with empirical adaptation losses. Although these methods have achieved somewhat promising results, nearly all of them typically suffer from the closed-fitting dilemma that their models are dominantly affected by these easy-to-distinguish instances than those hard-to-distinguish ones, resulting from the absence of the labeled source data. To address aforementioned issues, we propose the Dipolar Confidence Learning (DCL) for SFUDA. Specifically, we conduct positive confidence learning on the samples with standard outputs to avoid overfitting of the model to these samples. In contrast, we perform negative confidence learning for the samples with abnormal outputs to optimize the complementary label, which forces the network to pay more attention to these confusing samples. Furthermore, to achieve more generalized domain alignment, both the confidence-based fuzzy mixup and rotation-based self-supervised learning are respectively constructed to boost the representation ability of the target model. Finally, extensive experiments are conducted to demonstrate the effectiveness and performance superiority of the proposed method.
引用
收藏
页码:4342 / 4353
页数:12
相关论文
共 50 条
  • [21] Mitigating Negative Transfer Learning in Source Free-Unsupervised Domain Adaptation for Rotating Machinery Fault Diagnosis
    Kumar, M. P. Pavan
    Tu, Zhe-Xiang
    Chen, Hsu-Chi
    Chen, Kun-Chih
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [22] Uncertainty Estimation Pseudo-Label-Guided Source-Free Domain Adaptation for Cross-Domain Remaining Useful Life Prediction in IIoT
    Chen, Zhuohang
    Chen, Jinglong
    Pan, Tongyang
    Xie, Jingsong
    IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (01): : 236 - 249
  • [23] Lightweight Source-Free Domain Adaptation Based on Adaptive Euclidean Alignment for Brain-Computer Interfaces
    Wang, Huiyang
    Han, Hongfang
    Gan, John Q.
    Wang, Haixian
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2025, 29 (02) : 909 - 922
  • [24] A Source-Free Domain Adaptive Polyp Detection Framework With Style Diversification Flow
    Liu, Xinyu
    Yuan, Yixuan
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (07) : 1897 - 1908
  • [25] A Review of Single-Source Deep Unsupervised Visual Domain Adaptation
    Zhao, Sicheng
    Yue, Xiangyu
    Zhang, Shanghang
    Li, Bo
    Zhao, Han
    Wu, Bichen
    Krishna, Ravi
    Gonzalez, Joseph E.
    Sangiovanni-Vincentelli, Alberto L.
    Seshia, Sanjit A.
    Keutzer, Kurt
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (02) : 473 - 493
  • [26] Learning Transferable Parameters for Unsupervised Domain Adaptation
    Han, Zhongyi
    Sun, Haoliang
    Yin, Yilong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 6424 - 6439
  • [27] Guide Subspace Learning for Unsupervised Domain Adaptation
    Zhang, Lei
    Fu, Jingru
    Wang, Shanshan
    Zhang, David
    Dong, Zhaoyang
    Chen, C. L. Philip
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (09) : 3374 - 3388
  • [28] Source-Free Black-Box Adaptation for Machine Fault Diagnosis
    Jiao, Jinyang
    Zhang, Tian
    Li, Hao
    Liu, Hanyang
    Lin, Jing
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2025,
  • [29] Temporal Attention Source-Free Adaptation for Chemical Processes Fault Diagnosis
    Xiao, Yutang
    Shi, Hongbo
    Song, Bing
    Tao, Yang
    Tan, Shuai
    Wang, Boyu
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (03) : 4773 - 4783
  • [30] VDM-DA: Virtual Domain Modeling for Source Data-Free Domain Adaptation
    Tian, Jiayi
    Zhang, Jing
    Li, Wen
    Xu, Dong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (06) : 3749 - 3760