Uncertainty-aware pseudo-label filtering for source-free unsupervised domain adaptation

被引:1
|
作者
Chen, Xi [1 ]
Yang, Haosen [2 ]
Zhang, Huicong [1 ]
Yao, Hongxun [1 ]
Zhu, Xiatian [2 ]
机构
[1] Harbin Inst Technol, Fac Comp, Weihai, Peoples R China
[2] Univ Surrey, Surrey, England
基金
国家重点研发计划;
关键词
Source-free unsupervised domain adaptation; Pseudo-label filtering; Uncertainty-aware; Contrastive learning;
D O I
10.1016/j.neucom.2023.127190
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Source -free unsupervised domain adaptation (SFUDA) aims to enable the utilization of a pre -trained source model in an unlabeled target domain without access to source data. Self -training is a way to solve SFUDA, where confident target samples are iteratively selected as pseudo -labeled samples to guide target model learning. However, prior heuristic noisy pseudo -label filtering methods all involve introducing extra models, which are sensitive to model assumptions and may introduce additional errors or mislabeling. In this work, we propose a method called Uncertainty -aware Pseudo -label -filtering Adaptation (UPA) to efficiently address this issue in a coarse -to -fine manner. Specially, we first introduce a sample selection module named Adaptive Pseudo -label Selection (APS), which is responsible for filtering noisy pseudo labels. The APS utilizes a simple sample uncertainty estimation method by aggregating knowledge from neighboring samples and confident samples are selected as clean pseudo -labeled. Additionally, we incorporate Class -Aware Contrastive Learning (CACL) to mitigate the memorization of pseudo -label noise by learning robust pair -wise representation supervised by pseudo labels. Through extensive experiments conducted on three widely used benchmarks, we demonstrate that our proposed method achieves competitive performance on par with state-of-the-art SFUDA methods.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] DCL: Dipolar Confidence Learning for Source-Free Unsupervised Domain Adaptation
    Tian, Qing
    Sun, Heyang
    Peng, Shun
    Zheng, Yuhui
    Wan, Jun
    Lei, Zhen
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (06) : 4342 - 4353
  • [42] SOURCE-FREE UNSUPERVISED DOMAIN ADAPTATION VIA DENOISING MUTUAL LEARNING
    Hao, Zhang
    Liang, Tian
    2022 19TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICCWAMTIP), 2022,
  • [43] Denoised Maximum Classifier Discrepancy for Source-Free Unsupervised Domain Adaptation
    Chu, Tong
    Liu, Yahao
    Deng, Jinhong
    Li, Wen
    Duan, Lixin
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 472 - 480
  • [44] A Source-Free Unsupervised Domain Adaptation Method Based on Feature Consistency
    Lee, JoonHo
    Lee, Gyemin
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY, IWAIT 2023, 2023, 12592
  • [45] Source-free unsupervised domain adaptation with maintaining model balance and diversity?
    Tian, Qing
    Peng, Shun
    Sun, Heyang
    Zhou, Jiazhong
    Zhang, Heng
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 104
  • [46] Source-Free Unsupervised Domain Adaptation: Current research and future directions
    Zhang, Ningyuan
    Lu, Jie
    Li, Keqiuyin
    Fang, Zhen
    Zhang, Guangquan
    NEUROCOMPUTING, 2024, 564
  • [47] Source-free unsupervised domain adaptation with maintaining model balance and diversity
    Tian, Qing
    Peng, Shun
    Sun, Heyang
    Zhou, Jiazhong
    Zhang, Heng
    Computers and Electrical Engineering, 2022, 104
  • [48] Cross-scene target detection based on feature adaptation and uncertainty-aware pseudo-label learning for high resolution SAR images
    Zou, Bin
    Qin, Jiang
    Zhang, Lamei
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 200 : 173 - 190
  • [49] Asymmetric Source-Free Unsupervised Domain Adaptation for Medical Image Diagnosis
    Zhang, Yajie
    Huang, Zhi-An
    Wu, Jibin
    Tan, Kay Chen
    2024 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI 2024, 2024, : 234 - 239
  • [50] Progressive Source-Aware Transformer for Generalized Source-Free Domain Adaptation
    Tang, Song
    Shi, Yuji
    Song, Zihao
    Ye, Mao
    Zhang, Changshui
    Zhang, Jianwei
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 4138 - 4152