Feature Alignment by Uncertainty and Self-Training for Source-Free Domain

被引:27
作者
Lee, JoonHo [1 ,2 ]
Lee, Gyemin [2 ]
机构
[1] Samsung SDS Technol Res, Machine Learning Res Ctr, Seoul, South Korea
[2] Seoul Natl Univ Sci & Technol, Dept Elect & IT Media Engn, Seoul, South Korea
关键词
Unsupervised domain adaptation; Source-free domain adaptation; Uncertainty; Self-training; Image classification;
D O I
10.1016/j.neunet.2023.02.009
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most unsupervised domain adaptation (UDA) methods assume that labeled source images are available during model adaptation. However, this assumption is often infeasible owing to confidentiality issues or memory constraints on mobile devices. Some recently developed approaches do not require source images during adaptation, but they show limited performance on perturbed images. To address these problems, we propose a novel source-free UDA method that uses only a pre-trained source model and unlabeled target images. Our method captures the aleatoric uncertainty by incorporating data augmentation and trains the feature generator with two consistency objectives. The feature generator is encouraged to learn consistent visual features away from the decision boundaries of the head classifier. Thus, the adapted model becomes more robust to image perturbations. Inspired by self-supervised learning, our method promotes inter-space alignment between the prediction space and the feature space while incorporating intra-space consistency within the feature space to reduce the domain gap between the source and target domains. We also consider epistemic uncertainty to boost the model adaptation performance. Extensive experiments on popular UDA benchmark datasets demonstrate that the proposed source-free method is comparable or even superior to vanilla UDA methods. Moreover, the adapted models show more robust results when input images are perturbed. (c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:682 / 692
页数:11
相关论文
共 50 条
[41]   Domain Adaptive Object Detection via Balancing Between Self-Training and Adversarial Learning [J].
Munir, Muhammad Akhtar ;
Khan, Muhammad Haris ;
Sarfraz, M. Saquib ;
Ali, Mohsen .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (12) :14353-14365
[42]   Source-Free Domain Adaptation Guided by Vision and Vision-Language Pre-training [J].
Zhang, Wenyu ;
Shen, Li ;
Foo, Chuan-Sheng .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2025, 133 (02) :844-866
[43]   A self-training approach to cost sensitive uncertainty sampling [J].
Liu, Alexander ;
Jun, Goo ;
Ghosh, Joydeep .
MACHINE LEARNING, 2009, 76 (2-3) :257-270
[44]   A self-training approach to cost sensitive uncertainty sampling [J].
Alexander Liu ;
Goo Jun ;
Joydeep Ghosh .
Machine Learning, 2009, 76 :257-270
[45]   Two-stage structural information enhancement for source-free domain adaptation [J].
Sijie Chen ;
Mingwen Shao ;
Lixu Zhang ;
Zhiyuan Bao .
Machine Vision and Applications, 2023, 34
[46]   UPL-SFDA: Uncertainty-Aware Pseudo Label Guided Source-Free Domain Adaptation for Medical Image Segmentation [J].
Wu, Jianghao ;
Wang, Guotai ;
Gu, Ran ;
Lu, Tao ;
Chen, Yinan ;
Zhu, Wentao ;
Vercauteren, Tom ;
Ourselin, Sebastien ;
Zhang, Shaoting .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (12) :3932-3943
[47]   Contrastive Learning and Self-Training for Unsupervised Domain Adaptation in Semantic Segmentation [J].
Marsden, Robert A. ;
Bartler, Alexander ;
Doebler, Mario ;
Yang, Bin .
2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
[48]   Time and frequency synergy for source-free time-series domain adaptations [J].
Furqon, Muhammad Tanzil ;
Pratama, Mahardhika ;
Shiddiqi, Ary ;
Liu, Lin ;
Habibullah, Habibullah ;
Dogancay, Kutluyil .
INFORMATION SCIENCES, 2025, 695
[49]   Two-stage structural information enhancement for source-free domain adaptation [J].
Chen, Sijie ;
Shao, Mingwen ;
Zhang, Lixu ;
Bao, Zhiyuan .
MACHINE VISION AND APPLICATIONS, 2023, 34 (06)
[50]   Unsupervised domain adaptation with self-training for weed segmentation [J].
Huang, Yingchao ;
Hussein, Amina E. ;
Wang, Xin ;
Bais, Abdul ;
Yao, Shanshan ;
Wilder, Tanis .
INTELLIGENT SYSTEMS WITH APPLICATIONS, 2025, 25