Feature Alignment by Uncertainty and Self-Training for Source-Free Domain

被引:27
|
作者
Lee, JoonHo [1 ,2 ]
Lee, Gyemin [2 ]
机构
[1] Samsung SDS Technol Res, Machine Learning Res Ctr, Seoul, South Korea
[2] Seoul Natl Univ Sci & Technol, Dept Elect & IT Media Engn, Seoul, South Korea
关键词
Unsupervised domain adaptation; Source-free domain adaptation; Uncertainty; Self-training; Image classification;
D O I
10.1016/j.neunet.2023.02.009
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most unsupervised domain adaptation (UDA) methods assume that labeled source images are available during model adaptation. However, this assumption is often infeasible owing to confidentiality issues or memory constraints on mobile devices. Some recently developed approaches do not require source images during adaptation, but they show limited performance on perturbed images. To address these problems, we propose a novel source-free UDA method that uses only a pre-trained source model and unlabeled target images. Our method captures the aleatoric uncertainty by incorporating data augmentation and trains the feature generator with two consistency objectives. The feature generator is encouraged to learn consistent visual features away from the decision boundaries of the head classifier. Thus, the adapted model becomes more robust to image perturbations. Inspired by self-supervised learning, our method promotes inter-space alignment between the prediction space and the feature space while incorporating intra-space consistency within the feature space to reduce the domain gap between the source and target domains. We also consider epistemic uncertainty to boost the model adaptation performance. Extensive experiments on popular UDA benchmark datasets demonstrate that the proposed source-free method is comparable or even superior to vanilla UDA methods. Moreover, the adapted models show more robust results when input images are perturbed. (c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:682 / 692
页数:11
相关论文
共 50 条
  • [1] Feature mixing and self-training for source-free active domain
    Tian, Qing
    Zhang, Heng
    COMPUTERS & ELECTRICAL ENGINEERING, 2023, 111
  • [2] Rectifying self-training with neighborhood consistency and proximity for source-free domain adaptation
    Xing, Bowei
    Ying, Xianghua
    Wang, Ruibin
    NEUROCOMPUTING, 2024, 606
  • [3] Source-free domain adaptive segmentation with class-balanced complementary self-training
    Huang, Yongsong
    Xie, Wanqing
    Li, Mingzhen
    Xiao, Ethan
    You, Jane
    Liu, Xiaofeng
    ARTIFICIAL INTELLIGENCE IN MEDICINE, 2023, 146
  • [4] SAM-guided contrast based self-training for source-free cross-domain semantic segmentation
    Ren, Qinghua
    Hou, Ke
    Zhan, Yongzhao
    Wang, Chen
    MULTIMEDIA SYSTEMS, 2024, 30 (04)
  • [5] Simplifying Source-Free Domain Adaptation for Object Detection: Effective Self-training Strategies and Performance Insights
    Hao, Yan
    Forest, Florent
    Fink, Olga
    COMPUTER VISION - ECCV 2024, PT LIV, 2025, 15112 : 196 - 213
  • [6] Enhancing source-free domain adaptation in Medical Image Segmentation via regulated model self-training
    Zhang, Tianwei
    Li, Kang
    Gu, Shi
    Heng, Pheng-Ann
    MEDICAL IMAGE ANALYSIS, 2025, 102
  • [7] Uncertainty-Guided Source-Free Domain Adaptation
    Roy, Subhankar
    Trapp, Martin
    Pilzer, Andrea
    Kannala, Juho
    Sebe, Nicu
    Ricci, Elisa
    Solin, Arno
    COMPUTER VISION, ECCV 2022, PT XXV, 2022, 13685 : 537 - 555
  • [8] Uncertainty-Aware Source-Free Domain Adaptive Semantic Segmentation
    Lu, Zhihe
    Li, Da
    Song, Yi-Zhe
    Xiang, Tao
    Hospedales, Timothy M. M.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 4664 - 4676
  • [9] Uncertainty-Induced Transferability Representation for Source-Free Unsupervised Domain Adaptation
    Pei, Jiangbo
    Jiang, Zhuqing
    Men, Aidong
    Chen, Liang
    Liu, Yang
    Chen, Qingchao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 2033 - 2048
  • [10] Unsupervised Domain Adaptative SAR Target Detection Based on Feature Decomposition and Uncertainty-Guided Self-Training
    Shi, Yu
    Li, Yi
    Du, Lan
    Du, Yuang
    Guo, Yuchen
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 20265 - 20283