Uncertainty Modeling for Robust Domain Adaptation Under Noisy Environments

被引:10
|
作者
Zhuo, Junbao [1 ]
Wang, Shuhui [1 ,2 ]
Huang, Qingming [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518066, Peoples R China
[3] Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing 101408, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Domain Adaptation; Uncertainty; Noisy Label; Transfer Learning; Deep Learning;
D O I
10.1109/TMM.2022.3205457
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we tackle the task of domain adaptation under noisy environments; this is a practical and challenging problem in which the source domain is corrupted with noise in its labels, its features, or both. Noise in the source domain leads to inaccurate visual representations and makes it harder to estimate and reduce the domain discrepancy between the source and target domains, resulting in severe performance degradation in the target domain. These challenges can be addressed with offline source sample selection following robust domain discrepancy reduction. To achieve reliable sample selection, we model the uncertainty in the predictions of a convolutional neural network (CNN) classifier and reweight the classification loss by this uncertainty. Such a reweighting mechanism reduces the contribution of noise, leading to improved noise robustness. We further propose UncertaintyRank, a novel regularizer, to encourage the uncertainty to be more sensitive to noisy labels, as label corruption brings more severe degradation. The uncertainty is also aggregated with the classification loss to eliminate the adverse effects of noisy representations while estimating the domain discrepancy. Extensive experiments validate the effectiveness of our method and verify that it performs favorably against existing state-of-the-art methods.
引用
收藏
页码:6157 / 6170
页数:14
相关论文
共 50 条
  • [1] Towards Accurate and Robust Domain Adaptation Under Multiple Noisy Environments
    Han, Zhongyi
    Gui, Xian-Jin
    Sun, Haoliang
    Yin, Yilong
    Li, Shuo
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) : 6460 - 6479
  • [2] Learning Unbiased Transferability for Domain Adaptation by Uncertainty Modeling
    Hu, Jian
    Zhong, Haowen
    Yang, Fei
    Gong, Shaogang
    Wu, Guile
    Yan, Junchi
    COMPUTER VISION, ECCV 2022, PT XXXI, 2022, 13691 : 223 - 241
  • [3] Distributionally robust unsupervised domain adaptation
    Wang, Yibin
    Wang, Haifeng
    JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2023, 436
  • [4] Modeling and Robust Optimization for System of Systems Problems under Uncertainty
    Liu, Peng
    Xia, Boyuan
    Tan, Yuejin
    Zhao, Danling
    2018 IEEE 4TH INTERNATIONAL CONFERENCE ON CONTROL SCIENCE AND SYSTEMS ENGINEERING (ICCSSE 2018), 2018, : 385 - 390
  • [5] Credit Risk Modeling Using Transfer Learning and Domain Adaptation
    Suryanto, Hendra
    Mahidadia, Ashesh
    Bain, Michael
    Guan, Charles
    Guan, Ada
    FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2022, 5
  • [6] Consolidation of visuomotor adaptation memory with consistent and noisy environments
    Maeda, Rodrigo S.
    McGee, Steven E.
    Marigold, Daniel S.
    JOURNAL OF NEUROPHYSIOLOGY, 2017, 117 (01) : 316 - 326
  • [7] Towards Robust Uncertainty Estimation in the Presence of Noisy Labels
    Pan, Chao
    Yuan, Bo
    Zhou, Wei
    Yao, Xin
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT I, 2022, 13529 : 673 - 684
  • [8] Modulation recognition based on domain adaptation under impulsive noises
    Zhang, Xiaolin
    Li, Yang
    Sun, Rongchen
    Harbin Gongcheng Daxue Xuebao/Journal of Harbin Engineering University, 2024, 45 (09): : 1840 - 1847
  • [9] Robust Remote Sensing Image Cross-Scene Classification Under Noisy Environment
    Zhu, Sihan
    Wu, Chen
    Du, Bo
    Zhang, Liangpei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 11
  • [10] Towards Corruption-Agnostic Robust Domain Adaptation
    Xu, Yifan
    Sheng, Kekai
    Dong, Weiming
    Wu, Baoyuan
    Xu, Changsheng
    Hu, Bao-Gang
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (04)