Uncertainty Modeling for Robust Domain Adaptation Under Noisy Environments

被引:10
|
作者
Zhuo, Junbao [1 ]
Wang, Shuhui [1 ,2 ]
Huang, Qingming [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518066, Peoples R China
[3] Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing 101408, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Domain Adaptation; Uncertainty; Noisy Label; Transfer Learning; Deep Learning;
D O I
10.1109/TMM.2022.3205457
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we tackle the task of domain adaptation under noisy environments; this is a practical and challenging problem in which the source domain is corrupted with noise in its labels, its features, or both. Noise in the source domain leads to inaccurate visual representations and makes it harder to estimate and reduce the domain discrepancy between the source and target domains, resulting in severe performance degradation in the target domain. These challenges can be addressed with offline source sample selection following robust domain discrepancy reduction. To achieve reliable sample selection, we model the uncertainty in the predictions of a convolutional neural network (CNN) classifier and reweight the classification loss by this uncertainty. Such a reweighting mechanism reduces the contribution of noise, leading to improved noise robustness. We further propose UncertaintyRank, a novel regularizer, to encourage the uncertainty to be more sensitive to noisy labels, as label corruption brings more severe degradation. The uncertainty is also aggregated with the classification loss to eliminate the adverse effects of noisy representations while estimating the domain discrepancy. Extensive experiments validate the effectiveness of our method and verify that it performs favorably against existing state-of-the-art methods.
引用
收藏
页码:6157 / 6170
页数:14
相关论文
共 50 条
  • [21] Time-domain robust stability test under plant and controller interval uncertainty
    Cugueró, P
    Tornil, S
    Escobet, T
    Saludes, J
    Puig, V
    ROBUST CONTROL DESIGN 2000, VOLS 1 & 2, 2000, 1-2 : 207 - 211
  • [22] Indoor localization based on CSI in dynamic environments through domain adaptation
    Yang, Liuyi
    Kamada, Tomio
    Ohta, Chikara
    IEICE COMMUNICATIONS EXPRESS, 2021, 10 (08): : 564 - 569
  • [23] Adversarial Domain Adaptation for Gear Crack Level Classification Under Variable Load
    Wei, Dongdong
    Han, Te
    Chu, Fulei
    Zuo, Ming Jian
    2020 ASIA-PACIFIC INTERNATIONAL SYMPOSIUM ON ADVANCED RELIABILITY AND MAINTENANCE MODELING (APARM), 2020,
  • [24] Learning Causal Representations for Robust Domain Adaptation
    Yang, Shuai
    Yu, Kui
    Cao, Fuyuan
    Liu, Lin
    Wang, Hao
    Li, Jiuyong
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (03) : 2750 - 2764
  • [25] Learning Robust Feature Transformation for Domain Adaptation
    Wang, Wei
    Wang, Hao
    Ran, Zhi-Yong
    He, Ran
    PATTERN RECOGNITION, 2021, 114
  • [26] Across Sessions and Subjects Domain Adaptation for Building Robust Myoelectric Interface
    Li, Wei
    Zhang, Xinran
    Shi, Ping
    Li, Sujiao
    Li, Ping
    Yu, Hongliu
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2024, 32 : 2005 - 2015
  • [27] Unsupervised Domain Adaptation for Robust Sensory Systems
    Mathur, Akhil
    Isopoussu, Anton
    Berthouze, Nadia
    Lane, Nicholas D.
    Kawsar, Fahim
    UBICOMP/ISWC'19 ADJUNCT: PROCEEDINGS OF THE 2019 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2019 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2019, : 505 - 509
  • [28] Robust unsupervised domain adaptation for neural networks via moment alignment
    Zellinger, Werner
    Moser, Bernhard A.
    Grubinger, Thomas
    Lughofer, Edwin
    Natschlaeger, Thomas
    Saminger-Platz, Susanne
    INFORMATION SCIENCES, 2019, 483 : 174 - 191
  • [29] Robust Elbow Angle Prediction With Aging Soft Sensors via Output-Level Domain Adaptation
    Zhu, Zhongguan
    Guo, Shihui
    Qin, Yipeng
    Chen, Xiaowei
    Wu, Ronghui
    Shi, Yating
    Liu, Xiangyang
    Liao, Minghong
    IEEE SENSORS JOURNAL, 2021, 21 (20) : 22976 - 22984
  • [30] Precise modeling of cutting forces based on domain adaptation extreme learning machine under small sample conditions
    Zhang, Shaonan
    Xiong, Liangshan
    CIRP JOURNAL OF MANUFACTURING SCIENCE AND TECHNOLOGY, 2025, 57 : 32 - 41