Domain generalization based on domain-specific adversarial learning

被引:1
|
作者
Wang, Ziping [1 ,2 ]
Zhang, Xiaohang [1 ,2 ]
Li, Zhengren [3 ]
Chen, Fei [3 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Econ & Management, Beijing 100876, Peoples R China
[2] Beijing Univ Posts & Telecommun, Key Lab Trustworthy Distributed Comp & Serv, Beijing 100876, Peoples R China
[3] Beijing Univ Posts & Telecommun, Sch Modern Posts, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain generalization; Adversarial learning; Distribution alignment; Transfer learning;
D O I
10.1007/s10489-024-05423-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning models often suffer from degraded performance when the distributions of the training and testing data differ (i.e., domain shift). Domain generalization (DG) techniques can help improve the generalization performance for unseen target domains by using multiple source domains. The recently developed domain generalization methods focus on extracting domain-invariant features from all source domains. However, some task-relevant discriminative information can be removed during this process. In addition, the various source domains are treated equally ignoring the negative impacts of distant source domains. Both problems can lead to unsatisfactory performance. This paper proposed a domain-specific adversarial neural network (DSANN) based on adversarial learning to learn effective feature representations and reduce the influence of distantsource domains. The DSANN introduces a reference distribution that is adaptively generated during training. Additionally, domain-invariant features are extracted through a domain-specific adversarial learning process , in which each source domain distribution is aligned only with the reference distribution instead of all the other source domains. Moreover, the DSANN also aligns the outputs of multiple classifiers and adopts the weighted average of the predictions; thus, the employed label classifiers can become more robust to unknown domain shifts. Experiments conducted on popular benchmark datasets demonstrate that our proposed method can achieve remarkable generalization performance and has better classification accuracy than the existing DG algorithms.
引用
收藏
页码:4878 / 4889
页数:12
相关论文
共 50 条
  • [31] DSMCompare: domain-specific model differencing for graphical domain-specific languages
    Manouchehr Zadahmad
    Eugene Syriani
    Omar Alam
    Esther Guerra
    Juan de Lara
    Software and Systems Modeling, 2022, 21 : 2067 - 2096
  • [32] DSMCompare: domain-specific model differencing for graphical domain-specific languages
    Zadahmad, Manouchehr
    Syriani, Eugene
    Alam, Omar
    Guerra, Esther
    de Lara, Juan
    SOFTWARE AND SYSTEMS MODELING, 2022, 21 (05): : 2067 - 2096
  • [33] Adversarial Teacher-Student Representation Learning for Domain Generalization
    Yang, Fu-En
    Cheng, Yuan-Chia
    Shiau, Zu-Yun
    Wang, Yu-Chiang Frank
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [34] Adversarial Invariant Feature Learning with Accuracy Constraint for Domain Generalization
    Akuzawa, Kei
    Iwasawa, Yusuke
    Matsuo, Yutaka
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2019, PT II, 2020, 11907 : 315 - 331
  • [35] Domain-Specific Profiling
    Bergel, Alexandre
    Nierstrasz, Oscar
    Renggli, Lukas
    Ressia, Jorge
    OBJECTS, MODELS, COMPONENTS, PATTERNS, TOOLS 2011, 2011, 6705 : 68 - 82
  • [36] The Research on the Spider of the Domain-Specific Search Engines Based on the Reinforcement Learning
    Liu Quan
    Cui Zhi-ming
    Fu Yu-chen
    PROCEEDINGS OF THE 2009 WRI GLOBAL CONGRESS ON INTELLIGENT SYSTEMS, VOL II, 2009, : 588 - 592
  • [37] Decoupled domain-specific and domain-conditional representation learning for cross-domain recommendation
    Zhang, Yu
    Cheng, Zhiyong
    Liu, Fan
    Yang, Xun
    Peng, Yuxin
    INFORMATION PROCESSING & MANAGEMENT, 2024, 61 (03)
  • [38] Domain-Specific Greed
    Weiss, Martin
    Schulze, Julian
    Krumm, Stefan
    Goeritz, Anja S. S.
    Hewig, Johannes
    Mussel, Patrick
    PERSONALITY AND SOCIAL PSYCHOLOGY BULLETIN, 2024, 50 (06) : 889 - 905
  • [39] Mechanisms of Cognitive Development: Domain-General Learning or Domain-Specific Constraints?
    Sloutsky, Vladimir M.
    COGNITIVE SCIENCE, 2010, 34 (07) : 1125 - 1130
  • [40] Adversarial learning and decomposition-based domain generalization for face anti-spoofing
    Liu, Mingxin
    Mu, Jiong
    Yu, Zitong
    Ruan, Kun
    Shu, Baiyi
    Yang, Jie
    PATTERN RECOGNITION LETTERS, 2022, 155 : 171 - 177