Exploring Explicitly Disentangled Features for Domain Generalization

被引:11
|
作者
Li, Jingwei [1 ,2 ]
Li, Yuan [1 ,2 ]
Wang, Huanjie [1 ,2 ]
Liu, Chengbao [1 ]
Tan, Jie [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Automat, Beijing 100080, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 101408, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain generalization; feature disentanglement; Fourier transform; data augmentation;
D O I
10.1109/TCSVT.2023.3269534
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Domain generalization (DG) is a challenging task that aims to train a robust model with only labeled source data and can generalize well on unseen target data. The domain gap between the source and target data may degrade the performance. A plethora of methods resort to obtaining domain-invariant features to overcome the difficulties. However, these methods require sophisticated network designs or training strategies, causing inefficiency and complexity. In this paper, we first analyze and reclassify the features into two categories, i.e., implicitly disentangled ones and explicitly disentangled counterparts. Since we aim to design a generic algorithm for DG to alleviate the problems mentioned above, we focus more on the explicitly disentangled features due to their simplicity and interpretability. We find out that the shape features of images are simple and elegant choices based on our analysis. We extract the shape features from two aspects. In the aspect of networks, we propose Multi-Scale Amplitude Mixing (MSAM) to strengthen shape features at different layers of the network by Fourier transform. In the aspect of inputs, we propose a new data augmentation method called Random Shape Warping (RSW) to facilitate the model to concentrate more on the global structures of the objects. RSW randomly distorts the local parts of the images and keeps the global structures unchanged, which can further improve the robustness of the model. Our methods are simple yet efficient and can be conveniently used as plug-and-play modules. They can outperform state-of-the-art (SOTA) methods without bells and whistles.
引用
收藏
页码:6360 / 6373
页数:14
相关论文
共 50 条
  • [1] Ensembling disentangled domain-specific prompts for domain generalization
    Xu, Fangbin
    Deng, Shizhuo
    Jia, Tong
    Yu, Xiaosheng
    Chen, Dongyue
    KNOWLEDGE-BASED SYSTEMS, 2024, 301
  • [2] Continuous Disentangled Joint Space Learning for Domain Generalization
    Wang, Zizhou
    Wang, Yan
    Feng, Yangqin
    Du, Jiawei
    Liu, Yong
    Goh, Rick Siow Mong
    Zhen, Liangli
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [3] Uncovering and mitigating spurious features in domain generalization
    Karimi, Saeed
    Dibeklioglu, Hamdi
    TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2024, 32 (02) : 320 - 337
  • [4] Quantitatively Measuring and Contrastively Exploring Heterogeneity for Domain Generalization
    Tong, Yunze
    Yuan, Junkun
    Zhang, Min
    Zhu, Didi
    Zhang, Keli
    Wu, Fei
    Kuang, Kun
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 2189 - 2200
  • [5] Toward Enhanced Adversarial Robustness Generalization in Object Detection: Feature Disentangled Domain Adaptation for Adversarial Training
    Jung, Yoojin
    Song, Byung Cheol
    IEEE ACCESS, 2024, 12 : 179065 - 179076
  • [6] DOMAIN INVARIANT REGULARIZATION BY DISENTANGLING CONTENT AND STYLE FEATURES FOR VISUAL DOMAIN GENERALIZATION
    Gholami, Behnam
    El-Khamy, Mostafa
    Song, Kee-Bong
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1525 - 1529
  • [7] Exploring Flat Minima for Domain Generalization With Large Learning Rates
    Zhang, Jian
    Qi, Lei
    Shi, Yinghuan
    Gao, Yang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (11) : 6145 - 6158
  • [8] Dynamic domain generalization for medical image segmentation
    Cheng, Zhiming
    Liu, Mingxia
    Yan, Chenggang
    Wang, Shuai
    NEURAL NETWORKS, 2025, 184
  • [9] Iterative compression towards in-distribution features in domain generalization
    Jiang, Yizhou
    Zhang, Tianren
    Li, Yihan
    Chen, Guanyu
    Chen, Feng
    NEUROCOMPUTING, 2025, 638
  • [10] Learning Robust Shape-Based Features for Domain Generalization
    Zhang, Yexun
    Zhang, Ya
    Xu, Qinwei
    Zhang, Ruipeng
    IEEE ACCESS, 2020, 8 (08): : 63748 - 63756