Decomposition-Based Unsupervised Domain Adaptation for Remote Sensing Image Semantic Segmentation

被引:0
|
作者
Ma, Xianping [1 ]
Zhang, Xiaokang [2 ,3 ]
Ding, Xingchen [4 ]
Pun, Man-On [1 ]
Ma, Siwei [5 ]
机构
[1] Chinese Univ Hong Kong Shenzhen, Sch Sci & Engn, Shenzhen 518172, Peoples R China
[2] Hubei Luojia Lab, Wuhan 430079, Peoples R China
[3] Wuhan Univ Sci & Technol, Sch Informat Sci & Engn, Wuhan 430081, Peoples R China
[4] Wuhan Univ, Sch Cyber Sci & Engn, Wuhan 430072, Peoples R China
[5] Peking Univ, Sch Elect Engn & Comp Sci, Beijing 100871, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Semantic segmentation; Remote sensing; Training; Semantics; Feature extraction; Context modeling; Transformers; Generators; Generative adversarial networks; Adaptation models; Global-local information; high/low-frequency decomposition (HLFD); remote sensing; semantic segmentation; unsupervised domain adaptation (UDA); NETWORK;
D O I
10.1109/TGRS.2024.3483283
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Unsupervised domain adaptation (UDA) techniques are vital for semantic segmentation in geosciences, effectively utilizing remote sensing imagery across diverse domains. However, most existing UDA methods, which focus on domain alignment at the high-level feature space, struggle to simultaneously retain local spatial details and global contextual semantics. To overcome these challenges, a novel decomposition scheme is proposed to guide domain-invariant representation learning. Specifically, multiscale high/low-frequency decomposition (HLFD) modules are proposed to decompose feature maps into high- and low-frequency components across different subspaces. This decomposition is integrated into a fully global-local generative adversarial network (GLGAN) that incorporates global-local transformer blocks (GLTBs) to enhance the alignment of decomposed features. By integrating the HLFD scheme and the GLGAN, a novel decomposition-based UDA framework called De-GLGAN is developed to improve the cross-domain transferability and generalization capability of semantic segmentation models. Extensive experiments on two UDA benchmarks, namely ISPRS Potsdam and Vaihingen, and LoveDA Rural and Urban, demonstrate the effectiveness and superiority of the proposed approach over existing state-of-the-art UDA methods. The source code for this work is accessible at https://github.com/sstary/SSRS.
引用
收藏
页数:18
相关论文
共 50 条
  • [21] Hybrid Attention Fusion Embedded in Transformer for Remote Sensing Image Semantic Segmentation
    Chen, Yan
    Dong, Quan
    Wang, Xiaofeng
    Zhang, Qianchuan
    Kang, Menglei
    Jiang, Wenxiang
    Wang, Mengyuan
    Xu, Lixiang
    Zhang, Chen
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 4421 - 4435
  • [22] Semisupervised Multiscale Generative Adversarial Network for Semantic Segmentation of Remote Sensing Image
    Wang, Jiaqi
    Liu, Bing
    Zhou, Yong
    Zhao, Jiaqi
    Xia, Shixiong
    Yang, Yuancan
    Zhang, Man
    Ming, Liu Ming
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [23] Semantic Co-Occurrence and Relationship Modeling for Remote Sensing Image Segmentation
    Zhang, Yinxing
    Song, Haochen
    Wang, Qingwang
    Jin, Pengcheng
    Shen, Tao
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 6630 - 6640
  • [24] Unsupervised Domain Adaptation for the Semantic Segmentation of Remote Sensing Images via One-Shot Image-to-Image Translation
    Ismael, Sarmad F.
    Kayabol, Koray
    Aptoula, Erchan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [25] DDRNet: Dual-Domain Refinement Network for Remote Sensing Image Semantic Segmentation
    Yang, Zhenhao
    Bi, Fukun
    Hou, Xinghai
    Zhou, Dehao
    Wang, Yanping
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 20177 - 20189
  • [26] BiFDANet: Unsupervised Bidirectional Domain Adaptation for Semantic Segmentation of Remote Sensing Images
    Cai, Yuxiang
    Yang, Yingchun
    Zheng, Qiyi
    Shen, Zhengwei
    Shang, Yongheng
    Yin, Jianwei
    Shi, Zhongtian
    REMOTE SENSING, 2022, 14 (01)
  • [27] DAugNet: Unsupervised, Multisource, Multitarget, and Life-Long Domain Adaptation for Semantic Segmentation of Satellite Images
    Tasar, Onur
    Giros, Alain
    Tarabalka, Yuliya
    Alliez, Pierre
    Clerc, Sebastien
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (02): : 1067 - 1081
  • [28] FDGSNet: A Multimodal Gated Segmentation Network for Remote Sensing Image Based on Frequency Decomposition
    Cui, Jian
    Liu, Jiahang
    Ni, Yue
    Wang, Jinjin
    Li, Manchun
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 19756 - 19770
  • [29] Enhancing Multiscale Representations With Transformer for Remote Sensing Image Semantic Segmentation
    Xiao, Tao
    Liu, Yikun
    Huang, Yuwen
    Li, Mingsong
    Yang, Gongping
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [30] Combining Swin Transformer With UNet for Remote Sensing Image Semantic Segmentation
    Fan, Lili
    Zhou, Yu
    Liu, Hongmei
    Li, Yunjie
    Cao, Dongpu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61 : 1 - 11