Decomposition-Based Unsupervised Domain Adaptation for Remote Sensing Image Semantic Segmentation

被引:8
作者
Ma, Xianping [1 ]
Zhang, Xiaokang [2 ,3 ]
Ding, Xingchen [4 ]
Pun, Man-On [1 ]
Ma, Siwei [5 ]
机构
[1] Chinese Univ Hong Kong Shenzhen, Sch Sci & Engn, Shenzhen 518172, Peoples R China
[2] Hubei Luojia Lab, Wuhan 430079, Peoples R China
[3] Wuhan Univ Sci & Technol, Sch Informat Sci & Engn, Wuhan 430081, Peoples R China
[4] Wuhan Univ, Sch Cyber Sci & Engn, Wuhan 430072, Peoples R China
[5] Peking Univ, Sch Elect Engn & Comp Sci, Beijing 100871, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Semantic segmentation; Remote sensing; Training; Semantics; Feature extraction; Context modeling; Transformers; Generators; Generative adversarial networks; Adaptation models; Global-local information; high/low-frequency decomposition (HLFD); remote sensing; semantic segmentation; unsupervised domain adaptation (UDA); NETWORK;
D O I
10.1109/TGRS.2024.3483283
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Unsupervised domain adaptation (UDA) techniques are vital for semantic segmentation in geosciences, effectively utilizing remote sensing imagery across diverse domains. However, most existing UDA methods, which focus on domain alignment at the high-level feature space, struggle to simultaneously retain local spatial details and global contextual semantics. To overcome these challenges, a novel decomposition scheme is proposed to guide domain-invariant representation learning. Specifically, multiscale high/low-frequency decomposition (HLFD) modules are proposed to decompose feature maps into high- and low-frequency components across different subspaces. This decomposition is integrated into a fully global-local generative adversarial network (GLGAN) that incorporates global-local transformer blocks (GLTBs) to enhance the alignment of decomposed features. By integrating the HLFD scheme and the GLGAN, a novel decomposition-based UDA framework called De-GLGAN is developed to improve the cross-domain transferability and generalization capability of semantic segmentation models. Extensive experiments on two UDA benchmarks, namely ISPRS Potsdam and Vaihingen, and LoveDA Rural and Urban, demonstrate the effectiveness and superiority of the proposed approach over existing state-of-the-art UDA methods. The source code for this work is accessible at https://github.com/sstary/SSRS.
引用
收藏
页数:18
相关论文
共 69 条
[31]   Domain Adaptive Land-Cover Classification via Local Consistency and Global Diversity [J].
Ma, Ailong ;
Zheng, Chenyu ;
Wang, Junjue ;
Zhong, Yanfei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
[32]   Unsupervised Domain Adaptation Augmented by Mutually Boosted Attention for Semantic Segmentation of VHR Remote Sensing Images [J].
Ma, Xianping ;
Zhang, Xiaokang ;
Wang, Zhiguo ;
Pun, Man-On .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
[33]   RS3Mamba: Visual State Space Model for Remote Sensing Image Semantic Segmentation [J].
Ma, Xianping ;
Zhang, Xiaokang ;
Pun, Man-On .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
[34]   A Multilevel Multimodal Fusion Transformer for Remote Sensing Semantic Segmentation [J].
Ma, Xianping ;
Zhang, Xiaokang ;
Pun, Man-On ;
Liu, Ming .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 :1-15
[35]   A Crossmodal Multiscale Fusion Network for Semantic Segmentation of Remote Sensing Data [J].
Ma, Xianping ;
Zhang, Xiaokang ;
Pun, Man-On .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 :3463-3474
[36]  
Ma XH, 2024, IEEE T GEOSCI REMOTE, V62, DOI [10.1109/TGRS.2024.3356524, 10.1109/TGRS.2024.3443420]
[37]   Category-Level Assignment for Cross-Domain Semantic Segmentation in Remote Sensing Images [J].
Ni, Huan ;
Liu, Qingshan ;
Guan, Haiyan ;
Tang, Hong ;
Chanussot, Jocelyn .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
[38]   Domain Invariant and Compact Prototype Contrast Adaptation for Hyperspectral Image Classification [J].
Ning, Yujie ;
Peng, Jiangtao ;
Liu, Quanyong ;
Sun, Weiwei ;
Du, Qian .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 :1-14
[39]   Full-Level Domain Adaptation for Building Extraction in Very-High-Resolution Optical Remote-Sensing Images [J].
Peng, Daifeng ;
Guan, Haiyan ;
Zang, Yufu ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[40]   Domain Adaptation in Remote Sensing Image Classification: A Survey [J].
Peng, Jiangtao ;
Huang, Yi ;
Sun, Weiwei ;
Chen, Na ;
Ning, Yujie ;
Du, Qian .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 :9842-9859