Decomposition-Based Unsupervised Domain Adaptation for Remote Sensing Image Semantic Segmentation

被引:8
作者
Ma, Xianping [1 ]
Zhang, Xiaokang [2 ,3 ]
Ding, Xingchen [4 ]
Pun, Man-On [1 ]
Ma, Siwei [5 ]
机构
[1] Chinese Univ Hong Kong Shenzhen, Sch Sci & Engn, Shenzhen 518172, Peoples R China
[2] Hubei Luojia Lab, Wuhan 430079, Peoples R China
[3] Wuhan Univ Sci & Technol, Sch Informat Sci & Engn, Wuhan 430081, Peoples R China
[4] Wuhan Univ, Sch Cyber Sci & Engn, Wuhan 430072, Peoples R China
[5] Peking Univ, Sch Elect Engn & Comp Sci, Beijing 100871, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Semantic segmentation; Remote sensing; Training; Semantics; Feature extraction; Context modeling; Transformers; Generators; Generative adversarial networks; Adaptation models; Global-local information; high/low-frequency decomposition (HLFD); remote sensing; semantic segmentation; unsupervised domain adaptation (UDA); NETWORK;
D O I
10.1109/TGRS.2024.3483283
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Unsupervised domain adaptation (UDA) techniques are vital for semantic segmentation in geosciences, effectively utilizing remote sensing imagery across diverse domains. However, most existing UDA methods, which focus on domain alignment at the high-level feature space, struggle to simultaneously retain local spatial details and global contextual semantics. To overcome these challenges, a novel decomposition scheme is proposed to guide domain-invariant representation learning. Specifically, multiscale high/low-frequency decomposition (HLFD) modules are proposed to decompose feature maps into high- and low-frequency components across different subspaces. This decomposition is integrated into a fully global-local generative adversarial network (GLGAN) that incorporates global-local transformer blocks (GLTBs) to enhance the alignment of decomposed features. By integrating the HLFD scheme and the GLGAN, a novel decomposition-based UDA framework called De-GLGAN is developed to improve the cross-domain transferability and generalization capability of semantic segmentation models. Extensive experiments on two UDA benchmarks, namely ISPRS Potsdam and Vaihingen, and LoveDA Rural and Urban, demonstrate the effectiveness and superiority of the proposed approach over existing state-of-the-art UDA methods. The source code for this work is accessible at https://github.com/sstary/SSRS.
引用
收藏
页数:18
相关论文
共 69 条
[1]   Improving Vision Transformers by Revisiting High-Frequency Components [J].
Bai, Jiawang ;
Yuan, Li ;
Xia, Shu-Tao ;
Yan, Shuicheng ;
Li, Zhifeng ;
Liu, Wei .
COMPUTER VISION, ECCV 2022, PT XXIV, 2022, 13684 :1-18
[2]   Unsupervised Domain Adaptation Using Generative Adversarial Networks for Semantic Segmentation of Aerial Images [J].
Benjdira, Bilel ;
Bazi, Yakoub ;
Koubaa, Anis ;
Ouni, Kais .
REMOTE SENSING, 2019, 11 (11)
[3]   IterDANet: Iterative Intra-Domain Adaptation for Semantic Segmentation of Remote Sensing Images [J].
Cai, Yuxiang ;
Yang, Yingchun ;
Shang, Yongheng ;
Chen, Zhenqian ;
Shen, Zhengwei ;
Yin, Jianwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[4]   Exchange means change: An unsupervised single-temporal change detection framework based on intra- and inter-image patch exchange [J].
Chen, Hongruixuan ;
Song, Jian ;
Wu, Chen ;
Du, Bo ;
Yokoya, Naoto .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 206 :87-105
[5]  
Chen JY, 2023, INT J CLIN PHARM TH, V61, P1, DOI [10.5414/CP204156, 10.1109/TGRS.2023.3262576]
[6]   Unsupervised Domain Adaptation for Building Extraction of High-Resolution Remote Sensing Imagery Based on Decoupling Style and Semantic Features [J].
Chen, Jie ;
Zhu, Jingru ;
He, Peien ;
Guo, Ya ;
Hong, Liang ;
Yang, Yin ;
Deng, Min ;
Sun, Geng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 :1-17
[7]   Unsupervised Domain Adaptation for Semantic Segmentation of High-Resolution Remote Sensing Imagery Driven by Category-Certainty Attention [J].
Chen, Jie ;
Zhu, Jingru ;
Guo, Ya ;
Sun, Geng ;
Zhang, Yi ;
Deng, Min .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[8]   Towards Large-Scale Small Object Detection: Survey and Benchmarks [J].
Cheng, Gong ;
Yuan, Xiang ;
Yao, Xiwen ;
Yan, Kebing ;
Zeng, Qinghua ;
Xie, Xingxing ;
Han, Junwei .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (11) :13467-13488
[9]   ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data [J].
Diakogiannis, Foivos, I ;
Waldner, Francois ;
Caccetta, Peter ;
Wu, Chen .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 162 :94-114
[10]  
Ganin Y, 2016, J MACH LEARN RES, V17