DDF: A Novel Dual-Domain Image Fusion Strategy for Remote Sensing Image Semantic Segmentation With Unsupervised Domain Adaptation

被引:5
|
作者
Ran, Lingyan [1 ,2 ]
Wang, Lushuang [1 ,2 ]
Zhuo, Tao [3 ]
Xing, Yinghui [1 ,2 ]
Zhang, Yanning [1 ,2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Shaanxi Prov Key Lab Speech & Image Informat Proc, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Sch Comp Sci, Natl Engn Lab Integrated Aerosp Ground Ocean Big D, Xian 710072, Peoples R China
[3] Northwest A&F Univ, Coll Informat Engn, Yangling 712100, Xianyang, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Training; Adaptation models; Remote sensing; Semantic segmentation; Task analysis; Accuracy; Semantics; Domain adaptation; feature fusion; semantic segmentation;
D O I
10.1109/TGRS.2024.3433564
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The semantic segmentation of remote sensing (RS) images is a challenging and hot issue due to the large amount of unlabeled data and domain variation. Unsupervised domain adaptation (UDA) has proven to be advantageous in leveraging unlabeled information from the target domain. However, traditional approaches of independently fine-tuning UDA models in the source and target domains have a limited effect on the result. In this article, we propose a hybrid training strategy that boosts self-training methods with domain fusion images. First, we introduce a novel dual-domain image fusion (DDF) strategy to effectively utilize the original image, the style-transferred image, and the intermediate-domain information. Second, to further refine the precision of pseudolabels, we present a region-specific reweighting strategy that assigns different weights to pseudolabel regions based on their spatial context. Finally, we conduct a series of extensive benchmark experiments and ablation studies on the ISPRS Vaihingen and Potsdam datasets. These results show the efficiency of our approach and establish a practical basis for implementing semantic segmentation in remote sensors.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Domain adaptive remote sensing image semantic segmentation with prototype guidance
    Zeng, Wankang
    Cheng, Ming
    Yuan, Zhimin
    Dai, Wei
    Wu, Youming
    Liu, Weiquan
    Wang, Cheng
    NEUROCOMPUTING, 2024, 580
  • [32] Tackling Dual Gaps in Remote Sensing Segmentation: Task-Oriented Super-Resolution for Domain Adaptation
    Hong, Eungi
    Koo, Jamyoung
    Pyo, Seongmin
    Choi, Haechul
    Kim, Eunkyung
    Jang, Haneol
    IEEE ACCESS, 2024, 12 : 181462 - 181476
  • [33] DSM-Assisted Unsupervised Domain Adaptive Network for Semantic Segmentation of Remote Sensing Imagery
    Zhou, Shunping
    Feng, Yuting
    Li, Shengwen
    Zheng, Daoyuan
    Fang, Fang
    Liu, Yuanyuan
    Wan, Bo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [34] Unsupervised Domain Adaptation for Remote Sensing Image Segmentation Based on Adversarial Learning and Self-Training
    Liang, Chenbin
    Cheng, Bo
    Xiao, Baihua
    Dong, Yunyun
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [35] Deep Relearning in the Geospatial Domain for Semantic Remote Sensing Image Segmentation
    Geiss, Christian
    Zhu, Yue
    Qiu, Chunping
    Mou, Lichao
    Zhu, Xiao Xiang
    Taubenboeck, Hannes
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [36] Entropy Guided Adversarial Domain Adaptation for Aerial Image Semantic Segmentation
    Zheng, Aihua
    Wang, Ming
    Li, Chenglong
    Tang, Jin
    Luo, Bin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [37] Multichannel Semantic Segmentation with Unsupervised Domain Adaptation
    Watanabe, Kohei
    Saito, Kuniaki
    Ushiku, Yoshitaka
    Harada, Tatsuya
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 : 600 - 616
  • [38] Class-Aware Domain Adaptation for Semantic Segmentation of Remote Sensing Images
    Xu, Qingsong
    Yuan, Xin
    Ouyang, Chaojun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [39] Rethinking unsupervised domain adaptation for semantic segmentation
    Wang, Zhijie
    Suganuma, Masanori
    Okatani, Takayuki
    PATTERN RECOGNITION LETTERS, 2024, 186 : 119 - 125
  • [40] A One-Stage Domain Adaptation Network With Image Alignment for Unsupervised Nighttime Semantic Segmentation
    Wu, Xinyi
    Wu, Zhenyao
    Ju, Lili
    Wang, Song
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (01) : 58 - 72