DDF: A Novel Dual-Domain Image Fusion Strategy for Remote Sensing Image Semantic Segmentation With Unsupervised Domain Adaptation

被引:5
|
作者
Ran, Lingyan [1 ,2 ]
Wang, Lushuang [1 ,2 ]
Zhuo, Tao [3 ]
Xing, Yinghui [1 ,2 ]
Zhang, Yanning [1 ,2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Shaanxi Prov Key Lab Speech & Image Informat Proc, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Sch Comp Sci, Natl Engn Lab Integrated Aerosp Ground Ocean Big D, Xian 710072, Peoples R China
[3] Northwest A&F Univ, Coll Informat Engn, Yangling 712100, Xianyang, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Training; Adaptation models; Remote sensing; Semantic segmentation; Task analysis; Accuracy; Semantics; Domain adaptation; feature fusion; semantic segmentation;
D O I
10.1109/TGRS.2024.3433564
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The semantic segmentation of remote sensing (RS) images is a challenging and hot issue due to the large amount of unlabeled data and domain variation. Unsupervised domain adaptation (UDA) has proven to be advantageous in leveraging unlabeled information from the target domain. However, traditional approaches of independently fine-tuning UDA models in the source and target domains have a limited effect on the result. In this article, we propose a hybrid training strategy that boosts self-training methods with domain fusion images. First, we introduce a novel dual-domain image fusion (DDF) strategy to effectively utilize the original image, the style-transferred image, and the intermediate-domain information. Second, to further refine the precision of pseudolabels, we present a region-specific reweighting strategy that assigns different weights to pseudolabel regions based on their spatial context. Finally, we conduct a series of extensive benchmark experiments and ablation studies on the ISPRS Vaihingen and Potsdam datasets. These results show the efficiency of our approach and establish a practical basis for implementing semantic segmentation in remote sensors.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Unsupervised Domain Adaptation Semantic Segmentation of High-Resolution Remote Sensing Imagery With Invariant Domain-Level Prototype Memory
    Zhu, Jingru
    Guo, Ya
    Sun, Geng
    Yang, Libo
    Deng, Min
    Chen, Jie
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [22] Unsupervised Domain Adaptation Semantic Segmentation of High-Resolution Remote Sensing Imagery With Invariant Domain-Level Prototype Memory
    Zhu, Jingru
    Guo, Ya
    Sun, Geng
    Yang, Libo
    Deng, Min
    Chen, Jie
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [23] Unsupervised Adversarial Domain Adaptation Network for Semantic Segmentation
    Liu, Wei
    Su, Fulin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (11) : 1978 - 1982
  • [24] Curriculum-Style Local-to-Global Adaptation for Cross-Domain Remote Sensing Image Segmentation
    Zhang, Bo
    Chen, Tao
    Wang, Bin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [25] Multi-modal unsupervised domain adaptation for semantic image segmentation
    Hu, Sijie
    Bonardi, Fabien
    Bouchafa, Samia
    Sidibe, Desire
    PATTERN RECOGNITION, 2023, 137
  • [26] BiFDANet: Unsupervised Bidirectional Domain Adaptation for Semantic Segmentation of Remote Sensing Images
    Cai, Yuxiang
    Yang, Yingchun
    Zheng, Qiyi
    Shen, Zhengwei
    Shang, Yongheng
    Yin, Jianwei
    Shi, Zhongtian
    REMOTE SENSING, 2022, 14 (01)
  • [27] A bidirectional semantic segmentation method for remote sensing image based on super-resolution and domain adaptation
    Liang, Min
    Wang, Xili
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (02) : 666 - 689
  • [28] STAIR FUSION NETWORK FOR REMOTE SENSING IMAGE SEMANTIC SEGMENTATION
    Hua, Wenyi
    Liu, Jia
    Liu, Fang
    Zhang, Wenhua
    An, Jiaqi
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 5499 - 5502
  • [29] Unsupervised Multimodal Remote Sensing Image Registration via Domain Adaptation
    Shi, Lukui
    Zhao, Ruiyun
    Pan, Bin
    Zou, Zhengxia
    Shi, Zhenwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [30] Hybrid Attention Fusion Embedded in Transformer for Remote Sensing Image Semantic Segmentation
    Chen, Yan
    Dong, Quan
    Wang, Xiaofeng
    Zhang, Qianchuan
    Kang, Menglei
    Jiang, Wenxiang
    Wang, Mengyuan
    Xu, Lixiang
    Zhang, Chen
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 4421 - 4435