DDF: A Novel Dual-Domain Image Fusion Strategy for Remote Sensing Image Semantic Segmentation With Unsupervised Domain Adaptation

被引:3
|
作者
Ran, Lingyan [1 ,2 ]
Wang, Lushuang [1 ,2 ]
Zhuo, Tao [3 ]
Xing, Yinghui [1 ,2 ]
Zhang, Yanning [1 ,2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Shaanxi Prov Key Lab Speech & Image Informat Proc, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Sch Comp Sci, Natl Engn Lab Integrated Aerosp Ground Ocean Big D, Xian 710072, Peoples R China
[3] Northwest A&F Univ, Coll Informat Engn, Yangling 712100, Xianyang, Peoples R China
基金
中国国家自然科学基金;
关键词
Training; Adaptation models; Remote sensing; Semantic segmentation; Task analysis; Accuracy; Semantics; Domain adaptation; feature fusion; semantic segmentation;
D O I
10.1109/TGRS.2024.3433564
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The semantic segmentation of remote sensing (RS) images is a challenging and hot issue due to the large amount of unlabeled data and domain variation. Unsupervised domain adaptation (UDA) has proven to be advantageous in leveraging unlabeled information from the target domain. However, traditional approaches of independently fine-tuning UDA models in the source and target domains have a limited effect on the result. In this article, we propose a hybrid training strategy that boosts self-training methods with domain fusion images. First, we introduce a novel dual-domain image fusion (DDF) strategy to effectively utilize the original image, the style-transferred image, and the intermediate-domain information. Second, to further refine the precision of pseudolabels, we present a region-specific reweighting strategy that assigns different weights to pseudolabel regions based on their spatial context. Finally, we conduct a series of extensive benchmark experiments and ablation studies on the ISPRS Vaihingen and Potsdam datasets. These results show the efficiency of our approach and establish a practical basis for implementing semantic segmentation in remote sensors.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Deep Relearning in the Geospatial Domain for Semantic Remote Sensing Image Segmentation
    Geib, Christian
    Zhu, Yue
    Qiu, Chunping
    Mou, Lichao
    Zhu, Xiao Xiang
    Taubenbock, Hannes
    IEEE Geoscience and Remote Sensing Letters, 2022, 19
  • [22] Unsupervised Domain Adaptation for Remote Sensing Image Segmentation Based on Adversarial Learning and Self-Training
    Liang, Chenbin
    Cheng, Bo
    Xiao, Baihua
    Dong, Yunyun
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [23] MDANet: Unsupervised, Mixed-Domain Adaptation for Semantic Segmentation of Remote Sensing Images
    Cui, Hao
    Zhang, Guo
    Qi, Ji
    Li, Haifeng
    Tao, Chao
    Li, Xue
    Hou, Shasha
    Li, Deren
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [24] Multilevel Heterogeneous Domain Adaptation Method for Remote Sensing Image Segmentation
    Liang, Chenbin
    Cheng, Bo
    Xiao, Baihua
    Dong, Yunyun
    Chen, Jinfen
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [25] Dual domain distribution disruption with semantics preservation: Unsupervised domain adaptation for medical image segmentation
    Zheng, Boyun
    Zhang, Ranran
    Diao, Songhui
    Zhu, Jingke
    Yuan, Yixuan
    Cai, Jing
    Shao, Liang
    Li, Shuo
    Qin, Wenjian
    MEDICAL IMAGE ANALYSIS, 2024, 97
  • [26] DUAL-DOMAIN IMAGE DENOISING
    Knaus, Claude
    Zwicker, Matthias
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 440 - 444
  • [27] Review of Unsupervised Domain Adaptation in Medical Image Segmentation
    Hu, Wei
    Xu, Qiaozhi
    Ge, Xiangwei
    Yu, Lei
    Computer Engineering and Applications, 2024, 60 (06) : 10 - 26
  • [28] Domain Adaptation for Remote Sensing Image Semantic Segmentation: An Integrated Approach of Contrastive Learning and Adversarial Learning
    Bai, Lubin
    Du, Shihong
    Zhang, Xiuyuan
    Wang, Haoyu
    Liu, Bo
    Ouyang, Song
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [29] A bidirectional semantic segmentation method for remote sensing image based on super-resolution and domain adaptation
    Liang, Min
    Wang, Xili
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (02) : 666 - 689
  • [30] Dual-domain prior unfolding network for remote sensing image super-resolution
    Dong, Jing
    Hu, Guifu
    Zhang, Jie
    Luo, Xiaoqing
    EARTH SCIENCE INFORMATICS, 2025, 18 (01)