DDF: A Novel Dual-Domain Image Fusion Strategy for Remote Sensing Image Semantic Segmentation With Unsupervised Domain Adaptation

被引:3
|
作者
Ran, Lingyan [1 ,2 ]
Wang, Lushuang [1 ,2 ]
Zhuo, Tao [3 ]
Xing, Yinghui [1 ,2 ]
Zhang, Yanning [1 ,2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Shaanxi Prov Key Lab Speech & Image Informat Proc, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Sch Comp Sci, Natl Engn Lab Integrated Aerosp Ground Ocean Big D, Xian 710072, Peoples R China
[3] Northwest A&F Univ, Coll Informat Engn, Yangling 712100, Xianyang, Peoples R China
基金
中国国家自然科学基金;
关键词
Training; Adaptation models; Remote sensing; Semantic segmentation; Task analysis; Accuracy; Semantics; Domain adaptation; feature fusion; semantic segmentation;
D O I
10.1109/TGRS.2024.3433564
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The semantic segmentation of remote sensing (RS) images is a challenging and hot issue due to the large amount of unlabeled data and domain variation. Unsupervised domain adaptation (UDA) has proven to be advantageous in leveraging unlabeled information from the target domain. However, traditional approaches of independently fine-tuning UDA models in the source and target domains have a limited effect on the result. In this article, we propose a hybrid training strategy that boosts self-training methods with domain fusion images. First, we introduce a novel dual-domain image fusion (DDF) strategy to effectively utilize the original image, the style-transferred image, and the intermediate-domain information. Second, to further refine the precision of pseudolabels, we present a region-specific reweighting strategy that assigns different weights to pseudolabel regions based on their spatial context. Finally, we conduct a series of extensive benchmark experiments and ablation studies on the ISPRS Vaihingen and Potsdam datasets. These results show the efficiency of our approach and establish a practical basis for implementing semantic segmentation in remote sensors.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] CMT: Cross Mean Teacher Unsupervised Domain Adaptation for VHR Image Semantic Segmentation
    Yan, Liang
    Fan, Bin
    Xiang, Shiming
    Pan, Chunhong
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [32] Semantic Consistent Unsupervised Domain Adaptation for Cross-Modality Medical Image Segmentation
    Zeng, Guodong
    Lerch, Till D.
    Schmaranzer, Florian
    Zheng, Guoyan
    Burger, Juergen
    Gerber, Kate
    Tannast, Moritz
    Siebenrock, Klaus
    Gerber, Nicolas
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT III, 2021, 12903 : 201 - 210
  • [33] Unsupervised Domain Adaptation Semantic Segmentation for Remote-Sensing Images via Covariance Attention
    Liu, Yikun
    Kang, Xudong
    Huang, Yuwen
    Wang, Kuikui
    Yang, Gongping
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [34] A Fine-Grained Unsupervised Domain Adaptation Framework for Semantic Segmentation of Remote Sensing Images
    Wang, Luhan
    Xiao, Pengfeng
    Zhang, Xueliang
    Chen, Xinyang
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 4109 - 4121
  • [35] Unsupervised Domain Adaptation Semantic Segmentation of Remote Sensing Images With Mask Enhancement and Balanced Sampling
    Li, Xin
    Qiu, Yuanbo
    Liao, Jixiu
    Meng, Fan
    Ren, Peng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [36] DIFNet: Dual-Domain Information Fusion Network for Image Denoising
    Wu, Zedong
    Shi, Wenxu
    Xu, Liming
    Ding, Zicheng
    Liu, Tong
    Zhang, Zheng
    Zheng, Bochuan
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VIII, 2025, 15038 : 279 - 293
  • [37] Self-training guided disentangled adaptation for cross-domain remote sensing image semantic segmentation
    Zhao, Qi
    Lyu, Shuchang
    Zhao, Hongbo
    Liu, Binghao
    Chen, Lijiang
    Cheng, Guangliang
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 127
  • [38] An Unsupervised Domain Adaptation Method for Multi-Modal Remote Sensing Image Classification
    Liu, Wei
    Qin, Rongjun
    Su, Fulin
    Hu, Kun
    2018 26TH INTERNATIONAL CONFERENCE ON GEOINFORMATICS (GEOINFORMATICS 2018), 2018,
  • [39] Dual-Domain Attention for Image Deblurring
    Cui, Yuning
    Tao, Yi
    Ren, Wenqi
    Knoll, Alois
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 479 - 487
  • [40] Spatial-Frequency Dual-Domain Feature Fusion Network for Low-Light Remote Sensing Image Enhancement
    Yao, Zishu
    Fan, Guodong
    Fan, Jinfu
    Gan, Min
    Chen, C. L. Philip
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62