DDF: A Novel Dual-Domain Image Fusion Strategy for Remote Sensing Image Semantic Segmentation With Unsupervised Domain Adaptation

被引:3
|
作者
Ran, Lingyan [1 ,2 ]
Wang, Lushuang [1 ,2 ]
Zhuo, Tao [3 ]
Xing, Yinghui [1 ,2 ]
Zhang, Yanning [1 ,2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Shaanxi Prov Key Lab Speech & Image Informat Proc, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Sch Comp Sci, Natl Engn Lab Integrated Aerosp Ground Ocean Big D, Xian 710072, Peoples R China
[3] Northwest A&F Univ, Coll Informat Engn, Yangling 712100, Xianyang, Peoples R China
基金
中国国家自然科学基金;
关键词
Training; Adaptation models; Remote sensing; Semantic segmentation; Task analysis; Accuracy; Semantics; Domain adaptation; feature fusion; semantic segmentation;
D O I
10.1109/TGRS.2024.3433564
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The semantic segmentation of remote sensing (RS) images is a challenging and hot issue due to the large amount of unlabeled data and domain variation. Unsupervised domain adaptation (UDA) has proven to be advantageous in leveraging unlabeled information from the target domain. However, traditional approaches of independently fine-tuning UDA models in the source and target domains have a limited effect on the result. In this article, we propose a hybrid training strategy that boosts self-training methods with domain fusion images. First, we introduce a novel dual-domain image fusion (DDF) strategy to effectively utilize the original image, the style-transferred image, and the intermediate-domain information. Second, to further refine the precision of pseudolabels, we present a region-specific reweighting strategy that assigns different weights to pseudolabel regions based on their spatial context. Finally, we conduct a series of extensive benchmark experiments and ablation studies on the ISPRS Vaihingen and Potsdam datasets. These results show the efficiency of our approach and establish a practical basis for implementing semantic segmentation in remote sensors.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Scale variance minimization for unsupervised domain adaptation in image segmentation
    Guan, Dayan
    Huang, Jiaxing
    Lu, Shijian
    Xiao, Aoran
    PATTERN RECOGNITION, 2021, 112
  • [42] Unsupervised domain adaptation for histopathology image segmentation with incomplete labels
    Zhou H.
    Wang Y.
    Zhang B.
    Zhou C.
    Vonsky M.S.
    Mitrofanova L.B.
    Zou D.
    Li Q.
    Computers in Biology and Medicine, 2024, 171
  • [43] Rethinking Disentanglement in Unsupervised Domain Adaptation for Medical Image Segmentation
    Wang, Yan
    Chen, Yixin
    Zhang, Yingying
    Zhu, Haogang
    2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2023,
  • [44] Style Consistency Unsupervised Domain Adaptation Medical Image Segmentation
    Chen, Lang
    Bian, Yun
    Zeng, Jianbin
    Meng, Qingquan
    Zhu, Weifang
    Shi, Fei
    Shao, Chengwei
    Chen, Xinjian
    Xiang, Dehui
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 4882 - 4895
  • [45] Unsupervised remote sensing image segmentation based on a dual autoencoder
    Zhang, Ruonan
    Yu, Long
    Tian, Shengwei
    Lv, Yalong
    JOURNAL OF APPLIED REMOTE SENSING, 2019, 13 (03)
  • [46] Rethinking adversarial domain adaptation: Orthogonal decomposition for unsupervised domain adaptation in medical image segmentation
    Sun, Yongheng
    Dai, Duwei
    Xu, Songhua
    MEDICAL IMAGE ANALYSIS, 2022, 82
  • [47] Rethinking adversarial domain adaptation: Orthogonal decomposition for unsupervised domain adaptation in medical image segmentation
    Sun, Yongheng
    Dai, Duwei
    Xu, Songhua
    Medical Image Analysis, 2022, 82
  • [48] Unsupervised Domain Adaptation in Semantic Segmentation: A Review
    Toldo, Marco
    Maracani, Andrea
    Michieli, Umberto
    Zanuttigh, Pietro
    TECHNOLOGIES, 2020, 8 (02)
  • [49] Geometric Unsupervised Domain Adaptation for Semantic Segmentation
    Guizilini, Vitor
    Li, Jie
    Ambrus, Rares
    Gaidon, Adrien
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 8517 - 8527
  • [50] Multichannel Semantic Segmentation with Unsupervised Domain Adaptation
    Watanabe, Kohei
    Saito, Kuniaki
    Ushiku, Yoshitaka
    Harada, Tatsuya
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 : 600 - 616