Bridging the Domain Gap: A Simple Domain Matching Method for Reference-Based Image Super-Resolution in Remote Sensing

被引:2
作者
Min, Jeongho [1 ]
Lee, Yejun [1 ]
Kim, Dongyoung [1 ]
Yoo, Jaejun [1 ]
机构
[1] Ulsan Natl Inst Sci & Technol, Grad Sch Artificial Intelligence, Ulsan 44919, South Korea
关键词
Domain adaptation; reference-based image super-resolution (RefSR); remote sensing;
D O I
10.1109/LGRS.2023.3336680
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Recently, reference-based image super-resolution (RefSR) has shown excellent performance in image super-resolution (SR) tasks. The main idea of RefSR is to utilize additional information from the reference (Ref) image to recover the high-frequency components in low-resolution (LR) images. By transferring relevant textures through feature matching, RefSR models outperform existing single-image SR (SISR) models. However, their performance significantly declines when a domain gap between Ref and LR images exists, which often occurs in real-world scenarios, such as satellite imaging. In this letter, we introduce a domain matching (DM) module that can be seamlessly integrated with existing RefSR models to enhance their performance in a plug-and-play manner. To the best of our knowledge, we are the first to explore DM-based RefSR in remote sensing image processing. Our analysis reveals that their domain gaps often occur in different satellites, and our model effectively addresses these challenges, whereas existing models struggle. Our experiments demonstrate that the proposed DM module improves SR performance both qualitatively and quantitatively for remote sensing SR tasks.
引用
收藏
页码:1 / 5
页数:5
相关论文
共 19 条
  • [1] Reference-Based Image Super-Resolution with Deformable Attention Transformer
    Cao, Jiezhang
    Liang, Jingyun
    Zhang, Kai
    Li, Yawei
    Zhang, Yulun
    Wang, Wenguan
    Van Gool, Luc
    [J]. COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 : 325 - 342
  • [2] Remote Sensing Image Change Detection With Transformers
    Chen, Hao
    Qi, Zipeng
    Shi, Zhenwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [3] ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data
    Diakogiannis, Foivos, I
    Waldner, Francois
    Caccetta, Peter
    Wu, Chen
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 162 (162) : 94 - 114
  • [4] RRSGAN: Reference-Based Super-Resolution for Remote Sensing Image
    Dong, Runmin
    Zhang, Lixian
    Fu, Haohuan
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [5] Cross-Scale Mixing Attention for Multisource Remote Sensing Data Fusion and Classification
    Gao, Yunhao
    Zhang, Mengmeng
    Wang, Junjie
    Li, Wei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [6] Object Detection in Optical Remote Sensing Images Based on Weakly Supervised Learning and High-Level Feature Learning
    Han, Junwei
    Zhang, Dingwen
    Cheng, Gong
    Guo, Lei
    Ren, Jinchang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (06): : 3325 - 3337
  • [7] Robust Reference-based Super-Resolution via C2-Matching
    Jiang, Yuming
    Chan, Kelvin C. K.
    Wang, Xintao
    Loy, Chen Change
    Liu, Ziwei
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 2103 - 2112
  • [8] Jin Z., 2022, ARXIV220806140
  • [9] Multilayer Degradation Representation-Guided Blind Super-Resolution for Remote Sensing Images
    Kang, Xudong
    Li, Jier
    Duan, Puhong
    Ma, Fuyan
    Li, Shutao
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [10] Li YJ, 2017, ADV NEUR IN, V30