Robust Remote Sensing Super-Resolution With Frequency Domain Decoupling for Multiscenarios

被引:3
作者
Wang, Sheng [1 ,2 ,3 ]
Han, Boxun [1 ,2 ,3 ]
Yang, Linzhe [1 ,2 ,3 ]
Zhao, Chaoyue [1 ,2 ,3 ]
Liang, Aokang [1 ,2 ,3 ]
Hu, Chunying [1 ,2 ,3 ]
Yang, Feng [1 ,2 ,3 ]
Xu, Fu [1 ,2 ,3 ]
机构
[1] Beijing Forestry Univ, Sch Informat Sci & Technol, Beijing 100083, Peoples R China
[2] Natl Forestry & Grassland Adm, Engn Res Ctr Forestry Oriented Intelligent Informa, Beijing 100083, Peoples R China
[3] State Key Lab Efficient Prod Forest Resources, Beijing 100083, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
关键词
Feature extraction; Self-aware; Remote sensing; Transformers; Superresolution; Spatial resolution; Noise; satellite imagery; super-resolution (SR); transformer;
D O I
10.1109/TGRS.2024.3406516
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Super-resolution (SR) for remote sensing has the potential for a huge impact on diverse applications by reconstructing an accurate high-resolution (HR) image from its low-resolution (LR) counterpart. Despite a lot of attention, most recent methods concentrate on the overall modeling of the original inputs and treat various frequency information within the image equally, which can lead to distortion of image details or artifacts. To tackle this issue, we proposed a frequency-domain decoupling approach for image SR. It uses nonparametric clustering to obtain the low-frequency contours, applies a linearized transformer to model the long-range dependency of the mid-frequency details, processes the high-frequency textural with the attention mechanism (AM), and employs the Fourier transform to integrate different frequency information effectively. By processing the different frequencies independently, we achieve a more accurate enhancement of the original scene's visual quality without adding noise. We conducted evaluations of our method across five real-world scenarios with distinct characteristics. The results show that our model has a significant improvement in peak signal-to-noise ratio of 2.4-5.5 dB over the state-of-the-art method.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 43 条
[1]   Super-resolution land cover mapping with indicator geostatistics [J].
Boucher, Alexandre ;
Kyriakidis, Phaedon C. .
REMOTE SENSING OF ENVIRONMENT, 2006, 104 (03) :264-282
[2]   THE LAPLACIAN PYRAMID AS A COMPACT IMAGE CODE [J].
BURT, PJ ;
ADELSON, EH .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1983, 31 (04) :532-540
[3]   Super-Resolution-Guided Progressive Pansharpening Based on a Deep Convolutional Neural Network [J].
Cai, Jiajun ;
Huang, Bo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (06) :5206-5220
[4]  
CARPER WJ, 1990, PHOTOGRAMM ENG REM S, V56, P459
[5]  
CHAVEZ PS, 1989, PHOTOGRAMM ENG REM S, V55, P339
[6]   Learning Continuous Image Representation with Local Implicit Image Function [J].
Chen, Yinbo ;
Liu, Sifei ;
Wang, Xiaolong .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :8624-8634
[7]  
Conde Marcos V., 2023, Computer Vision - ECCV 2022 Workshops: Proceedings. Lecture Notes in Computer Science (13802), P669, DOI 10.1007/978-3-031-25063-7_42
[8]  
DICKINSON RE, 1975, B AM METEOROL SOC, V56, P1240, DOI 10.1175/1520-0477(1975)056<1240:SVATLA>2.0.CO
[9]  
2
[10]   RRSGAN: Reference-Based Super-Resolution for Remote Sensing Image [J].
Dong, Runmin ;
Zhang, Lixian ;
Fu, Haohuan .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60