Multilayer Degradation Representation-Guided Blind Super-Resolution for Remote Sensing Images

被引:20
作者
Kang, Xudong [1 ]
Li, Jier [2 ]
Duan, Puhong [2 ]
Ma, Fuyan [2 ]
Li, Shutao [2 ]
机构
[1] Hunan Univ, Sch Robot, Changsha 410082, Hunan, Peoples R China
[2] Hunan Univ, Coll Elect & Informat Engn, Changsha 410082, Hunan, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2022年 / 60卷
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Degradation; Feature extraction; Superresolution; Remote sensing; Kernel; Image reconstruction; Imaging; Blind super-resolution (SR); degradation-guided feature extraction; multilayer feature fusion; remote sensing image; representation learning; CLASSIFICATION; RESOLUTION; NETWORK;
D O I
10.1109/TGRS.2022.3192680
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Remote sensing image super-resolution (SR) aims to boost the image resolution while recovering rich high-frequency details. Currently, most of the SR methods are based on an assumption that the degradation kernel is a specific downsampler. However, the degradation kernel is unknown and sophisticated for real remote sensing scenes, leading to a severe performance drop. To alleviate this problem, we propose a multilayer degradation representation-guided blind SR method for remote sensing images, which mainly consists of three key steps. First, an unsupervised representation learning is exploited to learn the degradation representation from low-resolution images. Then, a degradation-guided deep residual module is designed to model high-order features across different scales from the original images. Finally, a multilayer degradation-aware feature fusion mechanism is proposed to restore the finer details. Experiments on synthetic and real datasets demonstrate that the proposed method can achieve promising performance with respect to other state-of-the-art SR approaches.
引用
收藏
页数:12
相关论文
共 57 条
[41]   Extraction of high-resolution frames from video sequences [J].
Schultz, RR ;
Stevenson, RL .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 1996, 5 (06) :996-1011
[42]   Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network [J].
Shi, Wenzhe ;
Caballero, Jose ;
Huszar, Ferenc ;
Totz, Johannes ;
Aitken, Andrew P. ;
Bishop, Rob ;
Rueckert, Daniel ;
Wang, Zehan .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1874-1883
[43]  
Sun J, 2008, PROC CVPR IEEE, P2471, DOI 10.1109/CVPR.2008.4587659
[44]   Super Resolution using Edge Prior and Single Image Detail Synthesis [J].
Tai, Yu-Wing ;
Liu, Shuaicheng ;
Brown, Michael S. ;
Lin, Stephen .
2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, :2400-2407
[45]   RSCNet: A Residual Self-Calibrated Network for Hyperspectral Image Change Detection [J].
Wang, Liguo ;
Wang, Lifeng ;
Wang, Qunming ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[46]   Unsupervised Degradation Representation Learning for Blind Super-Resolution [J].
Wang, Longguang ;
Wang, Yingqian ;
Dong, Xiaoyu ;
Xu, Qingyu ;
Yang, Jungang ;
An, Wei ;
Guo, Yulan .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :10576-10585
[47]   Image quality assessment: From error visibility to structural similarity [J].
Wang, Z ;
Bovik, AC ;
Sheikh, HR ;
Simoncelli, EP .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (04) :600-612
[48]   CBAM: Convolutional Block Attention Module [J].
Woo, Sanghyun ;
Park, Jongchan ;
Lee, Joon-Young ;
Kweon, In So .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :3-19
[49]   AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classification [J].
Xia, Gui-Song ;
Hu, Jingwen ;
Hu, Fan ;
Shi, Baoguang ;
Bai, Xiang ;
Zhong, Yanfei ;
Zhang, Liangpei ;
Lu, Xiaoqiang .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (07) :3965-3981
[50]   Unsupervised Image Super-Resolution using Cycle-in-Cycle Generative Adversarial Networks [J].
Yuan, Yuan ;
Liu, Siyuan ;
Zhang, Jiawei ;
Zhang, Yongbing ;
Dong, Chao ;
Lin, Liang .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :814-823