Super-Resolution of Single Remote Sensing Image Based on Residual Dense Backprojection Networks

被引:106
作者
Pan, Zongxu [1 ,2 ]
Ma, Wen [1 ,2 ,3 ]
Gu, Jiayi [1 ,2 ,3 ]
Lei, Bin [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Inst Elect, Beijing 100190, Peoples R China
[2] Chinese Acad Sci, Key Lab Technol Geospatial Informat Proc & Applic, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing 101408, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2019年 / 57卷 / 10期
基金
中国国家自然科学基金;
关键词
Convolutional neural networks (CNNs); dense backprojection blocks; remote sensing images; residual learning; single image super-resolution (SISR); SUPER RESOLUTION; REPRESENTATION;
D O I
10.1109/TGRS.2019.2917427
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
High-resolution (HR) images are always preferred for many remote sensing applications, which can be obtained from their low-resolution (LR) counterparts via a technique referred to as super-resolution (SR). Among SR approaches, single image SR (SISR) methods aim at reconstructing the HR image from only one LR image. In this paper, a residual dense backprojection network (RDBPN)-based SISR method is proposed to promote the resolution of RGB remote sensing images with median- and large-scale factors. The proposed network consists of several residual dense backprojection blocks that contain two kinds of modules, named the upprojection module and the downprojection module, and these modules are densely connected in one block. Different from the chain-connected backprojection structure, the proposed method applies a residual backprojection block structure, which can utilize residual learning in both global and local manners. We further simplify the network by replacing the downprojection unit with the downscaling unit to accelerate the speed of reconstruction, and this implementation is called fast RDBPN (FRDBPN). Several experiments under the UC Merced data set are conducted to validate the effectiveness of the proposed method, and the results indicate that: 1) the proposed residual block structure is superior to the chain-connected structure; 2) FRDBPN achieves a speedup of about 1.3 times with similar and even better-reconstructed performance in comparison with RDBPN; and 3) RDBPN and FRDBPN outperform several state-of-the-art methods in terms of both quantitative evaluation and visual quality.
引用
收藏
页码:7918 / 7933
页数:16
相关论文
共 63 条
[1]  
[Anonymous], 2017, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2017.618
[2]   Limits on super-resolution and how to break them [J].
Baker, S ;
Kanade, T .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (09) :1167-1183
[3]   Single image super-resolution using collaborative representation and non-local self-similarity [J].
Chang, Kan ;
Ding, Pak Lun Kevin ;
Li, Baoxin .
SIGNAL PROCESSING, 2018, 149 :49-61
[4]   Remote Sensing Image Scene Classification: Benchmark and State of the Art [J].
Cheng, Gong ;
Han, Junwei ;
Lu, Xiaoqiang .
PROCEEDINGS OF THE IEEE, 2017, 105 (10) :1865-1883
[5]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[6]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[7]   Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization [J].
Dong, Weisheng ;
Zhang, Lei ;
Shi, Guangming ;
Wu, Xiaolin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (07) :1838-1857
[8]   Example-based super-resolution [J].
Freeman, WT ;
Jones, TR ;
Pasztor, EC .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2002, 22 (02) :56-65
[9]   Image Super-Resolution With Sparse Neighbor Embedding [J].
Gao, Xinbo ;
Zhang, Kaibing ;
Tao, Dacheng ;
Li, Xuelong .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (07) :3194-3205
[10]  
Glasner D, 2009, IEEE I CONF COMP VIS, P349, DOI 10.1109/ICCV.2009.5459271