Super-Resolution-Guided Progressive Pansharpening Based on a Deep Convolutional Neural Network

被引:116
作者
Cai, Jiajun [1 ]
Huang, Bo [1 ]
机构
[1] Chinese Univ Hong Kong, Dept Geog & Resource Management, Hong Kong, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2021年 / 59卷 / 06期
关键词
Spatial resolution; Remote sensing; Neural networks; Dictionaries; Transforms; Deep learning; multispectral (MS) image; panchromatic image; pansharpening; super-resolution (SR); PAN-SHARPENING METHOD; IMAGE FUSION; QUALITY;
D O I
10.1109/TGRS.2020.3015878
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Pansharpening and super-resolution (SR) methods share the same target to improve the spatial resolution of images. Based on this similarity, we propose and develop a novel pansharpening algorithm that is guided by a deep SR convolutional neural network. The proposed framework comprises three components: an SR process, a progressive pansharpening process, and a high-pass residual module. Specifically, the SR process extracts inner spatial detail that is present in multispectral images. Then, progressive pansharpening is used as a detailed pansharpening process, and the high-pass residual module helps by directly injecting spatial detail from panchromatic images. The performance of the proposed network has been compared with that of traditional and other deep-learning-based pansharpening algorithms based on QuickBird, WorldView-3, and Landsat-8 data, and the results demonstrate the superiority of our algorithm.
引用
收藏
页码:5206 / 5220
页数:15
相关论文
共 49 条
[1]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[2]   Using Satellite Remote Sensing to Study the Impact of Climate and Anthropogenic Changes in the Mesopotamian Marshlands, Iraq [J].
Albarakat, Reyadh ;
Lakshmi, Venkat ;
Tucker, Compton J. .
REMOTE SENSING, 2018, 10 (10)
[3]   Multispectral and panchromatic data fusion assessment without reference [J].
Alparone, Luciano ;
Alazzi, Bruno ;
Baronti, Stefano ;
Garzelli, Andrea ;
Nencini, Filippo ;
Selva, Massimo .
PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2008, 74 (02) :193-200
[4]   A Global Quality Measurement of Pan-Sharpened Multispectral Imagery [J].
Alparone, Luciano ;
Baronti, Stefano ;
Garzelli, Andrea ;
Nencini, Filippo .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2004, 1 (04) :313-317
[5]  
[Anonymous], 2015, TENSOR
[6]  
[Anonymous], 2015, ACS SYM SER
[7]   THE LAPLACIAN PYRAMID AS A COMPACT IMAGE CODE [J].
BURT, PJ ;
ADELSON, EH .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1983, 31 (04) :532-540
[8]  
CARPER WJ, 1990, PHOTOGRAMM ENG REM S, V56, P459
[9]   Summary of current radiometric calibration coefficients for Landsat MSS, TM, ETM+, and EO-1 ALI sensors [J].
Chander, Gyanesh ;
Markham, Brian L. ;
Helder, Dennis L. .
REMOTE SENSING OF ENVIRONMENT, 2009, 113 (05) :893-903
[10]  
CHAVEZ PS, 1989, PHOTOGRAMM ENG REM S, V55, P339