Super-Resolution-Guided Progressive Pansharpening Based on a Deep Convolutional Neural Network

被引:97
|
作者
Cai, Jiajun [1 ]
Huang, Bo [1 ]
机构
[1] Chinese Univ Hong Kong, Dept Geog & Resource Management, Hong Kong, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2021年 / 59卷 / 06期
关键词
Spatial resolution; Remote sensing; Neural networks; Dictionaries; Transforms; Deep learning; multispectral (MS) image; panchromatic image; pansharpening; super-resolution (SR); PAN-SHARPENING METHOD; IMAGE FUSION; QUALITY;
D O I
10.1109/TGRS.2020.3015878
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Pansharpening and super-resolution (SR) methods share the same target to improve the spatial resolution of images. Based on this similarity, we propose and develop a novel pansharpening algorithm that is guided by a deep SR convolutional neural network. The proposed framework comprises three components: an SR process, a progressive pansharpening process, and a high-pass residual module. Specifically, the SR process extracts inner spatial detail that is present in multispectral images. Then, progressive pansharpening is used as a detailed pansharpening process, and the high-pass residual module helps by directly injecting spatial detail from panchromatic images. The performance of the proposed network has been compared with that of traditional and other deep-learning-based pansharpening algorithms based on QuickBird, WorldView-3, and Landsat-8 data, and the results demonstrate the superiority of our algorithm.
引用
收藏
页码:5206 / 5220
页数:15
相关论文
共 50 条
  • [1] DEEP PROGRESSIVE CONVOLUTIONAL NEURAL NETWORK FOR BLIND SUPER-RESOLUTION WITH MULTIPLE DEGRADATIONS
    Xiao, Jun
    Zhao, Rui
    Lai, Shun-Cheung
    Jia, Wenqi
    Lam, Kin-Man
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2856 - 2860
  • [2] Terahertz image super-resolution based on a deep convolutional neural network
    Long, Zhenyu
    Wang, Tianyi
    You, Chengwu
    Yang, Zhengang
    Wang, Kejia
    Liu, Jinsong
    APPLIED OPTICS, 2019, 58 (10) : 2731 - 2735
  • [3] Radar Super Resolution Using a Deep Convolutional Neural Network
    Geiss, Andrew
    Hardin, Joseph C.
    JOURNAL OF ATMOSPHERIC AND OCEANIC TECHNOLOGY, 2020, 37 (12) : 2197 - 2207
  • [4] Image Super-Resolution With Deep Convolutional Neural Network
    Ji, Xiancai
    Lu, Yao
    Guo, Li
    2016 IEEE FIRST INTERNATIONAL CONFERENCE ON DATA SCIENCE IN CYBERSPACE (DSC 2016), 2016, : 626 - 630
  • [5] Deep primitive convolutional neural network for image super resolution
    Greeshma, M. S. M.
    Bindu, V. R. V.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (1) : 253 - 278
  • [6] Deep primitive convolutional neural network for image super resolution
    Greeshma M. S.
    Bindu V. R.
    Multimedia Tools and Applications, 2024, 83 : 253 - 278
  • [7] CONVOLUTIONAL NEURAL NETWORK BASED DEM SUPER RESOLUTION
    Chen, Zixuan
    Wang, Xuewen
    Xu, Zekai
    Hou, Wenguang
    XXIII ISPRS CONGRESS, COMMISSION III, 2016, 41 (B3): : 247 - 250
  • [8] Progressive Spatial Information-Guided Deep Aggregation Convolutional Network for Hyperspectral Spectral Super-Resolution
    Li, Jiaojiao
    Du, Songcheng
    Song, Rui
    Li, Yunsong
    Du, Qian
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (01) : 1677 - 1691
  • [9] Satellite image super-resolution based on progressive residual deep neural network
    Zhang, Junwei
    Liu, Shigang
    Peng, Yali
    Li, Jun
    JOURNAL OF APPLIED REMOTE SENSING, 2020, 14 (03)
  • [10] A Deep Convolutional Neural Network with Selection Units for Super-Resolution
    Choi, Jae-Seok
    Kim, Munchurl
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1150 - 1156