Super-Resolution-Guided Progressive Pansharpening Based on a Deep Convolutional Neural Network

被引:97
|
作者
Cai, Jiajun [1 ]
Huang, Bo [1 ]
机构
[1] Chinese Univ Hong Kong, Dept Geog & Resource Management, Hong Kong, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2021年 / 59卷 / 06期
关键词
Spatial resolution; Remote sensing; Neural networks; Dictionaries; Transforms; Deep learning; multispectral (MS) image; panchromatic image; pansharpening; super-resolution (SR); PAN-SHARPENING METHOD; IMAGE FUSION; QUALITY;
D O I
10.1109/TGRS.2020.3015878
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Pansharpening and super-resolution (SR) methods share the same target to improve the spatial resolution of images. Based on this similarity, we propose and develop a novel pansharpening algorithm that is guided by a deep SR convolutional neural network. The proposed framework comprises three components: an SR process, a progressive pansharpening process, and a high-pass residual module. Specifically, the SR process extracts inner spatial detail that is present in multispectral images. Then, progressive pansharpening is used as a detailed pansharpening process, and the high-pass residual module helps by directly injecting spatial detail from panchromatic images. The performance of the proposed network has been compared with that of traditional and other deep-learning-based pansharpening algorithms based on QuickBird, WorldView-3, and Landsat-8 data, and the results demonstrate the superiority of our algorithm.
引用
收藏
页码:5206 / 5220
页数:15
相关论文
共 50 条
  • [41] Color-guided depth map super resolution using joint convolutional neural network
    Zhang, Ziyue
    Jin, Weiqi
    Li, Yingjie
    AOPC 2020: DISPLAY TECHNOLOGY; PHOTONIC MEMS, THZ MEMS, AND METAMATERIALS; AND AI IN OPTICS AND PHOTONICS, 2020, 11565
  • [42] Video super-resolution reconstruction based on deep convolutional neural network and spatio-temporal similarity
    Li Linghui
    Du Junping
    Liang Meiyu
    Ren Nan
    Fan Dan
    The Journal of China Universities of Posts and Telecommunications, 2016, 23 (05) : 68 - 81
  • [43] Video super-resolution reconstruction based on deep convolutional neural network and spatio-temporal similarity
    Li Linghui
    Du Junping
    Liang Meiyu
    Ren Nan
    Fan Dan
    The Journal of China Universities of Posts and Telecommunications, 2016, (05) : 68 - 81
  • [44] An effective super resolution image reconstruction using spatial entropy based normalized deep convolutional neural network
    Ramya, R.
    Senthilmurugan, M.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (13) : 18737 - 18753
  • [45] An effective super resolution image reconstruction using spatial entropy based normalized deep convolutional neural network
    R. Ramya
    M. Senthilmurugan
    Multimedia Tools and Applications, 2022, 81 : 18737 - 18753
  • [46] License Plate Image Super-Resolution Based on Convolutional Neural Network
    Yang, Yang
    Bi, Ping
    Liu, Ying
    2018 IEEE 3RD INTERNATIONAL CONFERENCE ON IMAGE, VISION AND COMPUTING (ICIVC), 2018, : 723 - 727
  • [47] Super Resolution Algorithm of Color RGB Image Based on Convolutional Neural Network
    Pan, Chao
    Ren, Zhengwei
    Zhang, Jiehui
    JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS, 2021, 11 (04) : 1188 - 1194
  • [48] Image Super-resolution Reconstruction Algorithm Based on Convolutional Neural Network
    He Jingxuan
    Zhang Jian
    Zhang Yonghui
    Wang Rong
    PROCEEDINGS OF 2018 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION, ELECTRONICS AND ELECTRICAL ENGINEERING (AUTEEE), 2018, : 267 - 271
  • [49] A SUPER-RESOLUTION LATTICE BOLTZMANN METHOD BASED ON CONVOLUTIONAL NEURAL NETWORK
    Luo, Renyu
    Li, Qizhi
    Zu, Gongbo
    Huang, Yunjin
    Yang, Gengchao
    Yao, Qinghe
    Lixue Xuebao/Chinese Journal of Theoretical and Applied Mechanics, 2024, 56 (12): : 3612 - 3624
  • [50] Detail Injection-Based Deep Convolutional Neural Networks for Pansharpening
    Deng, Liang-Jian
    Vivone, Gemine
    Jin, Cheng
    Chanussot, Jocelyn
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (08): : 6995 - 7010