Modified SSR-NET: A Shallow Convolutional Neural Network for Efficient Hyperspectral Image Super-Resolution

被引:1
|
作者
Avagyan, Shushik [1 ]
Katkovnik, Vladimir [1 ]
Egiazarian, Karen [1 ]
机构
[1] Tampere Univ, Fac Informat Technol & Commun Sci, Computat Imaging Grp, Tampere, Finland
来源
关键词
image fusion; remote sensing; hyperspectral imaging; multispectral imaging; spectral reconstruction; super-resolution; SPARSE; REPRESENTATION; DECOMPOSITION; FUSION;
D O I
10.3389/frsen.2022.889915
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
A fast and shallow convolutional neural network is proposed for hyperspectral image super-resolution inspired by Spatial-Spectral Reconstruction Network (SSR-NET). The feature extraction ability is improved compared to SSR-NET and other state-of-the-art methods, while the proposed network is also shallow. Numerical experiments show both the visual and quantitative superiority of our method. Specifically, for the fusion setup with two inputs, obtained by 32x spatial downsampling for the low-resolution hyperspectral (LR HSI) input and 25x spectral downsampling for high-resolution multispectral (HR MSI) input, a significant improvement of the quality of super-resolved HR HSI over 4 dB is demonstrated as compared with SSR-NET. It is also shown that, in some cases, our method with a single input, HR MSI, can provide a comparable result with that achieved with two inputs, HR MSI and LR HSI.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Diffused Convolutional Neural Network for Hyperspectral Image Super-Resolution
    Jia, Sen
    Zhu, Shuangzhao
    Wang, Zhihao
    Xu, Meng
    Wang, Weixi
    Guo, Yujuan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [2] HYPERSPECTRAL IMAGE SUPER-RESOLUTION VIA CONVOLUTIONAL NEURAL NETWORK
    Mei, Shaohui
    Yuan, Xin
    Ji, Jingyu
    Wan, Shuai
    Hou, Junhui
    Du, Qian
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 4297 - 4301
  • [3] Deep Residual Convolutional Neural Network for Hyperspectral Image Super-Resolution
    Wang, Chen
    Liu, Yun
    Bai, Xiao
    Tang, Wenzhong
    Lei, Peng
    Zhou, Jun
    IMAGE AND GRAPHICS (ICIG 2017), PT III, 2017, 10668 : 370 - 380
  • [4] Hyperspectral image super-resolution using deep convolutional neural network
    Li, Yunsong
    Hu, Jing
    Zhao, Xi
    Xie, Weiying
    Li, JiaoJiao
    NEUROCOMPUTING, 2017, 266 : 29 - 41
  • [5] SSR-NET: SpatialSpectral Reconstruction Network for Hyperspectral and Multispectral Image Fusion
    Zhang, Xueting
    Huang, Wei
    Wang, Qi
    Li, Xuelong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (07): : 5953 - 5965
  • [6] HYPERSPECTRAL SUPER-RESOLUTION BY UNSUPERVISED CONVOLUTIONAL NEURAL NETWORK AND SURE
    Nguyen, Han V.
    Ulfarsson, Magnus O.
    Sveinsson, Johannes R.
    Mura, Mauro Dalla
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 903 - 906
  • [7] Image Fusion and Super-Resolution with Convolutional Neural Network
    Zhong, Jinying
    Yang, Bin
    Li, Yuehua
    Zhong, Fei
    Chen, Zhongze
    PATTERN RECOGNITION (CCPR 2016), PT II, 2016, 663 : 78 - 88
  • [8] Image Super-Resolution With Deep Convolutional Neural Network
    Ji, Xiancai
    Lu, Yao
    Guo, Li
    2016 IEEE FIRST INTERNATIONAL CONFERENCE ON DATA SCIENCE IN CYBERSPACE (DSC 2016), 2016, : 626 - 630
  • [9] Convolutional Neural Network for Smoke Image Super-Resolution
    Liu, Maoshen
    Gu, Ke
    Qiao, Junfei
    PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND APPLICATION ENGINEERING (CSAE2018), 2018,
  • [10] MobileSR: Efficient Convolutional Neural Network for Super-resolution
    Zhang, Lulu
    Li, HuiYong
    Liu, Xuefeng
    Niu, Jianwei
    Wu, Jiyan
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,