Modified SSR-NET: A Shallow Convolutional Neural Network for Efficient Hyperspectral Image Super-Resolution

被引:1
|
作者
Avagyan, Shushik [1 ]
Katkovnik, Vladimir [1 ]
Egiazarian, Karen [1 ]
机构
[1] Tampere Univ, Fac Informat Technol & Commun Sci, Computat Imaging Grp, Tampere, Finland
来源
FRONTIERS IN REMOTE SENSING | 2022年 / 3卷
关键词
image fusion; remote sensing; hyperspectral imaging; multispectral imaging; spectral reconstruction; super-resolution; SPARSE; REPRESENTATION; DECOMPOSITION; FUSION;
D O I
10.3389/frsen.2022.889915
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
A fast and shallow convolutional neural network is proposed for hyperspectral image super-resolution inspired by Spatial-Spectral Reconstruction Network (SSR-NET). The feature extraction ability is improved compared to SSR-NET and other state-of-the-art methods, while the proposed network is also shallow. Numerical experiments show both the visual and quantitative superiority of our method. Specifically, for the fusion setup with two inputs, obtained by 32x spatial downsampling for the low-resolution hyperspectral (LR HSI) input and 25x spectral downsampling for high-resolution multispectral (HR MSI) input, a significant improvement of the quality of super-resolved HR HSI over 4 dB is demonstrated as compared with SSR-NET. It is also shown that, in some cases, our method with a single input, HR MSI, can provide a comparable result with that achieved with two inputs, HR MSI and LR HSI.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Hyperspectral Image Super-Resolution via Deep Spatiospectral Attention Convolutional Neural Networks
    Hu, Jin-Fan
    Huang, Ting-Zhu
    Deng, Liang-Jian
    Jiang, Tai-Xiang
    Vivone, Gemine
    Chanussot, Jocelyn
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (12) : 7251 - 7265
  • [2] HYPERSPECTRAL IMAGE SUPER-RESOLUTION VIA CONVOLUTIONAL NEURAL NETWORK
    Mei, Shaohui
    Yuan, Xin
    Ji, Jingyu
    Wan, Shuai
    Hou, Junhui
    Du, Qian
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 4297 - 4301
  • [3] Diffused Convolutional Neural Network for Hyperspectral Image Super-Resolution
    Jia, Sen
    Zhu, Shuangzhao
    Wang, Zhihao
    Xu, Meng
    Wang, Weixi
    Guo, Yujuan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [4] Hyperspectral image super-resolution using deep convolutional neural network
    Li, Yunsong
    Hu, Jing
    Zhao, Xi
    Xie, Weiying
    Li, JiaoJiao
    NEUROCOMPUTING, 2017, 266 : 29 - 41
  • [5] SSR-NET: SpatialSpectral Reconstruction Network for Hyperspectral and Multispectral Image Fusion
    Zhang, Xueting
    Huang, Wei
    Wang, Qi
    Li, Xuelong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (07): : 5953 - 5965
  • [6] Image Fusion and Super-Resolution with Convolutional Neural Network
    Zhong, Jinying
    Yang, Bin
    Li, Yuehua
    Zhong, Fei
    Chen, Zhongze
    PATTERN RECOGNITION (CCPR 2016), PT II, 2016, 663 : 78 - 88
  • [7] HYPERSPECTRAL SUPER-RESOLUTION BY UNSUPERVISED CONVOLUTIONAL NEURAL NETWORK AND SURE
    Nguyen, Han V.
    Ulfarsson, Magnus O.
    Sveinsson, Johannes R.
    Mura, Mauro Dalla
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 903 - 906
  • [8] StructureColor Preserving Network for Hyperspectral Image Super-Resolution
    Pan, Bin
    Qu, Qiaoying
    Xu, Xia
    Shi, Zhenwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [9] Image Super-Resolution With Deep Convolutional Neural Network
    Ji, Xiancai
    Lu, Yao
    Guo, Li
    2016 IEEE FIRST INTERNATIONAL CONFERENCE ON DATA SCIENCE IN CYBERSPACE (DSC 2016), 2016, : 626 - 630
  • [10] Convolutional Neural Network for Smoke Image Super-Resolution
    Liu, Maoshen
    Gu, Ke
    Qiao, Junfei
    PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND APPLICATION ENGINEERING (CSAE2018), 2018,