Super-Resolution for Hyperspectral Remote Sensing Images Based on the 3D Attention-SRGAN Network

被引:31
作者
Dou, Xinyu [1 ]
Li, Chenyu [1 ]
Shi, Qian [1 ]
Liu, Mengxi [1 ]
机构
[1] Sun Yat Sen Univ, Sch Geog & Planning, Guangdong Key Lab Urbanizat & Geoslimulat, Guangzhou 510275, Peoples R China
基金
中国国家自然科学基金;
关键词
hyperspectral image; 3D convolution; generative adversarial networks; super-resolution; spectral angle;
D O I
10.3390/rs12071204
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Hyperspectral remote sensing images (HSIs) have a higher spectral resolution compared to multispectral remote sensing images, providing the possibility for more reasonable and effective analysis and processing of spectral data. However, rich spectral information usually comes at the expense of low spatial resolution owing to the physical limitations of sensors, which brings difficulties for identifying and analyzing targets in HSIs. In the super-resolution (SR) field, many methods have been focusing on the restoration of the spatial information while ignoring the spectral aspect. To better restore the spectral information in the HSI SR field, a novel super-resolution (SR) method was proposed in this study. Firstly, we innovatively used three-dimensional (3D) convolution based on SRGAN (Super-Resolution Generative Adversarial Network) structure to not only exploit the spatial features but also preserve spectral properties in the process of SR. Moreover, we used the attention mechanism to deal with the multiply features from the 3D convolution layers, and we enhanced the output of our model by improving the content of the generator's loss function. The experimental results indicate that the 3DASRGAN (3D Attention-based Super-Resolution Generative Adversarial Network) is both visually quantitatively better than the comparison methods, which proves that the 3DASRGAN model can reconstruct high-resolution HSIs with high efficiency.
引用
收藏
页数:26
相关论文
共 34 条
  • [1] Akhtar N, 2015, PROC CVPR IEEE, P3631, DOI 10.1109/CVPR.2015.7298986
  • [2] Arjovsky M., 2017, ARXIV170107875
  • [3] A review on spectral processing methods for geological remote sensing
    Asadzadeh, Saeid
    de Souza Filho, Carlos Roberto
    [J]. INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2016, 47 : 69 - 90
  • [4] Bock S., 2018, An improvement of the convergence proof of the adam-optimizer
  • [5] Blind image fusion for hyperspectral imaging with the directional total variation
    Bungert, Leon
    Coomes, David A.
    Ehrhardt, Matthias J.
    Rasch, Jennifer
    Reisenhofer, Rafael
    Schonlieb, Carola-Bibiane
    [J]. INVERSE PROBLEMS, 2018, 34 (04)
  • [6] Accelerating the Super-Resolution Convolutional Neural Network
    Dong, Chao
    Loy, Chen Change
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 391 - 407
  • [7] Image Super-Resolution Using Deep Convolutional Networks
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) : 295 - 307
  • [8] Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
  • [9] Han XH, 2018, IEEE IMAGE PROC, P2506, DOI 10.1109/ICIP.2018.8451142
  • [10] Kawakami R, 2011, PROC CVPR IEEE