Hyperspectral Snapshot Compressive Imaging with Non-Local Spatial-Spectral Residual Network

被引:5
作者
Yang, Ying [1 ]
Xie, Yong [2 ]
Chen, Xunhao [1 ]
Sun, Yubao [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Jiangsu Key Lab Big Data Anal Technol, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Geog Sci, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金;
关键词
hyperspectral image; coded aperture snapshot spectral imaging; deep network; non-local spatial-spectral attention; compound loss; SPARSE;
D O I
10.3390/rs13091812
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Snapshot Compressive Imaging is an emerging technology that is based on compressive sensing theory to achieve high-efficiency hyperspectral data acquisition. The core problem of this technology is how to reconstruct 3D hyperspectral data from the 2D snapshot measurement in a fast and high-quality manner. In this paper, we propose a novel deep network, which consists of the symmetric residual module and the non-local spatial-spectral attention module, to learn the reconstruction mapping in a data-driven way. The symmetric residual module uses symmetric residual connections to improve the potential of interaction between convolution operations and further promotes the fusion of local features. The non-local spatial-spectral attention module is designed to capture the non-local spatial-spectral correlation in the hyperspectral image. Specifically, this module calculates the channel attention matrix to capture the global correlations between all of the spectral channels, and it fuses the channel attention attained feature maps and the spatial attention weighted features as the module output, thus both of the spatial-spectral correlations of hyperspectral images can be fully utilized for reconstruction. In addition, a compound loss, including the reconstruction loss, the measurement loss, and the cosine loss, is designed to guide the end-to-end network learning. We experimentally evaluate the proposed method on simulation and real datasets. The experimental results show that the proposed network outperforms the competing methods in terms of the reconstruction quality and running time.
引用
收藏
页数:18
相关论文
共 50 条
  • [21] Spectral Super-Resolution of Multispectral Images Using Spatial-Spectral Residual Attention Network
    Zheng, Xiangtao
    Chen, Wenjing
    Lu, Xiaoqiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [22] Hyperspectral Imagery Super-Resolution by Compressive Sensing Inspired Dictionary Learning and Spatial-Spectral Regularization
    Huang, Wei
    Xiao, Liang
    Liu, Hongyi
    Wei, Zhihui
    SENSORS, 2015, 15 (01) : 2041 - 2058
  • [23] Spatial-spectral separable convolutional neural network for cell classification of hyperspectral microscopic images
    Shi X.
    Li Y.
    Huang H.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2022, 30 (08): : 960 - 969
  • [24] Hyperspectral Image Super-Resolution Based on Spatial-Spectral Feature Extraction Network
    Li Yanshan
    Chen Shifu
    Luo Wenhan
    Zhou Li
    Xie Weixin
    CHINESE JOURNAL OF ELECTRONICS, 2023, 32 (03) : 415 - 428
  • [25] HGF Spatial-Spectral Fusion Method for Hyperspectral Images
    Fu, Pingjie
    Zhang, Yuxuan
    Meng, Fei
    Zhang, Wei
    Zhang, Banghua
    APPLIED SCIENCES-BASEL, 2023, 13 (01):
  • [26] A Spatial-Spectral Combination Method for Hyperspectral Band Selection
    Han, Xizhen
    Jiang, Zhengang
    Liu, Yuanyuan
    Zhao, Jian
    Sun, Qiang
    Li, Yingzhi
    REMOTE SENSING, 2022, 14 (13)
  • [27] SSF-Net: A Spatial-Spectral Features Integrated Autoencoder Network for Hyperspectral Unmixing
    Wang, Bin
    Yao, Huizheng
    Song, Dongmei
    Zhang, Jie
    Gao, Han
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 1781 - 1794
  • [28] Hyperspectral Target Detection via Global Spatial-Spectral Attention Network and Background Suppression
    Wang, Xiaoyi
    Wang, Liguo
    Wang, Qunming
    Vizziello, Anna
    Gamba, Paolo
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 9011 - 9024
  • [29] Hyperspectral image classification based on three branch network with grouped spatial-spectral attention
    Su H.
    Chen N.
    Peng J.
    Sun W.
    National Remote Sensing Bulletin, 2024, 28 (01) : 247 - 265
  • [30] Deep Spectral Spatial Inverted Residual Network for Hyperspectral Image Classification
    Zhang, Tianyu
    Shi, Cuiping
    Liao, Diling
    Wang, Liguo
    REMOTE SENSING, 2021, 13 (21)