Hyperspectral Snapshot Compressive Imaging with Non-Local Spatial-Spectral Residual Network

被引:5
|
作者
Yang, Ying [1 ]
Xie, Yong [2 ]
Chen, Xunhao [1 ]
Sun, Yubao [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Jiangsu Key Lab Big Data Anal Technol, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Geog Sci, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金;
关键词
hyperspectral image; coded aperture snapshot spectral imaging; deep network; non-local spatial-spectral attention; compound loss; SPARSE;
D O I
10.3390/rs13091812
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Snapshot Compressive Imaging is an emerging technology that is based on compressive sensing theory to achieve high-efficiency hyperspectral data acquisition. The core problem of this technology is how to reconstruct 3D hyperspectral data from the 2D snapshot measurement in a fast and high-quality manner. In this paper, we propose a novel deep network, which consists of the symmetric residual module and the non-local spatial-spectral attention module, to learn the reconstruction mapping in a data-driven way. The symmetric residual module uses symmetric residual connections to improve the potential of interaction between convolution operations and further promotes the fusion of local features. The non-local spatial-spectral attention module is designed to capture the non-local spatial-spectral correlation in the hyperspectral image. Specifically, this module calculates the channel attention matrix to capture the global correlations between all of the spectral channels, and it fuses the channel attention attained feature maps and the spatial attention weighted features as the module output, thus both of the spatial-spectral correlations of hyperspectral images can be fully utilized for reconstruction. In addition, a compound loss, including the reconstruction loss, the measurement loss, and the cosine loss, is designed to guide the end-to-end network learning. We experimentally evaluate the proposed method on simulation and real datasets. The experimental results show that the proposed network outperforms the competing methods in terms of the reconstruction quality and running time.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Compressive hyperspectral imaging recovery by spatial-spectral non-local means regularization
    Meza, Pablo
    Ortiz, Ivan
    Vera, Esteban
    Martinez, Javier
    OPTICS EXPRESS, 2018, 26 (06): : 7043 - 7055
  • [2] Unsupervised Spatial-Spectral Network Learning for Hyperspectral Compressive Snapshot Reconstruction
    Sun, Yubao
    Yang, Ying
    Liu, Qingshan
    Kankanhalli, Mohan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [3] Spatial-spectral Encoded Compressive Hyperspectral Imaging
    Lin, Xing
    Liu, Yebin
    Wu, Jiamin
    Dai, Qionghai
    ACM TRANSACTIONS ON GRAPHICS, 2014, 33 (06):
  • [4] Compressive Hyperspectral Image Reconstruction Based on Spatial-Spectral Residual Dense Network
    Huang, Wei
    Xu, Yang
    Hu, Xiaowei
    Wei, Zhihui
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (05) : 884 - 888
  • [5] Spatial-spectral modulating snapshot hyperspectral imager
    Johnson, WR
    Wilson, DW
    Bearman, G
    APPLIED OPTICS, 2006, 45 (09) : 1898 - 1908
  • [6] Spatial-spectral Compressive Sensing of Hyperspectral Image
    Wang, Zhongliang
    Feng, Yan
    Jia, Yinbiao
    2013 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY (ICIST), 2013, : 1256 - 1259
  • [7] SPATIAL-SPECTRAL HYPERSPECTRAL IMAGE COMPRESSIVE SENSING
    Martin, Gabriel
    Bioucas-Dias, Jose M.
    2017 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2017, : 3988 - 3991
  • [8] Spatial-Spectral Split Attention Residual Network for Hyperspectral Image Classification
    Shu, Zhenqiu
    Liu, Zigao
    Zhou, Jun
    Tang, Songze
    Yu, Zhengtao
    Wu, Xiao-Jun
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 419 - 430
  • [9] Spectral Memory-Enhanced Network With Local Non-Local and Low-Rank Priors for Hyperspectral Image Compressive Imaging
    Ying, Yangke
    Wang, Jin
    Shi, Yunhui
    Ling, Nam
    Yin, Baocai
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2024, 10 : 1664 - 1679
  • [10] NON-LOCAL COMPRESSIVE NETWORK FOR HYPERSPECTRAL AND MULTISPECTRAL DATA FUSION
    Hao, Junbo
    Wang, Ying
    Li, Jie
    Gao, Xinbo
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 3384 - 3387