Hyperspectral Snapshot Compressive Imaging with Non-Local Spatial-Spectral Residual Network

被引:5
作者
Yang, Ying [1 ]
Xie, Yong [2 ]
Chen, Xunhao [1 ]
Sun, Yubao [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Jiangsu Key Lab Big Data Anal Technol, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Geog Sci, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金;
关键词
hyperspectral image; coded aperture snapshot spectral imaging; deep network; non-local spatial-spectral attention; compound loss; SPARSE;
D O I
10.3390/rs13091812
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Snapshot Compressive Imaging is an emerging technology that is based on compressive sensing theory to achieve high-efficiency hyperspectral data acquisition. The core problem of this technology is how to reconstruct 3D hyperspectral data from the 2D snapshot measurement in a fast and high-quality manner. In this paper, we propose a novel deep network, which consists of the symmetric residual module and the non-local spatial-spectral attention module, to learn the reconstruction mapping in a data-driven way. The symmetric residual module uses symmetric residual connections to improve the potential of interaction between convolution operations and further promotes the fusion of local features. The non-local spatial-spectral attention module is designed to capture the non-local spatial-spectral correlation in the hyperspectral image. Specifically, this module calculates the channel attention matrix to capture the global correlations between all of the spectral channels, and it fuses the channel attention attained feature maps and the spatial attention weighted features as the module output, thus both of the spatial-spectral correlations of hyperspectral images can be fully utilized for reconstruction. In addition, a compound loss, including the reconstruction loss, the measurement loss, and the cosine loss, is designed to guide the end-to-end network learning. We experimentally evaluate the proposed method on simulation and real datasets. The experimental results show that the proposed network outperforms the competing methods in terms of the reconstruction quality and running time.
引用
收藏
页数:18
相关论文
共 50 条
[41]   Adaptive Spatial-Spectral Dictionary Learning for Hyperspectral Image Restoration [J].
Fu, Ying ;
Lam, Antony ;
Sato, Imari ;
Sato, Yoichi .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2017, 122 (02) :228-245
[42]   LR-Net: Low-Rank Spatial-Spectral Network for Hyperspectral Image Denoising [J].
Zhang, Hongyan ;
Chen, Hongyu ;
Yang, Guangyi ;
Zhang, Liangpei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :8743-8758
[43]   A Fast Spatial-Spectral Preprocessing Module for Hyperspectral Endmember Extraction [J].
Kowkabi, Fatemeh ;
Ghassemian, Hassan ;
Keshavarz, Ahmad .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2016, 13 (06) :782-786
[44]   Matrix Cofactorization for Joint Spatial-Spectral Unmixing of Hyperspectral Images [J].
Lagrange, Adrien ;
Fauvel, Mathieu ;
May, Stephane ;
Dobigeon, Nicolas .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (07) :4915-4927
[45]   DISCRIMINANT SPATIAL-SPECTRAL HYPERGRAPH LEARNING FOR HYPERSPECTRAL IMAGE CLASSIFICATION [J].
Luo, Fulin ;
Zhang, Liangpei ;
Du, Bo ;
Zhang, Lefei ;
Dong, Yanni .
IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, :8480-8483
[46]   A Multiobjective Method Leveraging Spatial-Spectral Relationship for Hyperspectral Unmixing [J].
Liu, Erfeng ;
Wu, Zikai ;
Zhang, Hongjuan .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[47]   Spatial-spectral segmentation of hyperspectral images for subpixel target detection [J].
Liang, Yilong ;
Markopoulos, Panos P. ;
Saber, Eli .
JOURNAL OF APPLIED REMOTE SENSING, 2019, 13 (03)
[48]   Deep Convolutional Network Aided by Non-Local Method for Hyperspectral Image Denoising [J].
De Oliveira, Gabriel A. ;
De Almeida, Larissa Medeiros ;
De Lima, Eduardo R. ;
Meloni, Luis Geraldo P. .
IEEE ACCESS, 2023, 11 :45233-45242
[49]   Spatial-Spectral Sparse Unmixing for Hyperspectral Imagery based on Graph Laplacian [J].
Gan Yuquan ;
Li Lei ;
Zhang Ji ;
Liu Ying .
AOPC 2021: OPTICAL SPECTROSCOPY AND IMAGING, 2021, 12064
[50]   Hyperspectral Object Detection Based on Spatial-Spectral Fusion and Visual Mamba [J].
Li, Wenjun ;
Yuan, Fuqiang ;
Zhang, Hongkun ;
Lv, Zhiwen ;
Wu, Beiqi .
REMOTE SENSING, 2024, 16 (23)