Progressive Content-Aware Coded Hyperspectral Snapshot Compressive Imaging

被引:0
|
作者
Zhang, Xuanyu [1 ]
Chen, Bin [1 ]
Zou, Wenzhen [2 ]
Liu, Shuai [3 ]
Zhang, Yongbing [2 ]
Xiong, Ruiqin [4 ]
Zhang, Jian [1 ]
机构
[1] Peking Univ, Sch Elect & Comp Engn, Shenzhen 518055, Peoples R China
[2] Harbin Inst Technol Shenzhen, Sch Comp Sci & Technol, Shenzhen 518055, Peoples R China
[3] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R China
[4] Peking Univ, Sch Comp Sci, Beijing 100871, Peoples R China
基金
中国国家自然科学基金;
关键词
Spectral snapshot compressive imaging; deep unfolding; progressive content-aware sampling; ALGORITHMS; RECOVERY; DESIGN; TENSOR;
D O I
10.1109/TCSVT.2024.3409421
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Hyperspectral imaging plays a pivotal role across diverse applications, like remote sensing, medicine, and cytology. The utilization of 2D sensors to acquire 3D hyperspectral images (HSIs) via a coded aperture snapshot spectral imaging (CASSI) system has proven successful, owing to its hardware-friendly implementation and fast sampling speed. Nevertheless, for less spectrally sparse scenes, the use of a single snapshot and unreasonable coded aperture design limits the efficacy of CASSI systems and renders HSI reconstruction more ill-posed, leading to compromised spatial and spectral fidelity. This paper proposes a novel Progressive Content-Aware CASSI (PCA-CASSI) framework, which progressively captures HSIs using multiple optimized content-aware coded apertures and fuses all snapshot measurements for reconstruction. By unlocking the full potential of CASSI systems and elevating their performance ceilings, this framework offers researchers new avenues for improving imaging quality. Furthermore, we develop the RndHRNet, a Range-Null space Decomposition (RND)-inspired deep unfolding network with multiple iterative phases for HSI recovery. Each unfolded recovery phase efficiently exploits the physical information within the coded apertures via explicit RND and adaptively explores the spatial-spectral correlation by dual transformer blocks. Through comprehensive experiments, our approach demonstrates superior performance compared to existing state-of-the-art methods in both the multiple- and single-shot compressive HSI imaging tasks with substantial improvements. Code is available at https://github.com/xuanyuzhang21/PCA-CASSI.
引用
收藏
页码:10817 / 10830
页数:14
相关论文
共 50 条
  • [1] Coded Hyperspectral Imaging and Blind Compressive Sensing
    Rajwade, A
    Kittle, D
    Tsai, TH
    Brady, D
    Carin, L
    SIAM JOURNAL ON IMAGING SCIENCES, 2013, 6 (02): : 782 - 812
  • [2] HerosNet: Hyperspectral Explicable Reconstruction and Optimal Sampling Deep Network for Snapshot Compressive Imaging
    Zhang, Xuanyu
    Zhang, Yongbing
    Xiong, Ruiqin
    Sun, Qilin
    Zhang, Jian
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 17511 - 17520
  • [3] Snapshot compressive hyperspectral imaging via dual spectral filter array
    Zhang, Yang
    Liu, Xinyu
    Wang, Chang
    Xu, Zhou
    Zhang, Qiangbo
    Zheng, Zhenrong
    OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY IX, 2022, 12317
  • [4] Snapshot compressive spectral imaging based on adaptive coded apertures
    Ma, Xu
    Zhang, Hao
    Ma, Xiao
    Arce, Gonzalo R.
    Xu, Tingfa
    Mao, Tianyi
    COMPRESSIVE SENSING VII: FROM DIVERSE MODALITIES TO BIG DATA ANALYTICS, 2018, 10658
  • [5] Ten-mega-pixel snapshot compressive imaging with a hybrid coded aperture
    Zhang, Zhihong
    Deng, Chao
    Liu, Yang
    Yuan, Xin
    Suo, Jinli
    Dai, Qionghai
    PHOTONICS RESEARCH, 2021, 9 (11) : 2277 - 2287
  • [6] Compressive hyperspectral microscopic imaging using spectral-coded illumination
    Yang, Ting
    Xu, Zhilong
    Ren, Wenyi
    Feng, Yang
    Wu, Dan
    Zhang, Rui
    Xie, Yingge
    OPTICS AND LASER TECHNOLOGY, 2023, 166
  • [7] Rank Minimization for Snapshot Compressive Imaging
    Liu, Yang
    Yuan, Xin
    Suo, Jinli
    Brady, David J.
    Dai, Qionghai
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (12) : 2990 - 3006
  • [8] Hybrid Multi-Dimensional Attention U-Net for Hyperspectral Snapshot Compressive Imaging Reconstruction
    Zheng, Siming
    Zhu, Mingyu
    Chen, Mingliang
    ENTROPY, 2023, 25 (04)
  • [9] HyperReconNet: Joint Coded Aperture Optimization and Image Reconstruction for Compressive Hyperspectral Imaging
    Wang, Lizhi
    Zhang, Tao
    Fu, Ying
    Huang, Hua
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (05) : 2257 - 2270
  • [10] Snapshot Multiplexed Imaging Based on Compressive Sensing
    Fu, Ying
    Sun, Chen
    Wang, Lizhi
    Huang, Hua
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2018, PT II, 2018, 11165 : 465 - 475