Progressive Content-Aware Coded Hyperspectral Snapshot Compressive Imaging

被引:4
作者
Zhang, Xuanyu [1 ]
Chen, Bin [1 ]
Zou, Wenzhen [2 ]
Liu, Shuai [3 ]
Zhang, Yongbing [2 ]
Xiong, Ruiqin [4 ]
Zhang, Jian [1 ]
机构
[1] Peking Univ, Sch Elect & Comp Engn, Shenzhen 518055, Peoples R China
[2] Harbin Inst Technol Shenzhen, Sch Comp Sci & Technol, Shenzhen 518055, Peoples R China
[3] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R China
[4] Peking Univ, Sch Comp Sci, Beijing 100871, Peoples R China
基金
中国国家自然科学基金;
关键词
Spectral snapshot compressive imaging; deep unfolding; progressive content-aware sampling; ALGORITHMS; RECOVERY; DESIGN; TENSOR;
D O I
10.1109/TCSVT.2024.3409421
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Hyperspectral imaging plays a pivotal role across diverse applications, like remote sensing, medicine, and cytology. The utilization of 2D sensors to acquire 3D hyperspectral images (HSIs) via a coded aperture snapshot spectral imaging (CASSI) system has proven successful, owing to its hardware-friendly implementation and fast sampling speed. Nevertheless, for less spectrally sparse scenes, the use of a single snapshot and unreasonable coded aperture design limits the efficacy of CASSI systems and renders HSI reconstruction more ill-posed, leading to compromised spatial and spectral fidelity. This paper proposes a novel Progressive Content-Aware CASSI (PCA-CASSI) framework, which progressively captures HSIs using multiple optimized content-aware coded apertures and fuses all snapshot measurements for reconstruction. By unlocking the full potential of CASSI systems and elevating their performance ceilings, this framework offers researchers new avenues for improving imaging quality. Furthermore, we develop the RndHRNet, a Range-Null space Decomposition (RND)-inspired deep unfolding network with multiple iterative phases for HSI recovery. Each unfolded recovery phase efficiently exploits the physical information within the coded apertures via explicit RND and adaptively explores the spatial-spectral correlation by dual transformer blocks. Through comprehensive experiments, our approach demonstrates superior performance compared to existing state-of-the-art methods in both the multiple- and single-shot compressive HSI imaging tasks with substantial improvements. Code is available at https://github.com/xuanyuzhang21/PCA-CASSI.
引用
收藏
页码:10817 / 10830
页数:14
相关论文
共 65 条
[1]   A new TwIST: Two-step iterative shrinkage/thresholding algorithms for image restoration [J].
Bioucas-Dias, Jose M. ;
Figueiredo, Mario A. T. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (12) :2992-3004
[2]   Hyperspectral Remote Sensing Data Analysis and Future Challenges [J].
Bioucas-Dias, Jose M. ;
Plaza, Antonio ;
Camps-Valls, Gustavo ;
Scheunders, Paul ;
Nasrabadi, Nasser M. ;
Chanussot, Jocelyn .
IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2013, 1 (02) :6-36
[3]   Microscopic imaging techniques for drug discovery [J].
Bullen, Andrew .
NATURE REVIEWS DRUG DISCOVERY, 2008, 7 (01) :54-67
[4]  
Cai Y., 2022, P ADV NEUR INF PROC, V35, P37749
[5]   Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstruction [J].
Cai, Yuanhao ;
Lin, Jing ;
Hu, Xiaowan ;
Wang, Haoqian ;
Yuan, Xin ;
Zhang, Yulun ;
Timofte, Radu ;
Van Gool, Luc .
COMPUTER VISION - ECCV 2022, PT XVII, 2022, 13677 :686-704
[6]   Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstruction [J].
Cai, Yuanhao ;
Lin, Jing ;
Hu, Xiaowan ;
Wang, Haoqian ;
Yuan, Xin ;
Zhang, Yulun ;
Timofte, Radu ;
Van Gool, Luc .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :17481-17490
[7]   MST plus plus : Multi-stage Spectral-wise Transformer for Efficient Spectral Reconstruction [J].
Cai, Yuanhao ;
Lin, Jing ;
Lin, Zudi ;
Wang, Haoqian ;
Zhang, Yulun ;
Pfister, Hanspeter ;
Timofte, Radu ;
Van Gool, Luc .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, :744-754
[8]   Content-Aware Scalable Deep Compressed Sensing [J].
Chen, Bin ;
Zhang, Jian .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :5412-5426
[9]   Equivariant Imaging: Learning Beyond the Range Space [J].
Chen, Dongdong ;
Tachella, Julian ;
Davies, Mike E. .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :4359-4368
[10]   Deep Decomposition Learning for Inverse Imaging Problems [J].
Chen, Dongdong ;
Davies, Mike E. .
COMPUTER VISION - ECCV 2020, PT XXVIII, 2020, 12373 :510-526