Progressive Content-Aware Coded Hyperspectral Snapshot Compressive Imaging

被引:4
作者
Zhang, Xuanyu [1 ]
Chen, Bin [1 ]
Zou, Wenzhen [2 ]
Liu, Shuai [3 ]
Zhang, Yongbing [2 ]
Xiong, Ruiqin [4 ]
Zhang, Jian [1 ]
机构
[1] Peking Univ, Sch Elect & Comp Engn, Shenzhen 518055, Peoples R China
[2] Harbin Inst Technol Shenzhen, Sch Comp Sci & Technol, Shenzhen 518055, Peoples R China
[3] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R China
[4] Peking Univ, Sch Comp Sci, Beijing 100871, Peoples R China
基金
中国国家自然科学基金;
关键词
Spectral snapshot compressive imaging; deep unfolding; progressive content-aware sampling; ALGORITHMS; RECOVERY; DESIGN; TENSOR;
D O I
10.1109/TCSVT.2024.3409421
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Hyperspectral imaging plays a pivotal role across diverse applications, like remote sensing, medicine, and cytology. The utilization of 2D sensors to acquire 3D hyperspectral images (HSIs) via a coded aperture snapshot spectral imaging (CASSI) system has proven successful, owing to its hardware-friendly implementation and fast sampling speed. Nevertheless, for less spectrally sparse scenes, the use of a single snapshot and unreasonable coded aperture design limits the efficacy of CASSI systems and renders HSI reconstruction more ill-posed, leading to compromised spatial and spectral fidelity. This paper proposes a novel Progressive Content-Aware CASSI (PCA-CASSI) framework, which progressively captures HSIs using multiple optimized content-aware coded apertures and fuses all snapshot measurements for reconstruction. By unlocking the full potential of CASSI systems and elevating their performance ceilings, this framework offers researchers new avenues for improving imaging quality. Furthermore, we develop the RndHRNet, a Range-Null space Decomposition (RND)-inspired deep unfolding network with multiple iterative phases for HSI recovery. Each unfolded recovery phase efficiently exploits the physical information within the coded apertures via explicit RND and adaptively explores the spatial-spectral correlation by dual transformer blocks. Through comprehensive experiments, our approach demonstrates superior performance compared to existing state-of-the-art methods in both the multiple- and single-shot compressive HSI imaging tasks with substantial improvements. Code is available at https://github.com/xuanyuzhang21/PCA-CASSI.
引用
收藏
页码:10817 / 10830
页数:14
相关论文
共 50 条
[21]   Content-Aware Retargeted Image Quality Assessment [J].
Zhang, Tingting ;
Yu, Ming ;
Guo, Yingchun ;
Liu, Yi .
INFORMATION, 2019, 10 (03)
[22]   Snapshot Hyperspectral Light Field Imaging [J].
Xiong, Zhiwei ;
Wang, Lizhi ;
Li, Huiqun ;
Liu, Dong ;
Wu, Feng .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6873-6881
[23]   Deep Unfolding for Snapshot Compressive Imaging [J].
Meng, Ziyi ;
Yuan, Xin ;
Jalali, Shirin .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2023, 131 (11) :2933-2958
[24]   Content-Aware Scalable Deep Compressed Sensing [J].
Chen, Bin ;
Zhang, Jian .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :5412-5426
[25]   Approximate Message Passing in Coded Aperture Snapshot Spectral Imaging [J].
Tan, Jin ;
Ma, Yanting ;
Rueda, Hoover ;
Baron, Dror ;
Arce, Gonzalo R. .
2015 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2015, :609-613
[26]   Compressive Hyperspectral Imaging With Spatial and Spectral Priors [J].
Zhang, Xinyue ;
Zhang, Xudong .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (11) :4156-4169
[27]   Hyperspectral image recovery based on fusion of coded aperture snapshot spectral imaging and RGB images by guided filtering [J].
Tao, Chenning ;
Zhu, Huanzheng ;
Sun, Peng ;
Wu, Rengmao ;
Zheng, Zhenrong .
OPTICS COMMUNICATIONS, 2020, 458
[28]   Video Object Segmentation for Content-Aware Video Compression [J].
Sun, Lu ;
Decombas, Marc ;
Lang, Jochen .
2016 13TH CONFERENCE ON COMPUTER AND ROBOT VISION (CRV), 2016, :116-123
[29]   Deep learning enabled reflective coded aperture snapshot spectral imaging [J].
Yu, Zhenming ;
Liu, Diyi ;
Cheng, Liming ;
Meng, Ziyi ;
Zhao, Zhengxiang ;
Yuan, Xin ;
Xu, Kun .
OPTICS EXPRESS, 2022, 30 (26) :46822-46837
[30]   Compressive Coded Aperture Spectral Imaging [J].
Arce, Gonzalo R. ;
Brady, David J. ;
Carin, Lawrence ;
Arguello, Henry ;
Kittle, David S. .
IEEE SIGNAL PROCESSING MAGAZINE, 2014, 31 (01) :105-115