Mid-Wave Infrared Snapshot Compressive Spectral Imager with Deep Infrared Denoising Prior

被引:5
作者
Yang, Shuowen [1 ]
Qin, Hanlin [1 ]
Yan, Xiang [1 ]
Yuan, Shuai [1 ]
Zeng, Qingjie [2 ]
机构
[1] Xidian Univ, Sch Optoelect Engn, Xian 710071, Peoples R China
[2] Xian Inst Modern Control Technol, Xian 710065, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
spectral imaging; compressive sensing; mid-wave infrared; deep denoising prior; DESIGN; ALGORITHMS; RESOLUTION;
D O I
10.3390/rs15010280
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Although various infrared imaging spectrometers have been studied, most of them are developed under the Nyquist sampling theorem, which severely burdens 3D data acquisition, storage, transmission, and processing, in terms of both hardware and software. Recently, computational imaging, which avoids direct imaging, has been investigated for its potential in the visible field. However, it has been rarely studied in the infrared domain, as it suffers from inconsistency in spectral response and reconstruction. To address this, we propose a novel mid-wave infrared snapshot compressive spectral imager (MWIR-SCSI). This design scheme provides a high degree of randomness in the measurement projection, which is more conducive to the reconstruction of image information and makes spectral correction implementable. Furthermore, leveraging the explainability of model-based algorithms and the high efficiency of deep learning algorithms, we designed a deep infrared denoising prior plug-in for the optimization algorithm to perform in terms of both imaging quality and reconstruction speed. The system calibration obtains 111 real coded masks, filling the gap between theory and practice. Experimental results on simulation datasets and real infrared scenarios prove the efficacy of the designed deep infrared denoising prior plug-in and the proposed acquisition architecture that acquires mid-infrared spectral images of 640 pixels x 512 pixels x 111 spectral channels at an acquisition frame rate of 50 fps.
引用
收藏
页数:19
相关论文
共 62 条
[21]   HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging [J].
Hu, Xiaowan ;
Cai, Yuanhao ;
Lin, Jing ;
Wang, Haoqian ;
Yuan, Xin ;
Zhang, Yulun ;
Timofte, Radu ;
Van Gool, Luc .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :17521-17530
[22]   Deep Gaussian Scale Mixture Prior for Spectral Compressive Imaging [J].
Huang, Tao ;
Dong, Weisheng ;
Yuan, Xin ;
Wu, Jinjian ;
Shi, Guangming .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :16211-16220
[23]   Video-rate, mid-infrared hyperspectral upconversion imaging [J].
Junaid, S. ;
Kumar, S. Chaitanya ;
Mathez, M. ;
Hermes, M. ;
Stone, N. ;
Shephero, N. ;
Ebrahim-Zadeh, M. ;
Tidemand-Lichtenberg, P. ;
Pedersen, C. .
OPTICA, 2019, 6 (06) :702-708
[24]   Mid-infrared upconversion based hyperspectral imaging [J].
Junaid, Saher ;
Tomko, Jan ;
Semtsiv, Mykhaylo P. ;
Kischkat, Jan ;
Masselink, W. Ted ;
Pedersen, Christian ;
Tidemand-Lichtenberg, Peter .
OPTICS EXPRESS, 2018, 26 (03) :2203-2211
[25]  
Kingma DP, 2014, ADV NEUR IN, V27
[26]   Multiframe image estimation for coded aperture snapshot spectral imagers [J].
Kittle, David ;
Choi, Kerkil ;
Wagadarikar, Ashwin ;
Brady, David J. .
APPLIED OPTICS, 2010, 49 (36) :6824-6833
[27]   THE SPECTRAL IMAGE-PROCESSING SYSTEM (SIPS) - INTERACTIVE VISUALIZATION AND ANALYSIS OF IMAGING SPECTROMETER DATA [J].
KRUSE, FA ;
LEFKOFF, AB ;
BOARDMAN, JW ;
HEIDEBRECHT, KB ;
SHAPIRO, AT ;
BARLOON, PJ ;
GOETZ, AFH .
REMOTE SENSING OF ENVIRONMENT, 1993, 44 (2-3) :145-163
[28]   Single-shot multispectral imaging through a thin scatterer [J].
Li, Xiaohan ;
Greenberg, Joel A. ;
Gehm, Michael E. .
OPTICA, 2019, 6 (07) :864-871
[29]   Spatial-spectral Encoded Compressive Hyperspectral Imaging [J].
Lin, Xing ;
Liu, Yebin ;
Wu, Jiamin ;
Dai, Qionghai .
ACM TRANSACTIONS ON GRAPHICS, 2014, 33 (06)
[30]   Residual image recovery method based on the dual-camera design of a compressive hyperspectral imaging system [J].
Liu, Xinyu ;
Yu, Zeqing ;
Zheng, Shuhang ;
Li, Yong ;
Tao, Xiao ;
Wu, Fei ;
Xie, Qin ;
Sun, Yan ;
Wang, Chang ;
Zheng, Zhenrong .
OPTICS EXPRESS, 2022, 30 (11) :20100-20116