Deeply learned broadband encoding stochastic hyperspectral imaging

被引:118
作者
Zhang, Wenyi [1 ]
Song, Hongya [1 ]
He, Xin [1 ,2 ]
Huang, Longqian [1 ]
Zhang, Xiyue [1 ]
Zheng, Junyan [1 ]
Shen, Weidong [1 ]
Hao, Xiang [1 ,2 ]
Liu, Xu [1 ]
机构
[1] Zhejiang Univ, Coll Opt Sci & Technol, State Key Lab Modern Opt Instrumentat, Hangzhou 310027, Peoples R China
[2] Zhejiang Univ, Intelligent Opt & Photon Res Ctr, Jiaxing Inst, Jiaxing 314000, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
27;
D O I
10.1038/s41377-021-00545-2
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Many applications requiring both spectral and spatial information at high resolution benefit from spectral imaging. Although different technical methods have been developed and commercially available, computational spectral cameras represent a compact, lightweight, and inexpensive solution. However, the tradeoff between spatial and spectral resolutions, dominated by the limited data volume and environmental noise, limits the potential of these cameras. In this study, we developed a deeply learned broadband encoding stochastic hyperspectral camera. In particular, using advanced artificial intelligence in filter design and spectrum reconstruction, we achieved 7000-11,000 times faster signal processing and similar to 10 times improvement regarding noise tolerance. These improvements enabled us to precisely and dynamically reconstruct the spectra of the entire field of view, previously unreachable with compact computational spectral cameras.
引用
收藏
页数:7
相关论文
共 27 条
[1]  
Alford T.L., 2007, Fundamentals of Nanoscale Film Analysis
[2]   The origin of reconnection-mediated transient brightenings in the solar transition region [J].
Bahauddin, Shah Mohammad ;
Bradshaw, Stephen J. ;
Winebarger, Amy R. .
NATURE ASTRONOMY, 2021, 5 (03) :237-+
[3]   A colloidal quantum dot spectrometer [J].
Bao, Jie ;
Bawendi, Moungi G. .
NATURE, 2015, 523 (7558) :67-+
[4]   IEEE-SPS and connexions - An open access education collaboration [J].
Baraniuk, Richard G. ;
Burrus, C. Sidney ;
Thierstein, E. Joel .
IEEE SIGNAL PROCESSING MAGAZINE, 2007, 24 (06) :6-+
[5]  
Cai X., 2020, ONE SHOT ULTRASPECTR
[6]   Computational Snapshot Multispectral Cameras Toward dynamic capture of the spectral world [J].
Cao, Xun ;
Yue, Tao ;
Lin, Xing ;
Lin, Stephen ;
Yuan, Xin ;
Dai, Qionghai ;
Carin, Lawrence ;
Brady, David J. .
IEEE SIGNAL PROCESSING MAGAZINE, 2016, 33 (05) :95-108
[7]   High-Quality Hyperspectral Reconstruction Using a Spectral Prior [J].
Choi, Inchang ;
Jeon, Daniel S. ;
Nam, Giljoo ;
Gutierrez, Diego ;
Kim, Min H. .
ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (06)
[8]   Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems [J].
Figueiredo, Mario A. T. ;
Nowak, Robert D. ;
Wright, Stephen J. .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2007, 1 (04) :586-597
[9]   Near-UV to mid-IR reflectance imaging spectroscopy of paintings on the macroscale [J].
Gabrieli, F. ;
Dooley, K. A. ;
Facini, M. ;
Delaney, J. K. .
SCIENCE ADVANCES, 2019, 5 (08)
[10]   A Bidirectional Deep Neural Network for Accurate Silicon Color Design [J].
Gao, Li ;
Li, Xiaozhong ;
Liu, Dianjing ;
Wang, Lianhui ;
Yu, Zongfu .
ADVANCED MATERIALS, 2019, 31 (51)