Spectral DiffuserCam: lensless snapshot hyperspectral imaging with a spectral filter array

被引:174
作者
Monakhova, Kristina [1 ]
Yanny, Kyrollos [2 ]
Aggarwal, Neerja [1 ]
Waller, Laura [1 ,2 ]
机构
[1] Univ Calif Berkeley, Dept Elect Engn & Comp Sci, Berkeley, CA 94720 USA
[2] Univ Calif Berkeley, UCB UCSF Joint Grad Program Bioengn, Berkeley, CA 94720 USA
基金
美国国家科学基金会;
关键词
SPECTROSCOPY; ALGORITHM; SYSTEM; CAMERA;
D O I
10.1364/OPTICA.397214
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Hyperspectral imaging is useful for applications ranging from medical diagnostics to agricultural crop monitoring; however, traditional scanning hyperspectral imagers are prohibitively slow and expensive for widespread adoption. Snapshot techniques exist but are often confined to bulky benchtop setups or have lowspatio-spectral resolution. In this paper, we propose a novel, compact, and inexpensive computational camera for snapshot hyperspectral imaging. Our system consists of a tiled spectral filter array placed directly on the image sensor and a diffuser placed close to the sensor. Each point in the world maps to a unique pseudorandom pattern on the spectral filter array, which encodes multiplexed spatio-spectral information. By solving a sparsity-constrained inverse problem, we recover the hyperspectral volume with sub-super-pixel resolution. Our hyperspectral imaging framework is flexible and can be designed with contiguous or non-contiguous spectral filters that can be chosen for a given application. We provide theory for system design, demonstrate a prototype device, and present experimental results with high spatio-spectral resolution. (C) 2020 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
引用
收藏
页码:1298 / 1307
页数:10
相关论文
共 49 条
[21]   Compressed sensing snapshot spectral imaging by a regular digital camera with an added optical diffuser [J].
Golub, Michael A. ;
Averbuch, Amir ;
Nathan, Menachem ;
Zheludev, Valery A. ;
Hauser, Jonathan ;
Gurevitch, Shay ;
Malinsky, Roman ;
Kagan, Asaf .
APPLIED OPTICS, 2016, 55 (03) :432-443
[22]   Hyperspectral imaging - an emerging process analytical tool for food quality and safety control [J].
Gowen, A. A. ;
O'Donnell, C. P. ;
Cullen, P. J. ;
Downey, G. ;
Frias, J. M. .
TRENDS IN FOOD SCIENCE & TECHNOLOGY, 2007, 18 (12) :590-598
[23]   Imaging spectroscopy and the Airborne Visible Infrared Imaging Spectrometer (AVIRIS) [J].
Green, RO ;
Eastwood, ML ;
Sarture, CM ;
Chrien, TG ;
Aronsson, M ;
Chippendale, BJ ;
Faust, JA ;
Pavri, BE ;
Chovit, CJ ;
Solis, MS ;
Olah, MR ;
Williams, O .
REMOTE SENSING OF ENVIRONMENT, 1998, 65 (03) :227-248
[24]   Dual-camera snapshot spectral imaging with a pupil-domain optical diffuser and compressed sensing algorithms [J].
Hauser, Jonathan ;
Golub, Michael A. ;
Averbuch, Amir ;
Nathan, Menachem ;
Zheludev, Valery A. ;
Kagan, Michael .
APPLIED OPTICS, 2020, 59 (04) :1058-1070
[25]   Hyperspectral Classification of Plants: A Review of Waveband Selection Generalisability [J].
Hennessy, Andrew ;
Clarke, Kenneth ;
Lewis, Megan .
REMOTE SENSING, 2020, 12 (01)
[26]   Development of a multispectral imaging system for online detection of bruises on apples [J].
Huang, Wenqian ;
Li, Jiangbo ;
Wang, Qingyan ;
Chen, Liping .
JOURNAL OF FOOD ENGINEERING, 2015, 146 :62-71
[27]   Compact Snapshot Hyperspectral Imaging with Diffracted Rotation [J].
Jeon, Daniel S. ;
Baek, Seung-Hwan ;
Yi, Shinyoung ;
Fu, Qiang ;
Dun, Xiong ;
Heidrich, Wolfgang ;
Kim, Min H. .
ACM TRANSACTIONS ON GRAPHICS, 2019, 38 (04)
[28]   A Parallel Proximal Algorithm for Anisotropic Total Variation Minimization [J].
Kamilov, Ulugbek S. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (02) :539-548
[29]   Real-time snapshot hyperspectral imaging endoscope [J].
Kester, Robert T. ;
Bedard, Noah ;
Gao, Liang ;
Tkaczyk, Tomasz S. .
JOURNAL OF BIOMEDICAL OPTICS, 2011, 16 (05)
[30]   Multispectral Filter Arrays: Recent Advances and Practical Implementation [J].
Lapray, Pierre-Jean ;
Wang, Xingbo ;
Thomas, Jean-Baptiste ;
Gouton, Pierre .
SENSORS, 2014, 14 (11) :21626-21659