Ultrafast light field tomography for snapshot transient and non-line-of-sight imaging

被引:42
作者
Feng, Xiaohua [1 ]
Gao, Liang [1 ,2 ,3 ]
机构
[1] Univ Calif Los Angeles, Dept Bioengn, Los Angeles, CA 90095 USA
[2] Univ Illinois, Dept Elect & Comp Engn, Urbana, IL 61801 USA
[3] Univ Illinois, Beckman Inst Adv Sci & Technol, Urbana, IL 61801 USA
关键词
PHOTOGRAPHY; RECONSTRUCTION;
D O I
10.1038/s41467-021-22461-0
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Cameras with extreme speeds are enabling technologies in both fundamental and applied sciences. However, existing ultrafast cameras are incapable of coping with extended three-dimensional scenes and fall short for non-line-of-sight imaging, which requires a long sequence of time-resolved two-dimensional data. Current non-line-of-sight imagers, therefore, need to perform extensive scanning in the spatial and/or temporal dimension, restricting their use in imaging only static or slowly moving objects. To address these long-standing challenges, we present here ultrafast light field tomography (LIFT), a transient imaging strategy that offers a temporal sequence of over 1000 and enables highly efficient light field acquisition, allowing snapshot acquisition of the complete four-dimensional space and time. With LIFT, we demonstrated three-dimensional imaging of light in flight phenomena with a <10 picoseconds resolution and non-line-of-sight imaging at a 30 Hz video-rate. Furthermore, we showed how LIFT can benefit from deep learning for an improved and accelerated image formation. LIFT may facilitate broad adoption of time-resolved methods in various disciplines. Speed and 3D capability are often incompatible for non-line-of-sight imaging. Here, the authors introduce ultrafast light field tomography (LIFT) that uses an efficient light field acquisition technique to obtain 3D and time.
引用
收藏
页数:9
相关论文
共 43 条
[1]   Fast back-projection for non-line of sight reconstruction [J].
Arellano, Victor ;
Gutierrez, Diego ;
Jarabo, Adrian .
OPTICS EXPRESS, 2017, 25 (10) :11574-11583
[2]   A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [J].
Beck, Amir ;
Teboulle, Marc .
SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01) :183-202
[3]   Single-photon avalanche diode imagers in biophotonics: review and outlook [J].
Bruschini, Claudio ;
Homulle, Harald ;
Antolovic, Ivan Michel ;
Burri, Samuel ;
Charbon, Edoardo .
LIGHT-SCIENCE & APPLICATIONS, 2019, 8 (1)
[4]   THE ILL-CONDITIONED NATURE OF THE LIMITED ANGLE TOMOGRAPHY PROBLEM [J].
DAVISON, ME .
SIAM JOURNAL ON APPLIED MATHEMATICS, 1983, 43 (02) :428-448
[5]   Non-line-of-sight imaging [J].
Faccio, Daniele ;
Velten, Andreas ;
Wetzstein, Gordon .
NATURE REVIEWS PHYSICS, 2020, 2 (06) :318-327
[6]   Improving non-line-of-sight age reconstruction with weighting factors [J].
Feng, Xiaohua ;
Gao, Liang .
OPTICS LETTERS, 2020, 45 (14) :3917-3920
[7]   Single-shot compressed ultrafast photography at one hundred billion frames per second [J].
Gao, Liang ;
Liang, Jinyang ;
Li, Chiye ;
Wang, Lihong V. .
NATURE, 2014, 516 (7529) :74-U159
[8]  
Gariepy G, 2016, NAT PHOTONICS, V10, P23, DOI [10.1038/nphoton.2015.234, 10.1038/NPHOTON.2015.234]
[9]   Serial time-encoded amplified imaging for real-time observation of fast dynamic phenomena [J].
Goda, K. ;
Tsia, K. K. ;
Jalali, B. .
NATURE, 2009, 458 (7242) :1145-U80
[10]   High-speed 3D sensing via hybrid-mode imaging and guided upsampling [J].
Gyongy, Istvan ;
Hutchings, Sam W. ;
Halimi, Abderrahim ;
Tyler, Max ;
Chan, Susan ;
Zhu, Feng ;
McLaughlin, Stephen ;
Henderson, Robert K. ;
Leach, Jonathan .
OPTICA, 2020, 7 (10) :1253-1260