Real-time Non-line-of-sight Imaging

被引:12
|
作者
O'Toole, Matthew [1 ]
Lindell, David B. [1 ]
Wetzstein, Gordon [1 ]
机构
[1] Stanford Univ, Stanford, CA 94305 USA
来源
SIGGRAPH'18: ACM SIGGRAPH 2018 EMERGING TECHNOLOGIES | 2018年
关键词
computational photography; single-photon sensors; time-of-flight imaging; non-line-of-sight imaging;
D O I
10.1145/3214907.3214920
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Non-line-of-sight (NLOS) imaging aims at recovering the shape of objects hidden outside the direct line of sight of a camera. In this work, we report on a new approach for acquiring time-resolved measurements that are suitable for NLOS imaging. The system uses a confocalized single-photon detector and pulsed laser. As opposed to previously-proposed NLOS imaging systems, our setup is very similar to LIDAR systems used for autonomous vehicles and it facilitates a closed-form solution of the associated inverse problem, which we derive in this work. This algorithm, dubbed the Light Cone Transform, is three orders of magnitude faster and more memory efficient than existing methods. We demonstrate experimental results for indoor and outdoor scenes captured and reconstructed with the proposed confocal NLOS imaging system.
引用
收藏
页数:2
相关论文
共 50 条
  • [1] Confocal Non-line-of-sight Imaging
    O'Toole, Matthew
    Lindell, David B.
    Wetzstein, Gordon
    SIGGRAPH'18: ACM SIGGRAPH 2018 TALKS, 2018,
  • [2] Thermal Non-Line-of-Sight Imaging
    Maeda, Tomohiro
    Wang, Yiqin
    Raskar, Ramesh
    Kadambi, Achuta
    2019 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY (ICCP), 2019,
  • [3] Learned Feature Embeddings for Non-Line-of-Sight Imaging and Recognition
    Chen, Wenzheng
    Wei, Fangyin
    Kutulakos, Kiriakos N.
    Rusinkiewicz, Szymon
    Heide, Felix
    ACM TRANSACTIONS ON GRAPHICS, 2020, 39 (06):
  • [4] Fast Non-line-of-sight Imaging with Non-planar Relay Surfaces
    Gu, Chaoying
    Sultan, Talha
    Masumnia-Bisheh, Khadijeh
    Waller, Laura
    Velten, Andreas
    2023 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY, ICCP, 2023,
  • [5] Photon-Efficient Non-Line-of-Sight Imaging
    Liu, Jianjiang
    Zhou, Yijun
    Huang, Xin
    Li, Zheng-Ping
    Xu, Feihu
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2022, 8 : 639 - 650
  • [6] Plug-and-Play Algorithms for Dynamic Non-line-of-sight Imaging
    Ye, Juntian
    Hong, Yu
    Su, Xiongfei
    Yuan, Xin
    Xu, Feihu
    ACM TRANSACTIONS ON GRAPHICS, 2024, 43 (05):
  • [7] Virtual Mirrors: Non-Line-of-Sight Imaging Beyond the Third Bounce
    Royo, Diego
    Sultan, Talha
    Munoz, Adolfo
    Masumnia-Bisheh, Khadijeh
    Brandt, Eric
    Gutierrez, Diego
    Velten, Andreas
    Marco, Julio
    ACM TRANSACTIONS ON GRAPHICS, 2023, 42 (04):
  • [8] A Dataset for Benchmarking Time-Resolved Non-Line-of-Sight Imaging
    Galindo, Miguel
    Marco, Julio
    O'Toole, Matthew
    Wetzstein, Gordon
    Gutierrez, Diego
    Jarabo, Adrian
    SIGGRAPH '19 - ACM SIGGRAPH 2019 POSTERS, 2019,
  • [9] Non-line-of-sight Imaging with Partial Occluders and Surface Normals
    Heide, Felix
    O'Toole, Matthew
    Zang, Kai
    Lindell, David
    Diamond, Steven
    Wetzstein, Gordon
    ACM TRANSACTIONS ON GRAPHICS, 2019, 38 (03):
  • [10] Non-line-of-Sight Imaging via Neural Transient Fields
    Shen, Siyuan
    Wang, Zi
    Liu, Ping
    Pan, Zhengqing
    Li, Ruiqian
    Gao, Tian
    Li, Shiying
    Yu, Jingyi
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (07) : 2257 - 2268