Non-line-of-sight imaging over 1.43 km

被引:99
|
作者
Wu, Cheng [1 ,2 ,3 ,4 ]
Liu, Jianjiang [1 ,2 ,3 ,4 ,5 ]
Huang, Xin [1 ,2 ,3 ,4 ]
Li, Zheng-Ping [1 ,2 ,3 ,4 ]
Yu, Chao [1 ,2 ,3 ,4 ]
Ye, Jun-Tian [1 ,2 ,3 ,4 ]
Zhang, Jun [1 ,2 ,3 ,4 ]
Zhang, Qiang [1 ,2 ,3 ,4 ]
Dou, Xiankang [1 ,2 ,5 ,6 ]
Goyal, Vivek K. [7 ]
Xu, Feihu [1 ,2 ,3 ,4 ]
Pan, Jian-Wei [1 ,2 ,3 ,4 ]
机构
[1] Univ Sci & Technol China, Hefei Natl Lab Phys Sci Microscale, Hefei 230026, Peoples R China
[2] Univ Sci & Technol China, Dept Modern Phys, Hefei 230026, Peoples R China
[3] Univ Sci & Technol China, CAS Ctr Excellence Quantum Informat & Quantum Phy, Shanghai Branch, Shanghai 201315, Peoples R China
[4] Shanghai Res Ctr Quantum Sci, Shanghai 201315, Peoples R China
[5] Univ Sci & Technol China, Sch Earth & Space Sci, Hefei 230026, Peoples R China
[6] Wuhan Univ, Sch Elect Informat, Wuhan 430072, Peoples R China
[7] Boston Univ, Dept Elect & Comp Engn, Boston, MA 02215 USA
基金
上海市科技启明星计划; 中国国家自然科学基金;
关键词
non-line-of-sight imaging; optical imaging; computational imaging; computer vision; RECONSTRUCTION; SCENES;
D O I
10.1073/pnas.2024468118
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Non-line-of-sight (NLOS) imaging has the ability to reconstruct hidden objects from indirect light paths that scatter multiple times in the surrounding environment, which is of considerable interest in a wide range of applications. Whereas conventional imaging involves direct line-of-sight light transport to recover the visible objects, NLOS imaging aims to reconstruct the hidden objects from the indirect light paths that scatter multiple times, typically using the information encoded in the time-of-flight of scattered photons. Despite recent advances, NLOS imaging has remained at short-range realizations, limited by the heavy loss and the spatial mixing due to the multiple diffuse reflections. Here, both experimental and conceptual innovations yield hardware and software solutions to increase the standoff distance of NLOS imaging from meter to kilometer range, which is about three orders of magnitude longer than previous experiments. In hardware, we develop a high-efficiency, low-noise NLOS imaging system at near-infrared wavelength based on a dual-telescope confocal optical design. In software, we adopt a convex optimizer, equipped with a tailored spatial-temporal kernel expressed using three-dimensional matrix, to mitigate the effect of the spatial-temporal broadening over long standoffs. Together, these enable our demonstration of NLOS imaging and real-time tracking of hidden objects over a distance of 1.43 km. The results will open venues for the development of NLOS imaging techniques and relevant applications to real-world conditions.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] Thermal Non-Line-of-Sight Imaging
    Maeda, Tomohiro
    Wang, Yiqin
    Raskar, Ramesh
    Kadambi, Achuta
    2019 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY (ICCP), 2019,
  • [2] Non-line-of-sight imaging
    Faccio, Daniele
    Velten, Andreas
    Wetzstein, Gordon
    NATURE REVIEWS PHYSICS, 2020, 2 (06) : 318 - 327
  • [3] Non-line-of-sight imaging with adaptive artifact cancellation
    Zhou, Hongyuan
    Chen, Ziyang
    Qiu, Jumin
    Zhong, Sijia
    Zhang, Dejian
    Wang, Tongbiao
    Liu, Qiegen
    Yu, Tianbao
    OPTICS AND LASER TECHNOLOGY, 2025, 182
  • [4] Exploiting Occlusion in Non-Line-of-Sight Active Imaging
    Thrampoulidis, Christos
    Shulkind, Gal
    Xu, Feihu
    Freeman, William T.
    Shapiro, Jeffrey H.
    Torralba, Antonio
    Wong, Franco N. C.
    Wornell, Gregory W.
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2018, 4 (03): : 419 - 431
  • [5] Confocal Non-line-of-sight Imaging
    O'Toole, Matthew
    Lindell, David B.
    Wetzstein, Gordon
    SIGGRAPH'18: ACM SIGGRAPH 2018 TALKS, 2018,
  • [6] Photon-Efficient Non-Line-of-Sight Imaging
    Liu, Jianjiang
    Zhou, Yijun
    Huang, Xin
    Li, Zheng-Ping
    Xu, Feihu
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2022, 8 : 639 - 650
  • [7] Domain Reduction Strategy for Non-Line-of-Sight Imaging
    Shim, Hyunbo
    Cho, In
    Kwon, Daekyu
    Kim, Seon Joo
    COMPUTER VISION - ECCV 2024, PT XXXI, 2025, 15089 : 75 - 92
  • [8] The role of Wigner Distribution Function in Non-Line-of-Sight Imaging
    Liu, Xiaochun
    Velten, Andreas
    2020 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY (ICCP), 2020,
  • [9] Passive Non-Line-of-Sight Imaging Using Optimal Transport
    Geng, Ruixu
    Hu, Yang
    Lu, Zhi
    Yu, Cong
    Li, Houqiang
    Zhang, Hengyu
    Chen, Yan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 110 - 124
  • [10] Error Backprojection Algorithms for Non-Line-of-Sight Imaging
    La Manna, Marco
    Kine, Fiona
    Breitbach, Eric
    Jackson, Jonathan
    Sultan, Talha
    Velten, Andreas
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (07) : 1615 - 1626