Recent Advances on Non-Line-of-Sight Imaging: Conventional Physical Models, Deep Learning, and New Scenes

被引:20
作者
Geng, Ruixu [1 ]
Hu, Yang [2 ]
Chen, Yan [3 ]
机构
[1] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 611731, Peoples R China
[2] Univ Sci & Technol China, Sch Informat Sci & Technol, Hefei 230026, Peoples R China
[3] Univ Sci & Technol China, Sch Cyber Sci & Technol, Hefei 230026, Peoples R China
基金
中国国家自然科学基金;
关键词
Non-line-of-sight (NLOS); deep learning; active NLOS imaging; passive NLOS imaging; RECONSTRUCTION; ILLUMINATION;
D O I
10.1561/116.00000019
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As an emerging technology that has attracted huge attention, non-line-of-sight (NLOS) imaging can reconstruct hidden objects by analyzing the diffuse reflection on a relay surface, with broad application prospects in the fields of autonomous driving, medical imaging, and defense. Despite the challenges of low signal-to-noise ratio (SNR) and high ill-posedness, NLOS imaging has been developed rapidly in recent years. Most current NLOS imaging technologies use conventional physical models, constructing imaging models through active or passive illumination and using reconstruction algorithms to restore hidden scenes. Moreover, deep learning algorithms for NLOS imaging have also received much attention recently. This paper presents a comprehensive overview of both conventional and deep learning-based NLOS imaging techniques. Besides, we also survey new proposed NLOS scenes, and discuss the challenges and prospects of existing technologies. Such a survey can help readers have an overview of different types of NLOS imaging, thus expediting the development of seeing around corners.
引用
收藏
页数:48
相关论文
共 121 条
[1]  
Ahn B, 2019, IEEE INT C COMPUTER
[2]  
Aittala M, 2019, ADV NEUR IN, V32
[3]   THE ROLE OF PARTIAL OCCLUSION IN STEREOPSIS [J].
ANDERSON, BL .
NATURE, 1994, 367 (6461) :365-368
[4]   Fast back-projection for non-line of sight reconstruction [J].
Arellano, Victor ;
Gutierrez, Diego ;
Jarabo, Adrian .
OPTICS EXPRESS, 2017, 25 (10) :11574-11583
[5]   A study of pile-up in integrated time-correlated single photon counting systems [J].
Arlt, Jochen ;
Tyndall, David ;
Rae, Bruce R. ;
Li, David D. -U. ;
Richardson, Justin A. ;
Henderson, Robert K. .
REVIEW OF SCIENTIFIC INSTRUMENTS, 2013, 84 (10)
[6]   Inferring Light Fields from Shadows [J].
Baradad, Manel ;
Ye, Vickie ;
Yedidia, Adam B. ;
Durand, Fredo ;
Freeman, William T. ;
Wornell, Gregory W. ;
Torralba, Antonio .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6267-6275
[7]   Passive sensing around the corner using spatial coherence [J].
Batarseh, M. ;
Sukhov, S. ;
Shen, Z. ;
Gemar, H. ;
Rezvani, R. ;
Dogariu, A. .
NATURE COMMUNICATIONS, 2018, 9
[8]   Multi-Modal Non-Line-of-Sight Passive Imaging [J].
Beckus, Andre ;
Tamasan, Alexandru ;
Ati, George K. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (07) :3372-3382
[9]   Non-invasive imaging through opaque scattering layers [J].
Bertolotti, Jacopo ;
van Putten, Elbert G. ;
Blum, Christian ;
Lagendijk, Ad ;
Vos, Willem L. ;
Mosk, Allard P. .
NATURE, 2012, 491 (7423) :232-234
[10]   Passive optical time-of-flight for non line-of-sight localization [J].
Boger-Lombard, Jeremy ;
Katz, Ori .
NATURE COMMUNICATIONS, 2019, 10 (1)